I guess it depends on your climate.
I'm in Chicago, and the weather here fluctuates like a crazy-man. Plus I have a smaller tank; smaller size = wider temp fluctuations.
I used to not have a heater...and my tank had a low of 68 and would go up to 70 by mid-day (during the winter here). However, since I have been dealing w/some sickness, I purchased a heater and have the tank at a toasty 73. And he is loving it.
Goldfish can tolerate cooler water temps. I know my guys were okay w/it being 68. I just now prefer it to be a bit warmer for him.