The most important time for temp control is the first 72-96 hours. However, I would not move the fermenter to a place that gets much colder than 60 (for ales) until the beer is completely finished. If it gets too cool, the yeast may drop out early and not finish fermenting/clean up.
Overall though, RDWHAHB.