How do you know the temperature is moving from 10-20 degrees? Beer (as water does) has quite the thermal mass and I would be surprised if the actual temperature of your beer itself moved that much in one day, unless it is extremely cold or extremely hot where you live. Colder is most definitely better for finished beer, as warmer temps will stale the flavors faster.
Where are you keeping your secondary fermentors?