I put it in at the start of the boil so I don't forget! Also, it has an impact on hop utilization, and I figure my hopping based on the wort gravity with the sugar in there. I guess I just haven't found a good reason not to add it at the beginning of the boil.