I say work on the harder/complex wort before adding the simple/less complex fruit to ferment. I treat it much like Belgians. I add my sugar after the yeast works out the majority of the beer is done, then pitch rack to fruit or dump into the primary.