Confessional...
I have been saying for years that secondary is optional, and for many folks, I still believe that is true. However, as a bottler (I don't keg), as I have become older and wiser and also more concerned about beer clarity (I love a crystal clear beer!), I have more recently begun to realize the value of racking to secondary. I don't want sediment in the bottoms of all my bottles. Often times in the past I had experienced what you have where just moving the fermenter around on bottling day causes enough trub to get mixed in to where I was getting up to about 1/4 to 3/8 inch of junk in every bottle, and I really dislike that. So, now on more recent batches in 2017 & 2018, I have decided that as long as I am not in a real hurry (rarely), I should indeed secondary for at least a couple of days to try to reduce this effect. If I was kegging, I wouldn't care, I could just waste the first pint or two or gulp it down sludge and all. But, since I always bottle, I now choose to rack to secondary more often going forward. I am doing this for my latest Scottish ale which is very clear when not disturbed, but just a couple of days ago when I racked to secondary, just the act of doing that clouded it up a lot, so I'm glad I racked it. It is much clearer today and I will bottle it up tonight.
Not sure if this helps, but these are my recent feelings on the topic. Maybe rack it, wait a couple days, then bottle (or even keg), and enjoy more without all that dang extra sediment.