With all of that work, and a desire to bottle after 4 weeks of waiting, I FORGOT TO SCRUB THE INSIDE OF THE BOTTLES WITH A BOTTLE BRUSH
If you soaked in OxiClean, I don't think this is an issue. To be honest, I just rinse my bottles right after pouring - no scrubbing. The only time I ever use my bottle brush is if there's visible crud on the bottom that won't rinse clean. Frankly, OxiClean should get most of that. My bet is that you'll be fine.
I always get residue from oxyclean that I need an ice pick to get off. It doesn't seem to matter how much I rinse. When I use that stuff I have to use a bottle brush to get it out.