It sounds to me like some sanitation related problem
Well, I use to clean the keg, the pump some of it up the pick up tube, and thru the line, and let it sit for an hour, then the same with star san.
Maybe the soap is affecting the taste if there is any residue.
I thought PBW and Starsans claim to fame was that it didnt need to be rinsed.
If it is a small beer just leave it in the primary up to thrree weeks or so and then rack to the keg
Mine usually stays in the primary for 1-2 weeks, then in the secondary for another 2-3. Like I said earlier, its noteworthy that there's a small area around the pickup that's cleared of trub, only conclusion is that its been picked up and fed into the beer mug as its poured.
How far down does everyone's pick up tubes extend? mine almost touch the bottom of the convex.
There are people who DIY CO2 refills. Perhaps they don't always get it right? I always go to the local Airgas Gaspro to refill, to make sure they do get it right.
*chuckle* nope, get mine done at a fire extinguisher place.