Yes, disassemble everything.
Throw away the rubber parts of your kegs and replace them (usually about 6 bucks for O-ring sets, and similar amount for replacement poppets.
If you have a plastic picnic tap, get rid of it too.
Then, clean everyghing thoroughly (Oxyclean or PBW) and then sanitize thoroughly with at least 2 different sanitizers like Iodophor AND Star-San. Using more than 1 sanitizer will kill everything.
HTH-