I assume you're looking at American IPA. I don't think you should focus on the water. Look at:
- Not enough late hop additions(should be at least 50% of the total hops < 20 minutes)
- Not enough dry hopping (3 oz /5 gallon)
- Oxidation - do NOT do a seconday, be careful to avoid splashing when bottling, and if you're kegging, purge the keg first.
- Make sure the hops are fresh. If you have any doubts about the whole hops you get (i.e. they are brown), use pellets.