I find that bugs add a pleasant yet subtle earthiness that you just can't get from rinsed hops.
And I'm pulling your leg.
But you can and should indeed just throw 'em in. Don't forget that if you're using fresh undried hops, you need to use 5 times as much by weight as you would use for dry because 80% of them is flavorless water weight.