There's a hardware store just down the street from me that has a small homebrew supply section. I get all my odds & ends from them that I can (dry yeast, DME, the occasional small equipment purchase, gypsum and so on). It's convenient as hell that they are so close, plus I live in a rather small town, so I try to support them as much as possible.
What may be more useful for you is why I don't use the two LHBS near me very often (I do about 95% of my grain, hops and liquid yeast purchases online). First of all, neither one is open convenient hours. They are both open a handful of weekday nights and limited weekend hours. They just aren't really useful given my work and family schedule. One of them is run by a guy who is a bit of a know-it-all, but gives out a lot of outdated info. The other one is often staffed by people who don't seem to know a hell of a lot regarding their ingredients. The main reason I do shop at either is if I need a last-minute ingredient. All too often they don't have what I'm looking for in those situations, either. And neither shop stocks Wyeast, which is annoying, too.
My ideal LHBS would be a place that is open normal business hours, and run by knowledgeable, helpful staff. A good selection, including both White Labs and Wyeast, is a big plus as well.