The one cherry stout I tried a couple years back (Bell's) I didn't like. And I realized afterwards I don't like cherries in any beer, period (though I do like cherries). So I am biased, but as far as I am concerned, it's like leaving out okra in just about any recipe, including fried okra... it can only be improved.
How does it taste? Do you like it? I made an oatmeal stout last winter flavored with a cold water extract of french roast coffee and a vodka extract of organic cocoa nibs, and it was deeeeeelish. Maybe the coffee is enough, but a little cocoa, a little vanilla... you can have fun with stout. It goes well with those warm dessert flavors. And at a fraction of the cost of out-of-season berries.