What version of Outlook? Exchange/Office365 account or just pop/smtp (i.e. yahoo.com) account?
On my work PC, using Outlook 2013, it basically File->Account Settings->Account Settings->RSS Feed tab and then delete the feed.
Also, if you delete the folder from the RSS Subscriptions folder in your email folder list, it does the same thing (at least on my setup).