It's not currently possible to delete purchases from your fan collection, but you can hide them. Just make sure you're logged in, hover over the item, and click the "hide" link that appears under the album art.
This will move the item to the "hidden" section of your collection, and it will no longer be visible to the public.