The news items you talk about, are they entries in the club news blog? How do you mean the comments appear as news items?
They are coming from NewsFeedFilteringManager.GetNewsFeedStories.
Well we settled this but I'll post the solution here in case someone else has similar problems and finds the thread.
The NewsFeed shows "Stories" that can be created in the Community framework when something happens, for example when someone posts a comment. This is handled by adding an event handler to the CommentHandler.CommentAdded event etc. In the event handler a separate NewsFeedStory object is created and committed to the database. Because the NewsFeed shows the NewsFeedStory and not the Comment it can remain even if the Comment is removed.
To fix this, the class rendering the NewsFeed should check if the Comment corresponding to the NewsFeedStory still exists and has not been hard or soft removed (it's status set to Removed). NewsFeedStories can have Actors and Targets and Actors can have Attachments. If the event handler for the CommentAdded event is implemented in a good way it will add the Comment itself as a reference to the NewsFeedStory, for example as an Attachment to one of the Actors. This means that when the NewsFeedStory is to be rendered it is possible to get a reference to the Comment and see if it still exists and doesn't have status removed, in which case you can choose to not render the story.