Rising Spam on Facebook: AI-Generated Content Is Taking Over the Feed

Facebook users are seeing a surge in AI-generated spam in their feeds, often with misleading or inauthentic content. But how is Meta planning to tackle the problem? Read more to find out.

Share
Rising Spam on Facebook: AI-Generated Content Is Taking Over the Feed

If you've recently paused on a strange photo in your Facebook feed, you're not alone. Many users who used to visit Facebook to keep in touch with friends and family are now complaining that random, spam-like content - often created by artificial intelligence - keeps showing up in their feeds.

Images that are obviously AI-generated, like the now-infamous "Shrimp Jesus," and old posts from real creators being reshared by bot accounts for engagement, are common. In other cases, pages share streams of seemingly harmless but random content, such as memes or movie clips, popping up every couple of hours.

AI spam image "Shrimp Jesus"

Spam Can Be Used to Manipulate

This spam is more than just an annoyance; it can also be exploited for fraudulent purposes. Some spam pages appear designed to deceive users, and in extreme cases, these pages that gain followers can be used by, for example, foreign actors to sow division ahead of elections, according to experts on inauthentic online behavior.

Facebook's Strategy Shift Behind the Change

This rise in spam coincides with a deliberate shift in Facebook's strategy in recent years. After criticism for contributing to election manipulation and real-world violence, the company scaled back its focus on current events and politics. Inspired by TikTok's entertainment focus, Facebook redesigned its feeds into a "discovery engine," hoping to get users to engage with content they might not otherwise see.

This push for more "discoverable" content has led to an algorithm that often surfaces shallow, misleading, or AI-generated content.

AI-Generated Content Fills Feeds

AI-generated or recycled memes have appeared on Facebook's quarterly list of most-viewed content. Posts with obviously AI-generated images and confusing captions sometimes rack up thousands of likes, comments, and shares. Bad actors and "engagement farmers" are quick to fill Facebook's appetite for new content, and the latest AI tools make it easier than ever to quickly churn out large volumes of fake images and text.

Meta: Here's How We're Fighting Spam

Facebook's parent company Meta is working to reduce the spread of spam and ensure a positive user experience. Meta encourages creators to use AI tools to produce high-quality content that follows community standards. The company also takes action against those trying to manipulate traffic through inauthentic engagement, regardless of whether they use AI or not, according to spokesperson Erin Logan.

What Can Be Done About AI Spam?

With AI tools, bad actors no longer need many people to quickly create large amounts of fake content - the technology does it for them. For Facebook, it would be challenging to identify every AI-generated image uploaded each day without making mistakes, especially at a time when the technology is evolving so quickly. Meta has also cut back its resources for handling fake content, meaning it relies more heavily on automated moderation systems that can be manipulated.