The Data Theft Dilemma: How Perplexity’s AI Ambitions Spark Legal Firestorm Over Web Scraping Ethics

The Legal Battle Over AI’s Data Diet

In a landmark lawsuit that could reshape how artificial intelligence companies access training data, Reddit has launched legal action against Perplexity AI and several data scraping firms, alleging systematic theft of proprietary content. The complaint, filed in Manhattan federal court, paints a dramatic picture of corporate evasion and technological subterfuge, claiming these companies built billion-dollar valuations on improperly acquired data while deliberately circumventing digital protections.

Reddit’s Accusations: From Cease-and-Desist to Alleged Evasion

According to court documents, Reddit had previously sent Perplexity a cease-and-desist letter in May 2024, demanding the AI company stop scraping Reddit data without proper licensing agreements. This came after Reddit had established data licensing deals with major tech players including Google and OpenAI, creating a precedent for compensated data access.

The lawsuit claims Perplexity responded by claiming it “was not using Reddit content to train any AI models and that it would respect Reddit’s robots.txt” protocols. However, Reddit alleges that instead of compliance, Perplexity’s citations of Reddit content actually increased “forty-fold after Reddit told it to stop,” suggesting the company found alternative methods to access the coveted data.

The Technical End-Run: How Reddit Claims Data Was Taken

Reddit’s legal team describes what they characterize as “increasingly devious schemes” to bypass security measures. The core allegation revolves around Perplexity allegedly using third-party data scrapers to access Reddit content indirectly through Google’s search engine results.

“In other words, Perplexity’s business model is effectively to take Reddit’s content from Google search results, feed them into a third party’s LLM, and call it a new product,” the lawsuit states. This approach, Reddit argues, allowed Perplexity to benefit from Reddit’s vast repository of human conversations while avoiding direct confrontation with the platform’s anti-scraping systems., according to market trends

The Supporting Cast: Data Scraping Intermediaries

The lawsuit names three additional defendants that operate as data intermediaries:

• Oxylabs UAB: A professional web scraping infrastructure provider
• SerpApi: Specializes in search engine results extraction
• AWMProxy: Identified in the lawsuit as a former Russian botnet operation

Reddit’s complaint draws a vivid analogy for these companies‘ alleged role: “In a very real sense, these Defendants are similar to would-be bank robbers, who, knowing they cannot get into the bank vault, break into the armored truck carrying the cash instead.”

The Stakes: Billions in Valuation Versus Millions in Protection

The financial dimensions of this conflict are substantial. Reddit confirmed it has spent tens of millions of dollars developing and maintaining anti-scraping systems that the lawsuit claims were systematically circumvented. Meanwhile, Perplexity has achieved a valuation approaching $20 billion, which Reddit suggests was built in part on improperly acquired data.

Ben Lee, Reddit’s chief legal officer, characterized the scraping firms as “textbook examples of illegal scrapers” that “bypass technological protections to steal data, then sell it to clients hungry for training material.” He emphasized Reddit’s particular vulnerability as “one of the largest and most dynamic collections of human conversation ever created.”, as comprehensive coverage

Perplexity’s Defense: Framing the Conflict as Public Interest

In response to the allegations, Perplexity spokesperson Jesse Dwyer positioned the company as defending fundamental access rights. “Our approach remains principled and responsible as we provide factual answers with accurate AI, and we will not tolerate threats against openness and the public interest,” Dwyer stated.

The company maintains it is fighting for “users’ rights to freely and fairly access public knowledge,” setting up a classic confrontation between content ownership and information accessibility in the AI era.

Broader Implications for the AI Industry

This lawsuit arrives at a critical juncture for artificial intelligence development, as companies increasingly confront the legal and ethical boundaries of training data acquisition. The outcome could establish important precedents for:

• How AI companies access publicly available web content
• The legality of indirect data scraping methods
• The value attribution for user-generated content in AI training
• The responsibilities of intermediary data providers

As Reddit’s legal officer noted, the platform represents a particularly valuable training dataset because of its authentic human conversations across countless topics and communities. This case ultimately tests whether such digital town squares can control how their conversations fuel the next generation of artificial intelligence.

This article aggregates information from publicly available sources. All trademarks and copyrights belong to their respective owners.

Note: Featured image is for illustrative purposes only and does not represent any specific product, service, or entity mentioned in this article.