Our algorithm does not treat a 4.8-star Trustpilot rating or a glowing Reddit thread as proof of quality. It treats them as text to be interrogated. Using linguistic and behavioral signals drawn from published NLP research, we flag reviews that show the statistical fingerprints of fabrication — whether written by a paid human, a sock-puppet account, or a large language model — before those reviews are allowed to influence an operator’s score on GamblScout.
Key takeaways
- Trustpilot itself removed 4.5 million fake reviews in 2024, with 90% caught automatically before publication — a signal that automated detection is now standard industry practice, not a niche technique.
- Classic linguistic-feature classifiers trained on hotel and product reviews reach close to 90% accuracy separating genuine from fabricated text, a benchmark set by Cornell’s foundational deceptive opinion spam research.
- Perplexity and burstiness — the metrics popularized by tools like GPTZero — can flag uniform, low-surprise AI-generated text, but researchers warn these signals are easy to evade and produce false positives on formal human writing.
- Regulators in the US and UK have moved from guidance to enforcement: the FTC’s final rule on fake reviews took effect in October 2024, and the UK CMA has opened formal investigations into review platforms since March 2026.
- On Reddit, astroturfing is increasingly caught through behavioral metadata — account age, posting bursts, comment-length entropy — rather than through content alone.
Table of contents
Why fake reviews distort iGaming rankings
Casino and sportsbook affiliates depend on a thin supply of visible social proof: Trustpilot star ratings, App Store reviews, and threads on subreddits like r/sportsbook or r/gambling. That scarcity makes the channel a target. A single seeded thread praising a withdrawal speed, or a coordinated pile-on accusing a competitor of slow payouts, can move real money because bettors treat peer testimony as more credible than operator marketing. We cover the broader mechanics of this scoring problem in our scoring system and algorithmic weights hub, and the underlying data-collection layer in our data scraping and technical engine hub.
Unlike a restaurant or a SaaS product, an online casino’s reputation is inseparable from money movement — deposits, withdrawals, KYC delays — which gives both operators and disgruntled affiliates a direct financial incentive to manufacture sentiment in either direction. That is the specific reason this category sits inside our Natural Language Processing & Sentiment Analysis hub rather than being treated as a generic review-scraping problem.
How big is the fake review problem, according to the platforms themselves
The number of detected fake reviews removed as a proportion of the total amount submitted in 2024 was 7.4%, and in 2023 it was 6.1%, an increase that demonstrates the platform’s automated detection systems are improving.
Trustpilot removed 4.5 million fake reviews — amounting to 7.4% of the total number of reviews submitted in 2024 — and 90% of those were removed automatically by technology that uses machine learning, neural networks and generative AI to identify patterns linked to fabricated content.
A year earlier the picture looked different:
Trustpilot removed 6% of total reviews in both 2023 (3.3 million) and 2022 (2.6 million), with the majority identified by automated detection systems, up from 68% in 2022 to 82% in 2023.
Those numbers matter for two reasons. First, they establish a base rate: even on a platform investing heavily in detection, roughly one in fourteen reviews submitted is judged fake before it ever reaches a reader. Second, the platform is explicit that
it introduced technology that looks for evidence a review has been purchased, as part of ongoing efforts to target review sellers
— an admission that a commercial market for fabricated reviews exists at scale, not just isolated bad actors. Trustpilot has also pursued sellers directly in court:
the High Court agreed that review-seller sites were unlawfully inducing businesses to breach the platform’s terms of use, passing off fake reviews as authorised by Trustpilot and infringing its trademarks.
Linguistic fingerprints: classic NLP detection
Before generative AI made fabrication cheap, researchers already showed that fabricated reviews leave a statistical trace in ordinary human writing.
N-grams and psycholinguistic word counts
The foundational study in this field, from Cornell’s Ott, Choi, Cardie and Hancock, built a gold-standard dataset of genuine and deliberately fabricated hotel reviews and found that
an integration of psychology and computational linguistics techniques produces a classifier that is nearly 90% accurate on the gold-standard opinion spam dataset.
A follow-up study extending the technique to negative fabricated reviews — the kind used to slander a competitor rather than flatter a client —
found that standard n-gram text categorization techniques can detect negative deceptive opinion spam with performance far surpassing that of human judges.
That negative-spam variant is directly relevant to iGaming, where affiliate networks and rival operators have as much incentive to manufacture one-star complaints as five-star praise. Later replications applying the same LIWC-based method
achieved 89.8% accuracy in distinguishing fake from real hotel reviews
, confirming the original result held up outside the original dataset.
These classifiers work because genuine reviewers tend to write with concrete, sensory, spatial detail — describing a specific withdrawal delay, a specific game glitch, a specific support agent — while fabricated text leans on generic superlatives and first-person narrative framing borrowed from persuasive writing rather than lived experience.
Sentiment extremity and missing specificity
Our own pipeline scores each review on a specificity index: mentions of exact amounts, dates, game titles, or transaction references push a review toward “likely genuine,” while reviews built entirely from adjectives (“amazing,” “best ever,” “highly recommend”) without a single verifiable detail are downweighted regardless of star rating. This complements the fraud-detection signals described on our security, fraud detection and fair play hub, where similar specificity checks are applied to operator complaint patterns.
Catching AI-generated reviews: perplexity and burstiness
Large language models have changed the economics of review fabrication — a single prompt can now generate hundreds of plausible, varied-sounding reviews in seconds. The detection layer built to counter this relies on two statistical measures.
GPTZero uses “burstiness” and “perplexity” metrics to distinguish between human and AI-generated text: burstiness assesses sentence length distribution, reflecting the varied sentence lengths in human writing versus the uniformity in AI text, while perplexity measures the predictability of subsequent words, with lower scores potentially indicating AI-generated content.
In practice,
GPTZero calculates burstiness using the standard deviation of the perplexity scores of each sentence in a passage and predicts a passage as LLM-generated if it has high perplexity or low burstiness.
A visualization tool built on the same principle, GLTR, colors each word by how predictable it was to a reference language model, making runs of “green” (highly predictable) tokens visually obvious to a human reviewer.
These tools are not foolproof. Independent researchers have shown that
there is less distinction in the standard deviation of burstiness scores between AI-generated and human text for some models, and as the size or complexity of LLMs increases, the deviation in burstiness scores diminishes — reinforcing the conclusion that perplexity or burstiness estimations cannot be considered reliable for AI-generated-text detection on their own.
That is why we never rely on a single score. Perplexity and burstiness are treated as one input among several, weighted alongside account metadata and posting-pattern signals rather than used as a standalone verdict.
| Signal type | What it measures | Strength | Known limitation |
|---|---|---|---|
| N-gram / LIWC classifiers | Word-choice and psycholinguistic patterns typical of fabricated narrative | ~90% accuracy on gold-standard hotel review datasets | Trained on specific verticals; needs retraining for iGaming vocabulary |
| Perplexity | How predictable each word is to a reference language model | Cheap to compute, no training data needed | Formal human writing can also score low; easy to prompt around |
| Burstiness | Variability in sentence length and structure across a passage | Captures AI’s tendency toward uniform structure | Diminishes as LLMs grow larger and more sophisticated |
| Account/behavioral metadata | Account age, posting frequency, comment-length entropy | Hard to fake at scale without cost | Requires platform-level access, not just review text |
Beyond text: behavioral and network signals on Reddit
Reddit poses a harder problem than Trustpilot because there is no star rating and no formal review structure — sentiment is scattered across comments, upvotes, and thread context. Detection here leans more heavily on account behavior than on the text of any single post.
One academic approach exploits activity volume and variability:
the idea is to exploit comment length and total activity of an account — accounts posting more than roughly 48 comments per day are likely automated, though activity alone cannot be a discriminant variable, so researchers also consider variability in comment length, assuming bots display repetitive patterns resulting in a comment-length distribution characterized by low entropy.
Low entropy — a narrow, repetitive range of comment lengths and phrasing — is a much harder signal to fake than any individual sentence, because it requires an operator to vary output across dozens or hundreds of posts convincingly.
Real-world cases illustrate why this matters. A marketing firm was caught after
publishing now-deleted case studies claiming it had seeded roughly 100 “organic-style” posts and comments across major gaming subreddits to simulate player reviews
for a game client — a campaign unearthed by ordinary users, not by the platform’s own tooling. Separately,
researchers at the University of Zurich deployed dozens of undisclosed AI bot accounts in a major subreddit between 2024 and 2025, posting more than 1,700 comments using fabricated personas, including presenting as an abuse survivor and a trauma counsellor, without participant consent and in violation of the subreddit’s rules.
Reddit’s own response has moved in the same direction as ours:
the platform reported in July 2026 that it now uses language models to catch subtle coordinated patterns older systems missed, alongside signals examined at account creation.
For iGaming specifically, our algorithm applies the same logic to threads mentioning specific operators: clusters of new accounts, near-identical phrasing praising withdrawal speed, and comment timing that spikes immediately after a promotional push are treated as coordinated-activity flags, independent of whether any single comment reads as “fake” in isolation.
The regulatory backdrop forcing platforms to act
Detection technology has been pulled forward partly by regulation. In the US,
the FTC’s final rule banning fake reviews and testimonials went into effect on October 21, 2024, having been passed by the FTC on a 5–0 vote.
The rule explicitly anticipates the AI angle:
in its statement of basis and purposes, the FTC notes that “AI tools make it easier for bad actors to pollute the review ecosystem by generating, quickly and cheaply, large numbers of realistic but fake reviews that can then be distributed widely across multiple platforms,” adding that AI-generated reviews are covered by the final rule.
Penalties are not symbolic:
violations of the final rule can result in civil penalties of $51,744 per violation.
The UK has taken a parallel path.
The CMA gained new consumer enforcement powers to address fake reviews under the Digital Markets, Competition and Consumers Act 2024, which bans fake reviews together with practices that encourage them, and gives the CMA new powers to investigate and act, including by imposing fines, against parties in breach of the law.
Enforcement has since escalated from guidance to formal cases:
on 27 March 2026 the CMA launched five new consumer law investigations spanning funerals, food delivery and car sales, targeting each key stage of the online reviews ecosystem — from how reviews are obtained, to how they are moderated and displayed, to the star ratings consumers rely on.
An earlier sweep found the problem was widespread:
in July 2025 the CMA completed a review of more than 100 businesses’ websites and found that over half could be failing to comply.
Maximum exposure is significant —
if an infringement is established, the CMA may impose fines of up to 10% of annual global turnover.
For a site like GamblScout, this regulatory pressure is a tailwind: platforms under legal obligation to police fake reviews are, in effect, doing part of our data-cleaning work for us before we ever scrape a page. We track how licensing regimes intersect with consumer-protection law more broadly in our Licensing & Jurisdictions hub.
Frequently asked questions
Can NLP alone reliably identify a fake casino review?
No single linguistic signal is reliable in isolation. Classic n-gram and psycholinguistic classifiers reach close to 90% accuracy on controlled datasets, but real-world text is messier, and sophisticated fabricators can mimic specificity. We combine text-based scores with account-level and timing-based behavioral signals rather than trusting either alone.
Does a low “perplexity” score prove a review was written by AI?
No. Perplexity and burstiness measure statistical predictability, not authorship. Formal, concise human writing can score similarly to AI text, and researchers have shown these metrics lose discriminating power as language models grow more sophisticated, producing false positives and false negatives.
Why do fake reviews target both very positive and very negative sentiment?
Operators and affiliates have incentives in both directions: inflating their own ratings and disparaging competitors. Academic research on “negative deceptive opinion spam” found this fabricated-complaint pattern is detectable with the same n-gram techniques used for fake praise, often more easily than by human readers.
How does Reddit differ from Trustpilot for detection purposes?
Trustpilot has a structured review format and its own automated pipeline checking nearly every submission before publication. Reddit has no formal review structure, so detection leans more on account metadata — posting frequency, comment-length entropy, account age — and on coordinated-pattern analysis across threads rather than single-comment scoring.
What happens to an operator’s GamblScout score if we detect review manipulation?
Reviews flagged as likely fabricated, whether inflating or attacking a rating, are excluded from the sentiment inputs feeding our scoring model. Persistent evidence of coordinated manipulation around a specific operator is logged as a negative trust signal in our broader scoring weights.
Methodology note
For this category, GamblScout’s algorithm ingests raw review and comment text from Trustpilot and relevant subreddits, then scores each item on linguistic specificity, sentiment extremity, n-gram and psycholinguistic patterns associated with fabricated narrative, and perplexity/burstiness estimates for AI-generated text. These text-level scores are combined with account-level behavioral metadata — posting frequency, account age, and comment-length entropy — to flag likely coordinated or fabricated activity before it is weighted into an operator’s public sentiment score.
Gambling involves risk. Only play with money you can afford to lose and use the deposit limits and self-exclusion tools available in your jurisdiction.
