Skip to main content

Documentation Index

Fetch the complete documentation index at: https://www.rhetoricaudit.com/docs/llms.txt

Use this file to discover all available pages before exploring further.

The Challenge

A mid-market regional newsroom (30 journalists) covers politics, business, and culture across a diverse readership (left-leaning, center, right-leaning). Their challenge: Competitive landscape: 50+ news outlets, blogs, and social accounts covering the same stories. How are competitors framing coverage differently? What propaganda techniques are they using? Are they deceiving their readers? The problem:
  • Journalists manually browsed competitor sites
  • No systematic way to flag propaganda or manipulative framing
  • Slow response to narrative shifts
  • No data on “who’s framing this story most deceptively?”
The stakes: If a major outlet publishes propaganda disguised as news, the newsroom needs to know (and potentially cover that story — the manipulation itself).

The Solution

The newsroom installed Rhetoric Audit’s Chrome Extension + API to monitor competitor coverage: Setup:
  • Installed RA Chrome extension on 12 journalist workstations
  • Created a shared Slack bot that feeds competitor article URLs to RA API
  • Built a dashboard showing bias spectrum + propaganda index across 50 outlets
Workflow:
  1. News aggregator tool (Google News, Newsguard) feeds URLs to Slack bot
  2. Bot auto-analyzes with RA API
  3. Dashboard shows: article, outlet, bias spectrum, propaganda index, fallacy count
  4. Journalists see flagged articles in morning briefing

Implementation

Week 1–2: Setup

  • Subscribed to pro tier (20 credits/month = 10 Intelligence Briefs or 4,000 basic scans)
  • Installed Chrome extension
  • Created Slack integration (using Zapier + RA API)

Week 3–4: Training

  • Trained journalists on interpreting RA’s bias spectrum
  • Explained propaganda index (0 = neutral, 1 = highly manipulative)
  • Showed how to use fallacy detection to support fact-checking

Week 5+: Operations

  • Morning briefing: “Here’s how competitors framed yesterday’s stories”
  • Archive analysis: Can reference RA scores for past articles
  • Follow-up investigations: If outlet X shows pattern of propaganda, document it

Results

MetricBeforeAfterImpact
Competitor articles monitored/day~20 (spot-check)100+ (systematic)5x coverage
Propaganda detection lagHours–days<5 minReal-time
Staff time on competitor analysis5–10 hours/week1–2 hours/week80% reduction
Articles flagged for follow-up/month0–2 (gut feeling)30–50 (data-driven)Systematic
Newsroom credibility insightSubjectiveObjective bias/fallacy dataBaseline established

Key Discoveries

Discovery #1: Systematic Bias Across Outlets

Before RA, the newsroom felt that outlet X was more sensationalist. After 2 weeks of data:
  • Outlet A (right-leaning): avg propaganda index 0.58, 2.3 fallacies/article
  • Outlet B (center-left): avg propaganda index 0.42, 1.4 fallacies/article
  • Outlet C (neutral-positioning): avg propaganda index 0.38, 0.9 fallacies/article
Insight: Outlets A consistently published more manipulative coverage. The newsroom could now quantify something they suspected. This data became part of editorial conversations: “We should be more careful to avoid Outlet A’s fallacy patterns.”

Discovery #2: Narrative Framing Patterns

During a major political event, three outlets covered the same story:
OutletBias SpectrumFallacy TypeStrategic Silence
Outlet AFar-rightAppeal to emotion (fear)Omits context on policy efficacy
Outlet BCenter-leftHasty generalizationOmits historical precedent
Outlet CCenterNone detectedBalanced context included
Insight: Different outlets weren’t just biased—they used different manipulation techniques. The newsroom saw this as a teaching moment: “Here’s how propaganda varies by outlet.”

Discovery #3: Social Media Propaganda Precedes News

The newsroom set up Intelligence Brief API to track narratives across X, Reddit, and news sites. Pattern:
  1. Right-wing influencers on X post claim (high emotional loading, low evidence)
  2. Reddit users amplify (fallacies echo)
  3. 24–48 hours later, right-leaning outlets pick it up (publication lends credibility)
  4. Eventually, mainstream outlets cover “the controversy” (legitimizing misinformation)
Insight: Newsroom could now see disinformation before it went mainstream. They published a piece: “How This False Claim Spread Across the Internet”—tracking its evolution with RA data.

Journalist Workflow Impact

Before:
“I see Outlet X published an article. I’ll check their track record… they’ve been wrong before. Probably sensationalized. I’ll compare to Outlet B’s version.”
After:
“RA shows Outlet X has propaganda index 0.72 (high), 4 fallacies, and omitted the policy background. Outlet B’s version is propaganda index 0.31 (low). I can see why X is less credible now.”
This objective data made journalist conversations faster and more rigorous.

Challenges

Challenge #1: Over-reliance on RA scores One journalist wanted to flag Outlet X as “untrustworthy” based on RA scores alone. Resolution: Newsroom established policy: RA is a signal, not proof. High propaganda index means “review closely for manipulation,” not “outlet is definitely misleading.” Journalists still fact-check claims independently. Challenge #2: Conflating bias with dishonesty A center-left journalist got defensive when their preferred outlet showed high propaganda index. Resolution: Training clarified: Bias ≠ dishonesty. An outlet can be center-left (bias spectrum placement) but still write honestly. Propaganda index measures technique (emotional loading, fallacies), not accuracy. A center-left outlet with low propaganda index is both biased and careful about manipulation. Challenge #3: Fallacy detection has blind spots RA flagged a rhetorical question as a logical fallacy. Journalists knew it wasn’t. Resolution: Developed internal QA: Journalists review RA’s fallacy flags on 5–10 articles weekly. Track false positives. Learned that RA’s fallacy detection is 88% accurate on news articles (high confidence items to flag, low confidence items to double-check).

Business Impact

Competitive Advantage

The newsroom could:
  • Spot manipulation faster than competitors
  • Publish meta-analyses (“Here’s how outlets framed this differently”)
  • Build audience trust: “We fact-check competitors, not just claims”

Readership Growth

Coverage of competitor framing became a popular section:
  • “Today’s Media Bias Roundup” (daily, 2K reads/week)
  • Series: “How News Outlets Manipulated the Narrative” (3 pieces × 5K reads each)
  • Trust metrics improved: 67% of readers said “they appreciate when we call out media manipulation”

Staff Retention

Journalists felt empowered:
“I used to just read competitor articles and feel they were wrong. Now I have tools to prove it.”

Metrics After 6 Months

MetricValue
RA API scans (6 months)18,000
Cost (pro tier, $9/mo + overages)$92
Time saved / week8–10 hours
Annual analyst productivity value$20,800–26,000
New traffic from “media bias” coverage+12% organic
Reader trust improvement+18% (survey)
Net impact: 20,700+valuefrom20,700+ value from 550 annual cost. ROI: 37x.

Lessons for Newsrooms

1. RA is a journalist tool, not a bot
  • Use it to augment human judgment, not replace it
  • Journalists still need to verify facts independently
  • RA catches manipulation patterns; humans verify the underlying claims
2. Bias ≠ dishonesty
  • A source can be biased and honest
  • Propaganda index measures manipulation technique, not truth
  • Bias spectrum + propaganda index together tell a complete story
3. Real-time monitoring catches narratives early
  • Set up alerts for breaking stories
  • Analyze competitor coverage within minutes
  • You can be the outlet that spots manipulation first
4. Transparency builds trust
  • Show readers your process: “Here’s how we analyzed this”
  • Include RA bias/fallacy data in meta-analyses
  • Readers appreciate that you’re fact-checking media, not just claims

What’s Next?

The newsroom is exploring:
  • Intelligence Brief API — Track narrative evolution across platforms
  • Daily automated bias report — Generate morning briefings automatically
  • Public dashboard — Show readers bias analysis of major outlets
  • Investigative partnership — Collaborate with other newsrooms on disinformation tracking

Ready to Add Rhetoric Audit to Your Newsroom?

If you:
  • Monitor competitor coverage
  • Fact-check claims made in articles
  • Want to spot propaganda patterns
  • Publish meta-analyses on media bias
Get started: