The Challenge
A mid-market regional newsroom (30 journalists) covers politics, business, and culture across a diverse readership (left-leaning, center, right-leaning). Their challenge: Competitive landscape: 50+ news outlets, blogs, and social accounts covering the same stories. How are competitors framing coverage differently? What propaganda techniques are they using? Are they deceiving their readers? The problem:- Journalists manually browsed competitor sites
- No systematic way to flag propaganda or manipulative framing
- Slow response to narrative shifts
- No data on “who’s framing this story most deceptively?”
The Solution
The newsroom installed Rhetoric Audit’s Chrome Extension + API to monitor competitor coverage: Setup:- Installed RA Chrome extension on 12 journalist workstations
- Created a shared Slack bot that feeds competitor article URLs to RA API
- Built a dashboard showing bias spectrum + propaganda index across 50 outlets
- News aggregator tool (Google News, Newsguard) feeds URLs to Slack bot
- Bot auto-analyzes with RA API
- Dashboard shows: article, outlet, bias spectrum, propaganda index, fallacy count
- Journalists see flagged articles in morning briefing
Implementation
Week 1–2: Setup
- Subscribed to pro tier (20 credits/month = 10 Intelligence Briefs or 4,000 basic scans)
- Installed Chrome extension
- Created Slack integration (using Zapier + RA API)
Week 3–4: Training
- Trained journalists on interpreting RA’s bias spectrum
- Explained propaganda index (0 = neutral, 1 = highly manipulative)
- Showed how to use fallacy detection to support fact-checking
Week 5+: Operations
- Morning briefing: “Here’s how competitors framed yesterday’s stories”
- Archive analysis: Can reference RA scores for past articles
- Follow-up investigations: If outlet X shows pattern of propaganda, document it
Results
Key Discoveries
Discovery #1: Systematic Bias Across Outlets
Before RA, the newsroom felt that outlet X was more sensationalist. After 2 weeks of data:- Outlet A (right-leaning): avg propaganda index 0.58, 2.3 fallacies/article
- Outlet B (center-left): avg propaganda index 0.42, 1.4 fallacies/article
- Outlet C (neutral-positioning): avg propaganda index 0.38, 0.9 fallacies/article
Discovery #2: Narrative Framing Patterns
During a major political event, three outlets covered the same story:
Insight: Different outlets weren’t just biased—they used different manipulation techniques. The newsroom saw this as a teaching moment: “Here’s how propaganda varies by outlet.”
Discovery #3: Social Media Propaganda Precedes News
The newsroom set up Intelligence Brief API to track narratives across X, Reddit, and news sites. Pattern:- Right-wing influencers on X post claim (high emotional loading, low evidence)
- Reddit users amplify (fallacies echo)
- 24–48 hours later, right-leaning outlets pick it up (publication lends credibility)
- Eventually, mainstream outlets cover “the controversy” (legitimizing misinformation)
Journalist Workflow Impact
Before:“I see Outlet X published an article. I’ll check their track record… they’ve been wrong before. Probably sensationalized. I’ll compare to Outlet B’s version.”After:
“RA shows Outlet X has propaganda index 0.72 (high), 4 fallacies, and omitted the policy background. Outlet B’s version is propaganda index 0.31 (low). I can see why X is less credible now.”This objective data made journalist conversations faster and more rigorous.
Challenges
Challenge #1: Over-reliance on RA scores One journalist wanted to flag Outlet X as “untrustworthy” based on RA scores alone. Resolution: Newsroom established policy: RA is a signal, not proof. High propaganda index means “review closely for manipulation,” not “outlet is definitely misleading.” Journalists still fact-check claims independently. Challenge #2: Conflating bias with dishonesty A center-left journalist got defensive when their preferred outlet showed high propaganda index. Resolution: Training clarified: Bias ≠ dishonesty. An outlet can be center-left (bias spectrum placement) but still write honestly. Propaganda index measures technique (emotional loading, fallacies), not accuracy. A center-left outlet with low propaganda index is both biased and careful about manipulation. Challenge #3: Fallacy detection has blind spots RA flagged a rhetorical question as a logical fallacy. Journalists knew it wasn’t. Resolution: Developed internal QA: Journalists review RA’s fallacy flags on 5–10 articles weekly. Track false positives. Learned that RA’s fallacy detection is 88% accurate on news articles (high confidence items to flag, low confidence items to double-check).Business Impact
Competitive Advantage
The newsroom could:- Spot manipulation faster than competitors
- Publish meta-analyses (“Here’s how outlets framed this differently”)
- Build audience trust: “We fact-check competitors, not just claims”
Readership Growth
Coverage of competitor framing became a popular section:- “Today’s Media Bias Roundup” (daily, 2K reads/week)
- Series: “How News Outlets Manipulated the Narrative” (3 pieces × 5K reads each)
- Trust metrics improved: 67% of readers said “they appreciate when we call out media manipulation”
Staff Retention
Journalists felt empowered:“I used to just read competitor articles and feel they were wrong. Now I have tools to prove it.”
Metrics After 6 Months
Net impact: 550 annual cost. ROI: 37x.
Lessons for Newsrooms
1. RA is a journalist tool, not a bot- Use it to augment human judgment, not replace it
- Journalists still need to verify facts independently
- RA catches manipulation patterns; humans verify the underlying claims
- A source can be biased and honest
- Propaganda index measures manipulation technique, not truth
- Bias spectrum + propaganda index together tell a complete story
- Set up alerts for breaking stories
- Analyze competitor coverage within minutes
- You can be the outlet that spots manipulation first
- Show readers your process: “Here’s how we analyzed this”
- Include RA bias/fallacy data in meta-analyses
- Readers appreciate that you’re fact-checking media, not just claims
What’s Next?
The newsroom is exploring:- Intelligence Brief API — Track narrative evolution across platforms
- Daily automated bias report — Generate morning briefings automatically
- Public dashboard — Show readers bias analysis of major outlets
- Investigative partnership — Collaborate with other newsrooms on disinformation tracking
Ready to Add Rhetoric Audit to Your Newsroom?
If you:- Monitor competitor coverage
- Fact-check claims made in articles
- Want to spot propaganda patterns
- Publish meta-analyses on media bias