# Satirical News Scraper - KnowHow v1 ## 1. Major Global Satirical News Sources ### North America - **The Onion** (`theonion.com`) — The canonical American satirical news outlet founded in 1988 in Madison, Wisconsin. Known for deadpan AP-style headlines, inverted-pyramid article structure, and recurring features such as "American Voices" (man-on-the-street interviews), "Fact Checks," and op-eds. The Onion mimics the visual language of major newspapers (grid layouts, serif headlines, serious photography) with no front-page disclaimer. In 2024–2025 it surpassed 60,000 paying subscribers and continues to expand video/multimedia under Onion Inc. - **ClickHole** (`clickhole.com`) — Also owned by Onion Inc. (originally launched in 2014). Absurdist clickbait parody that satirizes BuzzFeed-style listicles, quizzes, and viral content. Headlines are often surreal rather than politically pointed. - **The Babylon Bee** (`babylonbee.com`) — Conservative-leaning Christian satire based in the U.S. Launched in 2016, it parodies evangelical culture, U.S. politics, and mainstream media from a right-wing perspective. Structure mimics news briefs and op-eds. - **Reductress** (`reductress.com`) — Feminist satire site launched in 2013. Parodies women's media (Cosmopolitan, Goop, BuzzFeed) with headlines and listicles focused on gender, dating, and wellness culture. - **Neutral Ground News** (`neutralgroundnews.com`) — New Orleans–focused hyperlocal satire that imitates regional newspaper tropes. - **The Hard Times** (`thehardtimes.net`) — Punk-rock subculture satire; music-scene parody formatted as straight news. ### United Kingdom - **Private Eye** (`private-eye.co.uk`) — Fortnightly British satirical and current affairs magazine founded in 1961. It mixes investigative journalism with cartoons, parody columns, and mock advertisements. Its website is secondary to the print edition and paywalled for much content. - **The Daily Mash** (`thedailymash.co.uk`) — UK counterpart to The Onion founded in 2007. British tabloid voice; focuses on politics, class, Brexit aftermath, and royal family absurdities. - **NewsThump** (`newsthump.com`) — British satirical news blog launched in 2009. Tabloid-style parody with an emphasis on UK politics and pop culture. ### Australia & Oceania - **The Shovel** (`theshovel.com.au`) — Australian satirical news site launched in 2013. Covers Australian politics, sport, and media with an Onion-style straight face. Known for video skits and "Shovel TV" segments. - **The Betoota Advocate** (`betootaadvocate.com`) — Australian satirical newspaper founded in 2014, styled as a rural Queensland tabloid. Very popular on social media; focuses on Australian politics, sport, and larrikin culture. ### Canada - **The Beaverton** (`thebeaverton.com`) — Canadian satirical news founded in 2012. Political and cultural parody in both English and French (Le Savoyard). Covers Canadian federal politics, hockey, and U.S.-Canada relations. ### India - **Faking News** (`fakingnews.firstpost.com`) — English-language Indian satirical news portal hosted under the Firstpost network. Parodies Indian politics, cricket, Bollywood, and corporate culture. - **The UnReal Times** — Indian satirical news site (mostly active on Facebook/Twitter) known for visual memes and short satirical articles. --- ## 2. Chinese Satirical / Parody Sources There is no direct Chinese equivalent of The Onion operating as a single, long-lived standalone website, largely due to content-moderation and licensing constraints. Instead, Chinese satirical news is distributed across platforms and communities. - **煎蛋网 (Jandan.net)** — A Chinese humor and aggregation site that historically ran a "洋葱新闻" (Onion News) tag translating and republishing Onion-style satirical pieces. While not exclusively satire, it remains a key hub for absurdist foreign-news adaptations. - **知乎 (Zhihu)** — China's dominant Q&A platform hosts user-generated satirical answers written in the style of news reports. Common Zhihu topics include "讽刺新闻" and "地狱笑话" (hell jokes / dark humor about current events). In 2024, Zhihu columns compiled "2024年上半年国内新闻盘点" satirical roundups. Content is fragmented and community-driven rather than a single publication. - **豆瓣 (Douban)** — Douban Groups (小组) historically hosted humor and satire communities such as discussion circles around parody news and absurdism. Specific satirical-news groups tend to be smaller and periodically shift names or membership due to moderation. - **微博 (Weibo) & WeChat Public Accounts** — Major distribution channels for satirical commentary. Accounts such as 严肃八卦, 萝严肃, and 六神磊磊 read contemporary events through an ironic lens. They are more commentary than straight parody news, but their tone is essential to Chinese internet satire. - **Bilibili** — Video-first satirical "news" channels parody CCTV newscast formats. Skits模仿《新闻联播》style delivery to comment on social issues. UP主 (uploaders) use green-screen news-desks, lower-thirds, and serious anchors to heighten absurdity. - **微信公众号 aggregator: 北斗十大洋葱新闻** — Annual "Top 10 Onion News" roundups (e.g., "2024北斗十大洋葱新闻") circulate on WeChat, indicating a vibrant remix culture around satirical headlines adapted to Chinese contexts. ### Key distinction Chinese satirical content is **platform-distributed** (UGC across Zhihu, Douban, Weibo, Bilibili, WeChat) rather than **site-centralized** like The Onion. Scraping Chinese satire therefore requires platform-specific strategies (API limits, mobile-rendered pages, login requirements) rather than simple RSS or HTML crawling. --- ## 3. Common Satirical Writing Structures and Headline Formulas ### The Onion "Ski Jump" Headline Structure: **serious setup → absurd punch at the very end.** - Example: *"Real-Life Nancy Drew Traces Source Of Her HPV"* - Rule: keep the punch section as short as possible and place it at the end. ### Scott Dikkers / Tim Keck 5-Step Formula | Step | Name | What it does | |------|------|--------------| | 1 | Include The Elephant | State the unspoken truth everyone thinks but no real outlet would print. | | 2 | Religion is Dumb | Contrast journalistic logic with religious absurdity. | | 3 | The Honest Character | Have public figures say what they are actually thinking. | | 4 | Big/Small Switcheroo | Describe huge events in mundane personal terms (or vice versa). | | 5 | Write Something As Mean As Possible | Brutal honesty, often pseudonymous; gives the satire bite. | ### Article-Body Moves (Scientific/Study Genre) 1. **Headline** — AP-style, deadpan. 2. **Lead paragraph** — inverted pyramid, straight news tone. 3. **Study/research framing** — fake experts, fictional institutions. 4. **Quotes** — manufactured sources presented with total credibility. 5. **Conclusion** — point at which absurdity becomes undeniable. ### Headline Spectrum - **Overt markers**: Swearing, surreal collocations. - **Medium subtlety**: Logical violations upon reflection. - **Near-plausible**: Headlines that could almost be real (risk of misinformation if decontextualized). ### ClickHole Formula - Hyperbolic listicle constructions: *"7 Reasons Why…"* where the reasons collapse into existential nonsense. - Quiz outcomes that are all the same absurd answer. ### Babylon Bee Formula - Conservative inversion of mainstream-media frames: takes a culturally divisive topic and exaggerates the perceived hypocrisy of the opposing side. --- ## 4. Adapting Satire into Short Video Scripts / Skits Satire adapts exceptionally well to short video because the core comedic device — **cognitive dissonance between form and content** — is visual as well as textual. ### Translation Pipeline 1. **Headline as Hook (0–3 seconds)** — The headline becomes the on-screen title or the anchor's first line. The deadpan delivery is essential. 2. **News-Desk Framing (3–15 seconds)** — A single "anchor" at a desk with lower-thirds and B-roll mimics CNN/Fox/CCTV. The visual legitimacy buys time for the absurdity. 3. **Correspondent Package (15–45 seconds)** — A "field reporter" with a microphone in a mundane location (parking lot, kitchen, bedroom) describing a global event with total seriousness. 4. **Expert Interview (30–60 seconds)** — Fake expert in a lab coat or suit with a bookshelf greenscreen. 5. **Kicker / Punch Reveal (final 5 seconds)** — Cut back to anchor who either doubles down on the absurdity or delivers a non-sequitur sign-off. ### Platform-Specific Adaptations - **TikTok / Reels / Shorts** — Anchor-at-desk format works best; rapid cuts between headline graphic and reactionless face. - **YouTube (mid-form)** — Full correspondents' packages, "breaking news" stingers, and fabricated B-roll libraries. - **Bilibili** — Chinese creators use CCTV/Xinwen Lianbo visual grammar (red lower-thirds, formal mandarin, static wide shots) to heighten irony. - **Podcast / Audio** — BBC/NPR-style intro music followed by a straight-news read; humor relies entirely on tone and script. ### Viral Mechanics - Satire spreads fastest when the **headline is believable enough to be shared without reading the body**. - The best skit adaptations preserve the "Ski Jump" structure: the visual setup must look completely real until the final reveal. --- ## 5. Data Schemas for Satirical Article Extraction ### Core Schema (Minimized) ```json { "source_url": "string (canonical URL)", "crawl_time": "string (ISO-8601 UTC)", "headline": "string", "byline": "string | null", "publish_date": "string | null (ISO-8601)", "body_text": "string (full article text)", "tags": ["string"], "images": [{"url":"string","alt":"string"}], "satirical_signals": { "absurd_entities": ["string"], "fictional_quotes": ["string"], "tone_markers": ["string"] } } ``` ### Extended Schema (For Training Use) ```json { "article_id": "uuid", "source": { "name": "The Onion", "domain": "theonion.com", "country": "US", "political_lean": "progressive / absurdist", "format": "long-form article | listicle | video script" }, "extraction": { "crawl_time": "2024-01-15T08:30:00Z", "user_agent": "SatireBot/1.0", "respects_robots_txt": true }, "content": { "headline": "string", "deck": "string | null", "lead": "string", "body_paragraphs": ["string"], "quoted_sources": [{"name":"string","affiliation":"string","quote":"string"}], "images": [{"url":"string","caption":"string"}], "category": "Politics | Sports | Science | Entertainment | Local" }, "adaptation": { "skit_script": "string | null", "hook_for_short_form": "string | null", "visual_notes": "string | null" } } ``` ### Schema Design Principles - `source_url` and `crawl_time` are mandatory for provenance and retry logic. - `quoted_sources` is important because satire heavily depends on fake experts; tracking them enables pattern analysis. - `adaptation` fields allow downstream LLMs to generate video scripts without re-parsing the body. --- ## 6. Rate Limits, robots.txt, and Ethical Boundaries ### robots.txt Considerations - Most satirical news sites operate ad-supported or subscription-supported business models. Their `robots.txt` files may block generic bots or specific AI crawlers (e.g., `GPTBot`, `ChatGPT-User`, `CCBot`). - Best practice: respect `robots.txt` and crawl-delay directives. If a site disallows `/news/` or `/articles/` for unknown user-agents, do not bypass the block. - Use a clearly identifying user-agent string (e.g., `SatireResearchBot/1.0 (+https://example.com/bot-info)`) and provide an abuse contact. ### Rate Limiting - **The Onion / ClickHole / Babylon Bee**: target no more than **1 request every 2–3 seconds** during peak hours; 1 req/sec is aggressive and risks IP blacklisting. - **Private Eye**: print-first, web-paywalled. Heavy crawling is likely to trigger blocks quickly. Recommend low-frequency batch crawling (1 req every 5–10 seconds). - **Daily Mash / NewsThump / Shovel / Betoota**: mid-size independent outfits. Be conservative: **1 req every 2 seconds**. - **Zhihu / Douban / Weibo / Bilibili**: platform-level rate limits are strict (often hundreds of requests per hour for unauthenticated IPs). Expect CAPTCHAs and login walls. Use official APIs where available. ### Ethical Boundaries 1. **Do not decontextualize satirical content** for distribution as real news. Satirical articles extracted must retain source metadata and satirical labels. 2. **Do not republish full articles** without license. Extraction for internal training and remixing into original skit scripts is generally fair-use/transformative in many jurisdictions, but wholesale republication is not. 3. **Avoid scraping user data** (commenters, upvoters, personal profiles). Limit extraction to public article content only. 4. **Honor DMCA/takedown mechanisms**. If a site requests cessation, comply immediately. 5. **Satire targeting marginalized groups**: consider content filters. Satirical sources vary widely in who they punch up vs. punch down. Annotate political lean and target demographic in metadata to allow downstream filtering. --- ## 7. Data Sources and References ### Academic & Editorial Sources - Skalicky, S. "Investigating satirical discourse processing and comprehension: the role of cognitive, demographic, and pragmatic features." [PDF](https://www.stephenskalicky.com/satire_comp_lc.pdf) - GeekWire. "A 5-step guide to writing a perfectly satirical Onion article from co-founder Tim Keck." (2013) [link](https://www.geekwire.com/2013/onion-responds-cofounder/) - The Scene Shop (Medium). "How to Write an Onion-Style Headline." (2019) [link](https://sceneshop.medium.com/how-to-write-an-onion-style-headline-e5036b04829c) - Fonts In Use. "The Onion website" typography analysis. [link](https://fontsinuse.com/uses/73676/the-onion-website) - Smashing Magazine. "Newspaper Website Design: Trends And Examples." (2008) [link](https://www.smashingmagazine.com/2008/11/newspaper-website-design-trends-and-examples/) - MakeUseOf. "Faux News: 10 Best Websites for Fake News & Satire." [link](https://www.makeuseof.com/tag/faux-news-alert-best-websites-for-fake-news-satire/) - Kent State University LibGuides. "List of Satirical News Sites." [link](https://libguides.library.kent.edu/c.php?g=278400&p=1854632) - Feedspot. "Top 30 Satirical News Websites." [link](https://news.feedspot.com/satirical_news_websites/) ### Chinese Sources - 知乎专栏 / Zhihu: "讽刺新闻,地狱笑话(一)——2024年上半年国内新闻盘点" (satirical 2024H1 domestic news roundup). - 微信公众号: "2024北斗十大洋葱新闻" (2024 Top-10 Onion News roundup on WeChat). - 煎蛋网 (Jandan.net) — historical "洋葱新闻" tag for translated satirical articles. ### Site References - theonion.com - clickhole.com - babylonbee.com - reductress.com - private-eye.co.uk - thedailymash.co.uk - newsthump.com - theshovel.com.au - betootaadvocate.com - thebeaverton.com - thehardtimes.net - zhihu.com - douban.com - jandan.net --- *Document generated for satire-news-scraper train/hunt phase.*