Skip to main content

Overview

World Monitor aggregates 150+ RSS feeds across geopolitics, defense, energy, tech, and finance. Each variant loads its own curated feed set:
  • Geopolitical variant: ~25 categories
  • Tech variant: ~20 categories
  • Finance variant: ~18 categories
  • Happy variant: Positive news sources

RSS Proxy Architecture

All RSS feeds are proxied through /api/rss-proxy to prevent CORS issues. The proxy:
  • Domain allowlist - Only whitelisted domains are permitted (security)
  • Automatic fallback - Direct fetch → Railway relay on failure
  • Per-feed circuit breakers - Failing feeds don’t affect others
  • 5-minute polling - Each feed refreshed independently
  • 10-minute cooldown - Failed feeds pause before retry
The proxy implements a dual-fetch strategy: attempts direct connection first, then falls back to the Railway relay server if the direct fetch fails.

Allowed Domains

The following domains are permitted through api/rss-proxy.js (lines 48-326):

International News

DomainSourceLanguage
feeds.bbci.co.ukBBC NewsEnglish
www.bbc.comBBC NewsEnglish
www.theguardian.comThe GuardianEnglish
feeds.npr.orgNPREnglish
rss.cnn.comCNNEnglish
www.aljazeera.comAl JazeeraEnglish
www.aljazeera.netAl Jazeera ArabicArabic
feeds.reuters.comReutersEnglish
www.reutersagency.comReuters AgencyEnglish
www.ft.comFinancial TimesEnglish
news.google.comGoogle NewsMultiple

Geopolitical & Defense

DomainSourceFocus
www.defenseone.comDefense OneU.S. defense policy
breakingdefense.comBreaking DefenseMilitary procurement
www.defensenews.comDefense NewsGlobal defense
www.militarytimes.comMilitary TimesU.S. military
taskandpurpose.comTask & PurposeMilitary news
news.usni.orgU.S. Naval InstituteNaval operations
www.bellingcat.comBellingcatOSINT investigations
www.thedrive.comThe War Zone (The Drive)Military tech
www.oryxspioenkop.comOryxConflict equipment tracking
foreignpolicy.comForeign PolicyInternational relations
www.foreignaffairs.comForeign AffairsGeopolitics
thediplomat.comThe DiplomatAsia-Pacific
www.politico.comPoliticoU.S. politics
rss.politico.comPolitico RSSU.S. politics

Think Tanks & Research

DomainOrganizationRegion
www.cfr.orgCouncil on Foreign RelationsGlobal
www.csis.orgCenter for Strategic & International StudiesGlobal
www.brookings.eduBrookings InstitutionGlobal
www.atlanticcouncil.orgAtlantic CouncilTransatlantic
rusi.orgRoyal United Services InstituteUK
warontherocks.comWar on the RocksU.S. defense
www.aei.orgAmerican Enterprise InstituteU.S. policy
responsiblestatecraft.orgResponsible StatecraftU.S. foreign policy
www.fpri.orgForeign Policy Research InstituteGlobal
jamestown.orgJamestown FoundationEurasia
www.chathamhouse.orgChatham HouseUK
ecfr.euEuropean Council on Foreign RelationsEurope
www.gmfus.orgGerman Marshall FundTransatlantic
www.wilsoncenter.orgWilson CenterGlobal
www.lowyinstitute.orgLowy InstituteAsia-Pacific
www.mei.eduMiddle East InstituteMiddle East
www.stimson.orgStimson CenterGlobal security
www.cnas.orgCenter for New American SecurityU.S. security
carnegieendowment.orgCarnegie EndowmentGlobal
www.rand.orgRAND CorporationPolicy research
fas.orgFederation of American ScientistsScience policy
www.armscontrol.orgArms Control AssociationArms control
www.nti.orgNuclear Threat InitiativeNuclear security
thebulletin.orgBulletin of the Atomic ScientistsNuclear risk
www.iss.europa.euEU Institute for Security StudiesEuropean security
www.crisisgroup.orgInternational Crisis GroupConflict prevention

Technology & Cybersecurity

DomainSourceFocus
techcrunch.comTechCrunchStartups
www.theverge.comThe VergeTech news
feeds.arstechnica.comArs TechnicaTechnology
huggingface.coHugging FaceAI/ML
www.technologyreview.comMIT Technology ReviewTech trends
rss.arxiv.orgArXivResearch papers
export.arxiv.orgArXiv APIResearch papers
openai.comOpenAIAI research
www.zdnet.comZDNetEnterprise tech
www.techmeme.comTechmemeTech news aggregator
www.darkreading.comDark ReadingCybersecurity
www.schneier.comSchneier on SecuritySecurity research
krebsonsecurity.comKrebs on SecurityCybersecurity
www.ransomware.liveRansomware.liveRansomware tracking
www.anandtech.comAnandTechHardware
www.tomshardware.comTom’s HardwareHardware
www.semianalysis.comSemiAnalysisSemiconductor analysis
feed.infoq.comInfoQSoftware development
thenewstack.ioThe New StackCloud native
devops.comDevOps.comDevOps
dev.toDev.toDeveloper community
lobste.rsLobstersTech community
changelog.comChangelogDeveloper news
www.producthunt.comProduct HuntProduct launches
www.axios.comAxiosTech/business
api.axios.comAxios APITech/business
github.blogGitHub BlogDeveloper platform
githubnext.comGitHub NextExperimental projects
www.engadget.comEngadgetConsumer tech
news.mit.eduMIT NewsResearch
dev.eventsDev EventsTech conferences

Venture Capital & Startups

DomainSourceFocus
www.ycombinator.comY CombinatorAccelerator
a16z.comAndreessen HorowitzVC insights
review.firstround.comFirst Round ReviewStartup advice
www.sequoiacap.comSequoia CapitalVC
www.nfx.comNFXNetwork effects
bothsidesofthetable.comBoth Sides of the TableVC perspective
www.lennysnewsletter.comLenny’s NewsletterProduct/growth
stratechery.comStratecheryTech strategy
seekingalpha.comSeeking AlphaStock analysis
news.crunchbase.comCrunchbase NewsFunding news
www.saastr.comSaaStrSaaS
feeds.feedburner.comFeedBurner (various)Multiple sources
pitchbook.comPitchBookPE/VC data
www.cbinsights.comCB InsightsMarket intelligence
www.techstars.comTechstarsAccelerator
layoffs.fyiLayoffs.fyiTech layoffs

Regional Startup News

DomainSourceRegion
www.eu-startups.comEU-StartupsEurope
tech.euTech.euEurope
sifted.euSiftedEurope
www.techinasia.comTech in AsiaAsia
kr-asia.comKrASIAAsia
techcabal.comTechCabalAfrica
disrupt-africa.comDisrupt AfricaAfrica
lavca.orgLAVCALatin America
contxto.comContxtoLatin America
inc42.comInc42India
yourstory.comYourStoryIndia

Finance & Markets

DomainSourceFocus
www.cnbc.comCNBCMarkets
feeds.marketwatch.comMarketWatchStocks
finance.yahoo.comYahoo FinanceMarkets
www.coindesk.comCoinDeskCrypto
cointelegraph.comCointelegraphCrypto
asia.nikkei.comNikkei AsiaAsian markets

U.S. Government

DomainSourceAgency
www.whitehouse.govWhite HouseExecutive
www.state.govState DepartmentDiplomacy
www.defense.govDepartment of DefenseMilitary
home.treasury.govTreasuryFinance
www.justice.govDepartment of JusticeLaw enforcement
tools.cdc.govCDCHealth
www.fema.govFEMAEmergency
www.dhs.govDHSHomeland security
www.cisa.govCISACybersecurity
www.federalreserve.govFederal ReserveMonetary policy
www.sec.govSECSecurities

International Organizations

DomainSourceType
news.un.orgUnited NationsIntergovernmental
www.iaea.orgIAEANuclear agency
www.who.intWHOHealth
www.afro.who.intWHO AfricaRegional health
www.fao.orgFAOFood/agriculture
worldbank.orgWorld BankDevelopment
www.imf.orgIMFFinancial

Regional & Language-Specific

DomainSourceLanguage
www.euronews.comEuronewsEnglish
de.euronews.comEuronewsGerman
es.euronews.comEuronewsSpanish
fr.euronews.comEuronewsFrench
it.euronews.comEuronewsItalian
pt.euronews.comEuronewsPortuguese
ru.euronews.comEuronewsRussian
www.france24.comFrance 24English
rss.dw.comDeutsche WelleMultiple
www.gov.ukUK GovernmentEnglish

Security Advisories

DomainSourceType
travel.state.govU.S. State DeptTravel advisories
www.smartraveller.gov.auAustralia DFATTravel advisories
www.safetravel.govt.nzNew Zealand MFATTravel advisories
th.usembassy.govU.S. Embassy ThailandSecurity alerts
ae.usembassy.govU.S. Embassy UAESecurity alerts
de.usembassy.govU.S. Embassy GermanySecurity alerts
ua.usembassy.govU.S. Embassy UkraineSecurity alerts
mx.usembassy.govU.S. Embassy MexicoSecurity alerts
in.usembassy.govU.S. Embassy IndiaSecurity alerts
pk.usembassy.govU.S. Embassy PakistanSecurity alerts
co.usembassy.govU.S. Embassy ColombiaSecurity alerts
pl.usembassy.govU.S. Embassy PolandSecurity alerts
bd.usembassy.govU.S. Embassy BangladeshSecurity alerts
it.usembassy.govU.S. Embassy ItalySecurity alerts
do.usembassy.govU.S. Embassy Dominican RepublicSecurity alerts
mm.usembassy.govU.S. Embassy MyanmarSecurity alerts
wwwnc.cdc.govCDCHealth advisories
www.ecdc.europa.euECDCHealth advisories

Maritime & Aviation

DomainSourceFocus
www.twz.comThe War ZoneMilitary aviation
gcaptain.comgCaptainMaritime news

Positive News (Happy Variant)

DomainSourceFocus
www.goodnewsnetwork.orgGood News NetworkPositive stories
www.positive.newsPositive NewsConstructive journalism
reasonstobecheerful.worldReasons to be CheerfulSolutions journalism
www.optimistdaily.comOptimist DailyPositive trends
www.upworthy.comUpworthyInspiring stories
www.dailygood.orgDailyGoodGood deeds
www.goodgoodgood.coGood Good GoodPositive impact
www.good.isGood.isSocial progress
www.sunnyskyz.comSunny SkyzFeel-good news
thebetterindia.comThe Better IndiaPositive India news
singularityhub.comSingularity HubTech optimism
humanprogress.orgHumanProgressProgress metrics
greatergood.berkeley.eduGreater GoodScience of happiness
www.onlygoodnewsdaily.comOnly Good News DailyPositive headlines
www.sciencedaily.comScienceDailyResearch breakthroughs
feeds.nature.comNatureScientific advances
www.nature.comNatureScientific research
www.livescience.comLive ScienceScience discoveries
www.newscientist.comNew ScientistScience news

Community & Discussion

DomainSourceType
news.ycombinator.comHacker NewsTech discussion
hnrss.orgHacker News RSSTech discussion

Feed Processing

Instant Flat Render

News items appear immediately as a flat list the moment feed data arrives. ML-based clustering (topic grouping, entity extraction, sentiment analysis) runs asynchronously in the background and progressively upgrades the view.

Virtual Scrolling

News panels with 15+ items use a custom virtual list renderer:
  • Only visible items + 3-item overscan buffer are rendered
  • requestAnimationFrame-batched scroll handling
  • DOM element pooling and recycling
  • Responsive adaptation via ResizeObserver

Custom Keyword Monitors

User-defined keyword alerts with:
  • Word-boundary matching (prevents “ai” from matching “train”)
  • Automatic color-coding from 10-color palette
  • Multi-keyword support (comma-separated)
  • Real-time match counts
  • Search across titles and descriptions

Blocked Domains

The following domains are explicitly blocked (deprecated sources):
  • rsshub.app - Returns 410 Gone (stale clients still request these)

Circuit Breaker Behavior

When an RSS feed fails:
  1. Direct fetch attempted - Standard HTTP request
  2. Railway relay fallback - If direct fails, routes through relay
  3. 5-minute cooldown - Failed feed pauses before retry
  4. Other feeds unaffected - Per-feed isolation
  5. Automatic recovery - Resumes after cooldown expires

Feed Deduplication

Headlines are deduplicated before LLM summarization:
  • Jaccard similarity threshold of 0.6 (60% word overlap)
  • Reduces prompt size by 20-40%
  • Prevents LLM waste on repeated stories

Data Sources Overview

Complete data source catalog

External APIs

API integration specifications

Build docs developers (and LLMs) love