AI-powered news aggregator with structured multilingual summaries and push notifications

Newscrux monitors 13 AI/ML RSS feeds, filters articles by relevance using AI, extracts full article content when needed, generates structured summaries in your chosen language, and delivers them as rich push notifications to your phone via Pushover.

Every notification tells you what happened, why it matters, and one key detail — in English, Turkish, German, French, or Spanish.

English (--lang=en):

Title: OpenAI announces enterprise agent toolkit

📰 TechCrunch AI

What happened: OpenAI released a new suite of tools for building
enterprise-grade autonomous agents, including improved function
calling, a persistent memory API, and a new orchestration layer.

Why it matters: This could significantly accelerate agent-based
automation in large organizations by reducing integration complexity.

💡 Initial access is being rolled out to select enterprise customers.

Turkish (--lang=tr):

Title: AGI'ye doğru ilerlemeyi ölçmek: Bilişsel bir çerçeve

📰 Google DeepMind

Ne oldu: Google DeepMind, yapay genel zeka (AGI) yolunda ilerlemeyi
değerlendirmek için bilişsel bilim temelli bir çerçeve yayınladı.
10 temel bilişsel yeteneği tanımlıyor ve AI sistemlerinin yeteneklerini
sınıflandırmaya yönelik bir taksonomi sunuyor.

Neden önemli: Bu çerçeve, AI sistemlerinin genel zeka yeteneklerini
bilişsel perspektiften değerlendirmek için ortak bir temel sağlayabilir.

💡 200.000 dolar ödüllü Kaggle hackathonu başlatıldı.

• 🌍 5 languages — English, Turkish, German, French, Spanish via --lang flag
• 🧠 Structured summaries — What happened + Why it matters + Key detail, generated by DeepSeek
• 📰 13 RSS sources — OpenAI, Google AI, DeepMind, TechCrunch, arXiv, and more
• 🔍 AI relevance filtering — Only delivers news that matters; irrelevant articles are dropped before summarization
• 📄 Hybrid content extraction — RSS snippet first, full-text scraping (via cheerio) when snippet is too short
• ⚡ Article state pipeline — discovered → enriched → summarized → sent with persistence
• 🔒 No data loss — Atomic queue writes, retry on transient failure, articles survive restarts
• 📊 Operational metrics — Per-cycle stats logged (discovered, enriched, sent, failed, truncated)
• 🏷️ Feed typing — Official blogs (official_blog) bypass the relevance filter automatically
• 🔁 Cross-source deduplication — Title similarity check prevents the same story from multiple sources

git clone https://github.com/alicankiraz1/newscrux.git
cd newscrux
npm install
cp .env.example .env        # Edit with your API keys
npm run build
npm start -- --lang=en      # or: tr, de, fr, es

Prerequisites:

• Node.js 18+
• OpenRouter API key (free tier available)
• Pushover account (one-time $5 app fee)

RSS Feeds (13 sources)
        │
        ▼
  Fetch + Parse
        │
        ▼
  Cross-source Dedup (title similarity)
        │
        ▼
  Discover → Queue (persistent JSON)
        │
        ├─ high priority (official_blog) ────────────────────┐
        │                                                     │
        ▼                                                     │
  Relevance Filter (AI scores 1-10)                          │
  Drop below threshold                                        │
        │                                                     │
        └─────────────────────────────────────────────────── ▼
                                                   Enrich (snippet or scrape)
                                                             │
                                                             ▼
                                                   Summarize (DeepSeek JSON)
                                                             │
                                                             ▼
                                                   Render Notification
                                                   (HTML, smart truncation)
                                                             │
                                                             ▼
                                                   Send via Pushover
                                                             │
                                                             ▼
                                                   Mark Sent in Queue

Each language pack includes a full AI system prompt in that language, feed kind labels, and all notification UI strings. The AI model produces translated_title, what_happened, why_it_matters, and key_detail in the selected language.

Examples:

newscrux --lang=tr      # Start with Turkish summaries
newscrux -l de          # Start with German summaries
newscrux                # Start with English summaries (default)

To add or remove feeds, edit the feeds array in src/config.ts.

# 1. Clone and build
git clone https://github.com/alicankiraz1/newscrux.git ~/newscrux
cd ~/newscrux
npm install
cp .env.example .env
nano .env                                       # fill in your API keys
npm run build

# 2. Install and configure service
cp newscrux.service ~/.config/systemd/user/
nano ~/.config/systemd/user/newscrux.service    # adjust --lang flag if needed

# 3. Enable and start (user-level systemd)
systemctl --user daemon-reload
systemctl --user enable newscrux
systemctl --user start newscrux

# 4. View live logs
journalctl --user -u newscrux -f

Note: The service file uses %h (systemd home directory specifier) so paths are automatically resolved to your home directory. No root access needed.

1. Fetch — Polls all 13 RSS feeds every 15 minutes (configurable) using rss-parser
2. Deduplicate — Cross-source title similarity check prevents the same story from appearing twice
3. Discover — New articles are added to a persistent JSON queue (data/article-queue.json) with state discovered
4. Filter — AI scores each article's relevance 1–10; articles below the threshold are dropped before any summarization cost is incurred. High-priority (official_blog) sources bypass this step entirely.
5. Enrich — Checks RSS snippet length; if shorter than 300 characters, scrapes the full article using cheerio. Content is capped at 3,000 characters for the summarizer.
6. Summarize — Sends article content to DeepSeek (via OpenRouter) with a structured JSON prompt in the selected language. Output: translated_title, what_happened, why_it_matters, key_detail, source_type.
7. Render — Builds the Pushover notification message with HTML formatting and smart truncation to stay within the 1,024-character limit.
8. Send — POSTs the notification to the Pushover API. The article is only marked sent after a confirmed successful delivery.
9. Retry — Articles that fail enrichment, summarization, or sending remain in the queue as failed and are retried on the next cycle.

See CONTRIBUTING.md for how to add languages, submit fixes, or suggest features.

Alican Kiraz

MIT — see LICENSE