Job Sources: Expand beyond Greenhouse/Lever/HN

[madhavcodez]

Current State

SecretAIRY ingests from 3 sources with hardcoded company lists:

• Greenhouse: 15 board tokens (Anthropic, OpenAI, Vercel, etc.)
• Lever: 10 companies (Netflix, Coinbase, etc.)
• HN Who's Hiring: Latest monthly thread

This gives ~500-600 total jobs per ingest run.

Needed

Scale to thousands of relevant opportunities:

New Sources

• LinkedIn Jobs API — Largest job database
• Indeed/Glassdoor scraping — Via OpenClaw browser automation
• AngelList/Wellfound — Startup-focused roles
• company career pages — Direct scraping via OpenClaw
• Y Combinator Work at a Startup — Batch companies

Improvements to Existing

• Dynamic board discovery — Auto-discover Greenhouse/Lever board tokens instead of hardcoded lists
• Configurable company lists — Let users add/remove companies from the dashboard
• Deduplication across sources — Same job posted on multiple platforms
• Freshness tracking — Mark stale jobs, re-check if roles are still open

Labels

feature, ingest, sources