Exclude legacy V0 pages from llms.txt context files

[enyst]

Mintlify auto-generates /llms.txt and /llms-full.txt from all public pages.

We want those LLM context files to include V1-only content, while we keep legacy V0 pages available for humans.

This PR overrides Mintlify's auto-generated files by committing custom llms.txt and llms-full.txt generated from V1-only docs pages.

What changed

• Add and document a generator script: scripts/generate-llms-files.py
• Commit generated llms.txt and llms-full.txt at the repo root (Mintlify override)
• Exclude legacy V0 pages from both files:
  • anything under openhands/usage/v0/
  • any page whose filename starts with V0*
• Make sections explicit and ordered for clarity:
  1. OpenHands Software Agent SDK
  2. OpenHands CLI
  3. OpenHands Web App Server
  4. OpenHands Cloud
  5. OpenHands Overview

How to regenerate

./scripts/generate-llms-files.py

References:

• Mintlify llms.txt docs: https://www.mintlify.com/docs/ai/llmstxt
• llms.txt proposal: https://llmstxt.org/

[all-hands-bot]

🟡 Acceptable - Pragmatic but needs automation

THE GOOD:
Solving a real problem (V0/V1 doc confusion) with a straightforward solution. Overriding Mintlify's auto-generation is pragmatic when they don't offer exclude configs.

THE RISK:
33K+ lines of generated content committed to git with no visible CI safeguards. These files will become stale the moment someone updates docs without re-running the generator.

VERDICT: ✅ Worth merging - core approach is sound, but add automation or accept manual maintenance burden.

KEY INSIGHT: Good taste favors generated artifacts that can't drift (built on-demand) over committed artifacts that can (require discipline). If committing is necessary, CI checks are non-negotiable.

[enyst]

Added a small ergonomics layer so keeping / fresh is easy:\n\n- python3 scripts/generate-llms-files.py regenerates both files\n- python3 scripts/generate-llms-files.py
git diff --exit-code llms.txt llms-full.txt regenerates + diffs (same behavior as CI)\n\nDocumented in (since agents touch this repo frequently).

[enyst]

Added a small ergonomics layer so keeping llms.txt / llms-full.txt fresh is easy:

• make llms regenerates both files
• make llms-check regenerates + diffs (same behavior as CI)

Documented in AGENTS.md (since agents touch this repo frequently).

[enyst]

@OpenHands why is CI failing? We just added that job to verify llms.txt, in THIS PR, and the PR is updated from main. Fix it please.

[openhands-ai]

@enyst your session has expired. Please login again at OpenHands Cloud and try again.