Skip to content

feat(tests): add onboarding test script#150

Merged
fcogidi merged 6 commits into
mainfrom
feat/add_onboarding_test
Jun 24, 2026
Merged

feat(tests): add onboarding test script#150
fcogidi merged 6 commits into
mainfrom
feat/add_onboarding_test

Conversation

@fcogidi

@fcogidi fcogidi commented Jun 24, 2026

Copy link
Copy Markdown
Collaborator

Summary

Aligns proxy credential env vars with the bootcamp secret manager (PROXY_*OPENAI_*), adds a repo-root onboarding integration test suite for live credential verification, and updates setup docs/notebooks to explain the Coder vs local credential model and the onboard CLI workflow.

Clickup Ticket(s): Link(s) if applicable.

Type of Change

  • 🐛 Bug fix (non-breaking change that fixes an issue)
  • ✨ New feature (non-breaking change that adds functionality)
  • 💥 Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • 📝 Documentation update
  • 🔧 Refactoring (no functional changes)
  • ⚡ Performance improvement
  • 🧪 Test improvements
  • 🔒 Security fix

Changes Made

  • Env var rename (breaking): PROXY_BASE_URL / PROXY_API_KEYOPENAI_BASE_URL / OPENAI_API_KEY across the library (AgentConfig, LLMPredictorConfig), implementations, playground scripts, and docs — matching names injected by aieng-platform-onboard from the secret manager
  • Onboarding integration tests: new tests/test_integration.py with live checks for Vector proxy LLM inference, Langfuse auth, and E2B code execution; shared helpers in tests/conftest.py; integration_test pytest marker registered in pyproject.toml
  • Docs & UX: README gains a Coder workspace / bootcamp environment section with onboard commands; .env.example clarifies which keys are shell-injected vs .env-local; 00_environment_check.ipynb updated with setup instructions and the new env var names; planning-docs/vector-llm-proxy.md updated
  • Dependencies: aieng-platform-onboard>=0.7.2 in root dev deps; aieng-agents[code-interpreter] minimum bumped to >=0.3.1

Testing

  • Tests pass locally (uv run pytest tests/)
  • Type checking passes (uv run mypy <src_dir>)
  • Linting passes (uv run ruff check src_dir/)
  • Manual testing performed (describe below)

Manual testing details:

  • eval "$(onboard --bootcamp-name agentic-forecasting --test-script tests/test_integration.py)" passes all three integration checks
  • uv run pytest tests/test_integration.py -v passes with onboard-injected keys
  • 00_environment_check.ipynb runs top-to-bottom on Coder and locally
  • Unit tests still pass with integration tests excluded: uv run pytest -m "not integration_test" tests implementations/tests

Screenshots/Recordings

N/A

Related Issues

Deployment Notes

Breaking change for local setups: rename PROXY_BASE_URL / PROXY_API_KEY to OPENAI_BASE_URL / OPENAI_API_KEY in any existing .env files. Code that passed proxy_base_url / proxy_api_key to AgentConfig or LLMPredictorConfig must use openai_base_url / openai_api_key instead.

On Coder workspaces, bootcamp keys are injected into the shell by onboarding. Only personal keys (e.g. FRED_API_KEY) belong in .env.

Checklist

  • Code follows the project's style guidelines
  • Self-review of code completed
  • Documentation updated (if applicable)
  • No sensitive information (API keys, credentials) exposed

@fcogidi fcogidi self-assigned this Jun 24, 2026
@fcogidi fcogidi merged commit 91c4537 into main Jun 24, 2026
2 checks passed
@fcogidi fcogidi deleted the feat/add_onboarding_test branch June 24, 2026 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant