Skip to content

feat: environments folder#917

Open
cmunley1 wants to merge 4 commits intomainfrom
cmunley1/envs-dir
Open

feat: environments folder#917
cmunley1 wants to merge 4 commits intomainfrom
cmunley1/envs-dir

Conversation

@cmunley1
Copy link
Copy Markdown
Contributor

@cmunley1 cmunley1 commented Mar 20, 2026

See #986

Introduces environments/ folder

Separates environment configuration (agent + dataset pairings) from server implementation configuration to improve environment discoverability and organization.

Added a top-level environments/ directory with three subdirectories:

  • environments/training/ 47 training environments (one per dataset)
  • environments/eval/ 10 evaluation benchmarks (replaces benchmarks/)
  • environments/example/ 14 simple examples configs

Total: 73 environments

Config separation

  • resources_servers/*/configs/*.yaml now contain server parameters only
  • Dataset definitions and agent pairings have been moved to environments/

Each environment config:

  • includes a config_paths entry pointing back to its resources server config
  • defines the agent + dataset section

Motivation

Previously, each YAML file in resources_servers/*/configs/ served two purpose:

  • server implementation config
  • dataset registry

This created limitations on environment discoverability:

  • Could not define multiple training environments using the same resources server
    • e.g. dapo_math_17k and open_math_reasoning both depend on math_with_judge

Signed-off-by: cmunley1 <cmunley@nvidia.com>
Signed-off-by: cmunley1 <cmunley@nvidia.com>
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot bot commented Mar 20, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Signed-off-by: cmunley1 <cmunley@nvidia.com>
Signed-off-by: cmunley1 <cmunley@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant