cost subcommand#267
Draft
Cedric / ViaDézo1er (viadezo1er) wants to merge 16 commits into
Draft
Conversation
Contributor
|
Latest downloadable build artifacts for this PR commit
Available artifact names
|
Cedric / ViaDézo1er (viadezo1er)
force-pushed
the
cedric/cost-subcommand
branch
from
July 16, 2026 20:08
393aea5 to
2ad0651
Compare
first draft BREAKING-CHANGE: --profile and --prefer-profile removed Breaks any script using them
…n to use the new auth storage format orgid,email
remove dead code
The field is needed by OAuth but it's unused both bt and the backend Therefore exposing it is useless Now bt_cli is hardcoded as its value
Cedric / ViaDézo1er (viadezo1er)
force-pushed
the
cedric/cost-subcommand
branch
2 times, most recently
from
July 21, 2026 01:33
d81f21a to
0c40707
Compare
- Preserves separate OAuth and API-key login identities.
- Keeps multiple API keys for the same org distinct using key hints.
- Implements the intended precedence:
1. Explicit --api-key
2. --prefer-api-key
3. OAuth
4. BRAINTRUST_API_KEY
5. Stored API key
- Validates explicit/environment API keys against the requested org.
- Does not fall back to OAuth when a selected key is invalid or belongs to another org.
- Rejects API-key authentication in cross-org mode.
- Pins the exact API-key login selected by bt switch or bt init.
- Adds bt auth login --global/--local.
- Adds filtering to bt auth logins --org/--prefer-api-key.
- Changes bare bt auth logout to select from all saved logins instead of deleting the currently active one.
- Adds bt auth logout --oauth and retains --api-key-hint.
Config handling — src/config/mod.rs
- Makes global/local merging org-safe:
- A project is never inherited from another org.
- project and project_id remain coupled.
- Local project-without-org does not inherit the global org.
- Stores cross-org as:
```json
{ "org": "" }
```
- Ignores the legacy profile field.
- Preserves unknown config keys during updates.
- Only treats .bt/config.json as a local config; a bare .bt directory is not one.
- Adds separate filesystem discovery rules for bt init.
bt switch — src/switch.rs
- Starts with a saved-login picker:
- OAuth entries collapse into org choices.
- API keys remain separate and display their hints.
- Cross-org OAuth is selectable.
- Automatically selects a sole login/project.
- Prompts for project when multiple projects exist.
- Pins a selected API-key slot exactly.
- Implements global/local scope rules:
- --global does not search for local config.
- --local requires an existing .bt/config.json.
- Interactive ambiguity opens a scope picker.
- Non-interactive ambiguity errors before network work.
- Preserves unknown config fields.
- Fixes the scope-picker ANSI corruption you reported by passing plain labels to Dialoguer.
bt init — src/init.rs
- Adds:
- --here
- -f/--force
- Searches upward for .bt, .git, home, or filesystem root using the specified boundary rules.
- Resolves destination errors before authentication.
- Uses the same saved-login/project selection behavior as switch.
- Excludes cross-org from the picker because init requires a project.
- Writes org, project, and project_id.
- Reports permission/write failures with the affected path.
- Now exposes the real destination error instead of only saying:
```text
could not resolve `bt init` destination
```
Cross-org CLI/status — src/args.rs, src/main.rs, src/status.rs
- Normalizes these to canonical cross-org:
```sh
--org cross-org
--org ""
```
- Displays cross-org as cross-org in human and JSON status output.
- Prevents stale projects from being combined with cross-org context.
- Makes --prefer-api-key fail actionably from cross-org context.
Cedric / ViaDézo1er (viadezo1er)
force-pushed
the
cedric/cost-subcommand
branch
from
July 23, 2026 20:48
b103609 to
4c18616
Compare
Cedric / ViaDézo1er (viadezo1er)
force-pushed
the
cedric/cost-subcommand
branch
from
July 23, 2026 20:52
1bac553 to
ec0f4aa
Compare
multiple group-by work sort by time when grouped by day/hour sort by the dimension (eg user) in the output data when grouped by user
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
STACKED BARS for
bt cost --group-by user --group-by hoursay the cost is only for tokens not for storage cost
create a skill to teach the agent to use btql to see the data however they want, because we're not able to think of all the ways customers will want to use our data
TODO
repeated --group-by
too few abscissa legends in images
legends too small in images
Rebased on
cedric/prune-profilesto dogfood.#274 will be merged before this pr.
bt cost logs:bt cost logs --json|jq:{ "project": "cedric-traces", "org": "BT Staging", "currency": "USD", "since": "2026-07-14T01:35:29Z", "until": "2026-07-21T01:35:29Z", "excludes_scorers": false, "pricing_file": null, "rows": [ { "model": "claude-opus-4-8", "purpose": null, "candidate_spans": 430, "cost": 48.40370225, "braintrust_cost": 48.40370225, "file_cost": null, "braintrust_priced_spans": 430, "file_priced_spans": 0, "unpriced_token_spans": 0, "no_usage_spans": 0, "coverage": "full" }, { "model": "zai-org/GLM-5.2", "purpose": null, "candidate_spans": 2539, "cost": 45.48671468, "braintrust_cost": 45.48671468, "file_cost": null, "braintrust_priced_spans": 2267, "file_priced_spans": 0, "unpriced_token_spans": 0, "no_usage_spans": 272, "coverage": "full" }, { "model": "gpt-5.5", "purpose": null, "candidate_spans": 714, "cost": 32.5653, "braintrust_cost": 32.5653, "file_cost": null, "braintrust_priced_spans": 705, "file_priced_spans": 0, "unpriced_token_spans": 0, "no_usage_spans": 9, "coverage": "full" }, { "model": "gpt-5.6-sol", "purpose": null, "candidate_spans": 752, "cost": 14.96779075, "braintrust_cost": 14.96779075, "file_cost": null, "braintrust_priced_spans": 741, "file_priced_spans": 0, "unpriced_token_spans": 0, "no_usage_spans": 11, "coverage": "full" }, { "model": "claude-haiku-4-5-20251001", "purpose": null, "candidate_spans": 50, "cost": 0.33857415, "braintrust_cost": 0.33857415, "file_cost": null, "braintrust_priced_spans": 50, "file_priced_spans": 0, "unpriced_token_spans": 0, "no_usage_spans": 0, "coverage": "full" }, { "model": null, "purpose": null, "candidate_spans": 4, "cost": null, "braintrust_cost": null, "file_cost": null, "braintrust_priced_spans": 0, "file_priced_spans": 0, "unpriced_token_spans": 4, "no_usage_spans": 0, "coverage": "unknown" }, { "model": "glm-5.2", "purpose": null, "candidate_spans": 1760, "cost": null, "braintrust_cost": null, "file_cost": null, "braintrust_priced_spans": 0, "file_priced_spans": 0, "unpriced_token_spans": 1749, "no_usage_spans": 11, "coverage": "unknown" } ], "totals": { "candidate_spans": 6249, "cost": 141.76208183, "braintrust_cost": 141.76208183, "file_cost": null, "braintrust_priced_spans": 4193, "file_priced_spans": 0, "unpriced_token_spans": 1753, "no_usage_spans": 303, "coverage": "partial" } }