Skip to content

Add minimal batch output with --batch-full-output opt-in#6

Closed
dnagoda wants to merge 1 commit into
dc.batch-5-lazy-humanizedfrom
dc.batch-6-minimal-output
Closed

Add minimal batch output with --batch-full-output opt-in#6
dnagoda wants to merge 1 commit into
dc.batch-5-lazy-humanizedfrom
dc.batch-6-minimal-output

Conversation

@dnagoda

@dnagoda dnagoda commented Jul 2, 2026

Copy link
Copy Markdown
Owner

📚 Stack (bottom → top)

  1. Add batch mode for processing multiple inputs via JSONL #1 Add batch mode for processing multiple inputs via JSONL
  2. Preserve JSON input object order #2 Preserve JSON input object order
  3. Refine batch failure handling #3 Refine batch failure handling
  4. Reuse the compiled provider across runs #4 Reuse the compiled provider across runs
  5. Compute humanized bytes lazily #5 Compute humanized bytes lazily
  6. Add minimal batch output with --batch-full-output opt-in #6 Add minimal batch output with --batch-full-output opt-in

Stacked draft PRs on the fork; review bottom-up. Merge target is Shopify/function-runner once upstream write access is available.


Why

Batch mode emitted the full FunctionRunResult per input — including the echoed
input, function name, and size. Parity replay only needs the run outcome, and
the extra fields bloat the JSONL output for large runs.

What

  • Default batch output is now a minimal record per line:
    success, instructions, memory_usage, logs, output.
  • Add --batch-full-output to opt back into the complete FunctionRunResult
    per line.
  • Extend integration coverage for both the minimal default and the
    full-output flag.

Single-run output is unaffected.

Testing

  • cargo test batch_
  • cargo test

Batch mode emitted the full FunctionRunResult for every input, including the
echoed input, function name, and size. Parity replay only needs the run
outcome, so default batch output is now a minimal record (success,
instructions, memory_usage, logs, output).

Add --batch-full-output to opt back into the complete FunctionRunResult per
line. Extend integration coverage for both the minimal default and the
full-output flag.

Verified with:
- cargo test batch_
- cargo test

Assisted-By: devx/c659e918-9568-4750-b122-e3890447348a
@dnagoda dnagoda force-pushed the dc.batch-5-lazy-humanized branch from f672955 to 5fea7f9 Compare July 2, 2026 21:51
@dnagoda dnagoda force-pushed the dc.batch-6-minimal-output branch from 11bb660 to 11950bb Compare July 2, 2026 21:51
@dnagoda

dnagoda commented Jul 6, 2026

Copy link
Copy Markdown
Owner Author

Moved upstream to Shopify#594 now that write access is available. Closing this fork PR.

@dnagoda dnagoda closed this Jul 6, 2026
@dnagoda dnagoda deleted the dc.batch-6-minimal-output branch July 6, 2026 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant