Repository navigation
bench(net): isolate SETUP parameters from message codecs - #7153
Conversation
Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>
|
Warning Review limit reachedYou've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. Next included review available in 40 minutes. View limit details
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
kixelated
left a comment
There was a problem hiding this comment.
Automated review by review (OpenAI)
Reviewed commit: 54291a6.
No actionable bugs found. Moving the unchanged SETUP parameter sweep into a separate Criterion executable is a small, appropriately scoped way to isolate benchmark composition without altering production codec behavior. The six workload sizes and series IDs are preserved, the target retains its fuzz gate, and nightly's --bench '*' selection includes it without another target list.
Verification limits: static review of the diff, changed files and nightly selection only. I did not run tests or benchmarks, reproduce the timing improvement, or validate the ARM effect.
|
Merging as is: no changes were needed.
(Written by Claude Opus 5.5) |
Problem
Adding the SETUP parameter round-trip workload to the codec executable perturbs its existing message-codec timings, including when the new workload is filtered out. These shifts can look like production codec regressions in the nightly report.
Approach
Move the unchanged
setup_parameterssweep into its ownparametersCriterion target. Keep its series IDs and the nightly's automatic target discovery.Impact
Validation
mainon x86: lite encode 55.4 → 38.6 ns (-30.4%); lite decode 67.7 → 45.2 ns (-33.3%).nix flake check --no-buildpassed with the new target committed.just ci: Rust lint, 33 crate feature checks, Loom target builds, feature-boundary tests, WebAssembly and io_uring lint, 9,020 selected tests (96 skipped), and repository checks passed. The Nix runner-image build is blocked by this host refusing/proc/self/uid_mapwrites (unshare: Operation not permitted).Alternatives
Changing production codec code or forcing inlining would obscure the benchmark-composition effect.
Follow-ups
The independent batch-write regression is addressed by moq-dev/moq#7154.
(Written by GPT-6.1 Sol)