Skip to content

Comments

chore(ci): run thread count test as single threaded#1626

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 3 commits intomainfrom
gyuheon0h/flaky-thread-count
Feb 24, 2026
Merged

chore(ci): run thread count test as single threaded#1626
gh-worker-dd-mergequeue-cf854d[bot] merged 3 commits intomainfrom
gyuheon0h/flaky-thread-count

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Feb 24, 2026

What does this PR do?

We had a test to test a util function that counts the number of threads running. It did this by counting the number of threads in the beginning, spawning N threads, then checking that there are (# at beginning + N threads) at the end. This test is flaky, because cargo tests are run in parallel, and threads from other tests running get counted in the beginning, but may finish and not be present when checked after N threads are spawned.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

cargo test --package libdd-common --lib -- test_utils::tests

Copy link
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title Run in subprcess for thread count chore(ci): run thread count test in subproces Feb 24, 2026
@github-actions
Copy link

Clippy Allow Annotation Report

Comparing clippy allow annotations between branches:

  • Base Branch: origin/main
  • PR Branch: origin/gyuheon0h/flaky-thread-count

Summary by Rule

Rule Base Branch PR Branch Change

Annotation Counts by File

File Base Branch PR Branch Change

Annotation Stats by Crate

Crate Base Branch PR Branch Change
clippy-annotation-reporter 5 5 No change (0%)
datadog-ffe-ffi 1 1 No change (0%)
datadog-ipc 27 27 No change (0%)
datadog-live-debugger 6 6 No change (0%)
datadog-live-debugger-ffi 10 10 No change (0%)
datadog-profiling-replayer 4 4 No change (0%)
datadog-remote-config 3 3 No change (0%)
datadog-sidecar 59 59 No change (0%)
libdd-common 10 10 No change (0%)
libdd-common-ffi 12 12 No change (0%)
libdd-crashtracker 12 12 No change (0%)
libdd-data-pipeline 5 5 No change (0%)
libdd-ddsketch 2 2 No change (0%)
libdd-dogstatsd-client 1 1 No change (0%)
libdd-profiling 13 13 No change (0%)
libdd-telemetry 19 19 No change (0%)
libdd-tinybytes 4 4 No change (0%)
libdd-trace-normalization 2 2 No change (0%)
libdd-trace-obfuscation 9 9 No change (0%)
libdd-trace-utils 15 15 No change (0%)
Total 219 219 No change (0%)

About This Report

This report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality.

@gyuheon0h gyuheon0h marked this pull request as ready for review February 24, 2026 09:32
@gyuheon0h gyuheon0h requested a review from a team as a code owner February 24, 2026 09:32
@codecov-commenter
Copy link

codecov-commenter commented Feb 24, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.09%. Comparing base (5bb62b1) to head (9ab133f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1626      +/-   ##
==========================================
+ Coverage   71.07%   71.09%   +0.02%     
==========================================
  Files         423      423              
  Lines       62491    62491              
==========================================
+ Hits        44413    44430      +17     
+ Misses      18078    18061      -17     
Components Coverage Δ
libdd-crashtracker 63.25% <ø> (-0.02%) ⬇️
libdd-crashtracker-ffi 17.80% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.27% <ø> (ø)
libdd-data-pipeline-ffi 71.51% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (+0.03%) ⬆️
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.74% <ø> (ø)
libdd-profiling 81.56% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 32.62% <ø> (ø)
datdog-sidecar-ffi 8.81% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.21% <ø> (ø)
libdd-trace-protobuf 68.00% <ø> (ø)
libdd-trace-utils 89.10% <ø> (+0.13%) ⬆️
datadog-tracer-flare 86.86% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Feb 24, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-02-24 15:13:05

Comparing candidate commit 9ab133f in PR branch gyuheon0h/flaky-thread-count with baseline commit 5bb62b1 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.021ns 189.648ns ± 1.952ns 189.331ns ± 1.369ns 190.687ns 193.663ns 194.760ns 196.402ns 3.73% 0.903 0.512 1.03% 0.138ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [189.378ns; 189.919ns] or [-0.143%; +0.143%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.961µs 86.141µs ± 0.111µs 86.123µs ± 0.043µs 86.171µs 86.284µs 86.569µs 87.084µs 1.12% 4.233 29.128 0.13% 0.008µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.126µs; 86.156µs] or [-0.018%; +0.018%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.157ms 3.190ms ± 0.015ms 3.190ms ± 0.009ms 3.196ms 3.218ms 3.232ms 3.240ms 1.60% 0.802 0.881 0.47% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.188ms; 3.192ms] or [-0.065%; +0.065%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.386µs 2.428µs ± 0.020µs 2.424µs ± 0.007µs 2.431µs 2.488µs 2.501µs 2.502µs 3.24% 2.362 5.592 0.82% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.426µs; 2.431µs] or [-0.113%; +0.113%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.916ms 13.972ms ± 0.032ms 13.966ms ± 0.013ms 13.979ms 14.039ms 14.086ms 14.138ms 1.23% 2.240 6.982 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.967ms; 13.976ms] or [-0.032%; +0.032%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.164ms 4.171ms ± 0.007ms 4.171ms ± 0.002ms 4.172ms 4.175ms 4.180ms 4.255ms 2.02% 10.779 136.147 0.16% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.170ms; 4.172ms] or [-0.022%; +0.022%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.616µs 34.308µs ± 0.831µs 33.847µs ± 0.124µs 35.150µs 35.909µs 36.048µs 37.640µs 11.20% 1.204 0.291 2.42% 0.059µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.193µs; 34.423µs] or [-0.336%; +0.336%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.849ms 50.272ms ± 1.082ms 50.115ms ± 0.067ms 50.228ms 50.348ms 55.564ms 61.658ms 23.03% 8.652 78.433 2.15% 0.077ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [50.122ms; 50.422ms] or [-0.298%; +0.298%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.105ns 256.160ns ± 11.637ns 251.124ns ± 4.252ns 262.885ns 284.106ns 287.981ns 292.178ns 16.35% 1.398 1.010 4.53% 0.823ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [254.547ns; 257.773ns] or [-0.630%; +0.630%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.255µs 496.054µs ± 0.642µs 495.979µs ± 0.247µs 496.223µs 496.949µs 497.655µs 502.413µs 1.30% 5.231 46.883 0.13% 0.045µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1990393.917op/s 2015913.803op/s ± 2590.730op/s 2016212.477op/s ± 1001.665op/s 2017294.038op/s 2018718.715op/s 2019029.349op/s 2019159.807op/s 0.15% -5.149 45.764 0.13% 183.192op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.643µs 371.280µs ± 0.290µs 371.250µs ± 0.170µs 371.455µs 371.840µs 372.036µs 372.165µs 0.25% 0.488 0.190 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2686980.237op/s 2693386.726op/s ± 2104.593op/s 2693604.429op/s ± 1235.808op/s 2694748.682op/s 2696604.527op/s 2697443.316op/s 2698013.992op/s 0.16% -0.483 0.184 0.08% 148.817op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.520µs 167.889µs ± 0.160µs 167.881µs ± 0.115µs 168.002µs 168.160µs 168.308µs 168.385µs 0.30% 0.282 0.069 0.09% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5938763.886op/s 5956309.779op/s ± 5658.640op/s 5956601.861op/s ± 4071.766op/s 5960150.847op/s 5964954.508op/s 5967454.334op/s 5969421.569op/s 0.22% -0.276 0.061 0.09% 400.126op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.575µs 36.694µs ± 0.050µs 36.690µs ± 0.034µs 36.730µs 36.783µs 36.817µs 36.822µs 0.36% 0.267 -0.250 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27157347.302op/s 27252130.949op/s ± 37283.652op/s 27255711.185op/s ± 25445.562op/s 27277845.834op/s 27311576.187op/s 27324508.929op/s 27341084.319op/s 0.31% -0.260 -0.254 0.14% 2636.352op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.294µs 45.479µs ± 0.088µs 45.495µs ± 0.068µs 45.549µs 45.594µs 45.633µs 45.730µs 0.52% -0.200 -0.783 0.19% 0.006µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21867594.630op/s 21988227.388op/s ± 42536.049op/s 21980410.592op/s ± 32684.316op/s 22024880.658op/s 22060709.540op/s 22074442.719op/s 22078223.145op/s 0.44% 0.207 -0.785 0.19% 3007.753op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [495.965µs; 496.143µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015554.753op/s; 2016272.853op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.240µs; 371.320µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2693095.049op/s; 2693678.402op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.867µs; 167.911µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5955525.546op/s; 5957094.012op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.687µs; 36.701µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27246963.793op/s; 27257298.104op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.467µs; 45.491µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21982332.300op/s; 21994122.475op/s] or [-0.027%; +0.027%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.599µs 161.522µs ± 0.322µs 161.483µs ± 0.149µs 161.649µs 161.936µs 162.549µs 163.806µs 1.44% 2.613 15.373 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.478µs; 161.567µs] or [-0.028%; +0.028%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.968µs 5.058µs ± 0.047µs 5.062µs ± 0.037µs 5.096µs 5.129µs 5.132µs 5.134µs 1.42% -0.058 -1.108 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.052µs; 5.065µs] or [-0.128%; +0.128%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.716µs 186.244µs ± 0.336µs 186.208µs ± 0.151µs 186.368µs 186.635µs 187.292µs 189.169µs 1.59% 4.274 30.951 0.18% 0.024µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5286282.599op/s 5369311.108op/s ± 9617.941op/s 5370350.804op/s ± 4342.774op/s 5374523.683op/s 5379028.758op/s 5382239.396op/s 5384556.258op/s 0.26% -4.195 30.062 0.18% 680.091op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.868µs 17.964µs ± 0.048µs 17.959µs ± 0.031µs 17.992µs 18.054µs 18.097µs 18.129µs 0.95% 0.769 0.559 0.27% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55159550.158op/s 55666792.075op/s ± 148267.551op/s 55683026.034op/s ± 95343.540op/s 55776559.115op/s 55868319.036op/s 55918395.983op/s 55966446.469op/s 0.51% -0.754 0.522 0.27% 10484.099op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 9.832µs 9.885µs ± 0.021µs 9.881µs ± 0.013µs 9.901µs 9.918µs 9.936µs 9.959µs 0.79% 0.437 0.616 0.21% 0.001µs 1 200
normalization/normalize_name/normalize_name/good throughput 100409840.778op/s 101165791.305op/s ± 215645.664op/s 101201790.577op/s ± 132188.725op/s 101307720.319op/s 101520466.765op/s 101622564.827op/s 101712259.899op/s 0.50% -0.422 0.593 0.21% 15248.451op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.198µs; 186.291µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5367978.154op/s; 5370644.062op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.958µs; 17.971µs] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55646243.618op/s; 55687340.532op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/good execution_time [9.882µs; 9.888µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/good throughput [101135904.890op/s; 101195677.720op/s] or [-0.030%; +0.030%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.614µs 25.746µs ± 9.407µs 18.026µs ± 0.247µs 33.274µs 42.754µs 43.559µs 68.246µs 278.59% 0.908 0.716 36.45% 0.665µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.442µs; 27.049µs] or [-5.064%; +5.064%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.698µs 146.071µs ± 1.937µs 145.821µs ± 0.516µs 146.336µs 147.986µs 153.581µs 165.621µs 13.58% 6.315 54.834 1.32% 0.137µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.802µs; 146.339µs] or [-0.184%; +0.184%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 729.041µs 731.282µs ± 0.723µs 731.282µs ± 0.490µs 731.775µs 732.501µs 733.138µs 733.257µs 0.27% 0.006 0.248 0.10% 0.051µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [731.182µs; 731.383µs] or [-0.014%; +0.014%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.184µs 3.248µs ± 1.449µs 3.020µs ± 0.038µs 3.058µs 3.715µs 14.057µs 14.798µs 390.07% 7.040 51.280 44.49% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.047µs; 3.449µs] or [-6.181%; +6.181%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.667ms 10.702ms ± 0.015ms 10.702ms ± 0.010ms 10.711ms 10.723ms 10.756ms 10.777ms 0.70% 1.110 3.982 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.700ms; 10.704ms] or [-0.020%; +0.020%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9ab133f 1771944987 gyuheon0h/flaky-thread-count
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.916µs ± 0.003µs 3.915µs ± 0.002µs 3.918µs 3.921µs 3.924µs 3.926µs 0.27% -1.106 10.344 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254711413.464op/s 255379580.410op/s ± 215582.204op/s 255407848.862op/s ± 130226.313op/s 255517962.943op/s 255632366.453op/s 255670186.353op/s 256873631.746op/s 0.57% 1.134 10.547 0.08% 15243.964op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.493µs 80.148µs ± 0.679µs 80.148µs ± 0.439µs 80.583µs 81.235µs 81.687µs 81.952µs 2.25% 0.005 -0.374 0.85% 0.048µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12202246.873op/s 12477855.982op/s ± 105779.885op/s 12476974.413op/s ± 68243.104op/s 12547417.427op/s 12645400.631op/s 12727301.823op/s 12740029.806op/s 2.11% 0.036 -0.374 0.85% 7479.767op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.436µs 71.714µs ± 0.222µs 71.627µs ± 0.136µs 71.859µs 72.090µs 72.487µs 72.549µs 1.29% 1.122 1.269 0.31% 0.016µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13783837.722op/s 13944326.541op/s ± 43042.268op/s 13961203.213op/s ± 26651.134op/s 13978303.925op/s 13989678.070op/s 13996359.435op/s 13998474.166op/s 0.27% -1.104 1.193 0.31% 3043.548op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.914µs ± 0.009µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.923µs 4.002µs 2.25% 8.196 75.634 0.22% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 249906065.066op/s 255465699.970op/s ± 565366.410op/s 255529310.609op/s ± 119601.957op/s 255630444.463op/s 255771926.911op/s 255826798.413op/s 256959254.452op/s 0.56% -8.125 74.823 0.22% 39977.442op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.236µs 68.564µs ± 0.251µs 68.527µs ± 0.189µs 68.762µs 69.055µs 69.222µs 69.329µs 1.17% 0.798 -0.099 0.37% 0.018µs 1 200
credit_card/is_card_number/378282246310005 throughput 14424025.447op/s 14585180.287op/s ± 53256.965op/s 14592878.677op/s ± 40453.142op/s 14631871.142op/s 14648979.743op/s 14653500.650op/s 14654925.194op/s 0.43% -0.784 -0.132 0.36% 3765.836op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.393µs 45.632µs ± 0.080µs 45.640µs ± 0.060µs 45.693µs 45.747µs 45.789µs 45.827µs 0.41% -0.260 -0.354 0.18% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21821073.742op/s 21914394.445op/s ± 38475.105op/s 21910702.930op/s ± 28874.972op/s 21944414.259op/s 21977942.388op/s 22010742.324op/s 22029797.504op/s 0.54% 0.268 -0.346 0.18% 2720.601op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.557µs 6.620µs ± 0.018µs 6.623µs ± 0.012µs 6.635µs 6.641µs 6.645µs 6.650µs 0.41% -0.840 0.315 0.27% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150375251.438op/s 151054175.995op/s ± 404585.913op/s 150997004.956op/s ± 280021.999op/s 151258060.898op/s 151696045.009op/s 152152786.876op/s 152500703.714op/s 1.00% 0.853 0.353 0.27% 28608.544op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.919µs 3.921µs 3.925µs 0.25% -1.548 13.460 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254808487.577op/s 255424786.904op/s ± 181426.604op/s 255441994.668op/s ± 108780.291op/s 255536903.896op/s 255645597.463op/s 255727462.101op/s 256760651.722op/s 0.52% 1.576 13.680 0.07% 12828.798op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.554µs 65.795µs ± 0.052µs 65.800µs ± 0.034µs 65.831µs 65.866µs 65.884µs 65.905µs 0.16% -0.750 1.697 0.08% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15173342.045op/s 15198705.162op/s ± 11904.852op/s 15197524.611op/s ± 7814.327op/s 15205729.043op/s 15219866.944op/s 15228402.440op/s 15254692.039op/s 0.38% 0.757 1.726 0.08% 841.800op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.355µs 53.418µs ± 0.032µs 53.413µs ± 0.019µs 53.438µs 53.472µs 53.501µs 53.553µs 0.26% 0.700 1.026 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18673208.911op/s 18720404.772op/s ± 11204.407op/s 18722017.182op/s ± 6511.009op/s 18727980.148op/s 18737619.093op/s 18740240.839op/s 18742236.427op/s 0.11% -0.695 1.012 0.06% 792.271op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.920µs 3.921µs 3.921µs 0.17% -0.877 7.465 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255014647.366op/s 255442026.410op/s ± 180924.448op/s 255452252.758op/s ± 96913.003op/s 255545955.087op/s 255665631.521op/s 255738198.318op/s 256607440.651op/s 0.45% 0.895 7.587 0.07% 12793.290op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.145µs 50.206µs ± 0.034µs 50.201µs ± 0.022µs 50.226µs 50.261µs 50.301µs 50.331µs 0.26% 0.652 0.488 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19868490.462op/s 19917858.841op/s ± 13342.725op/s 19920076.669op/s ± 8781.386op/s 19927146.353op/s 19936630.821op/s 19940982.906op/s 19942137.887op/s 0.11% -0.648 0.478 0.07% 943.473op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.367µs 45.706µs ± 0.114µs 45.710µs ± 0.084µs 45.798µs 45.867µs 45.910µs 45.921µs 0.46% -0.392 -0.334 0.25% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21776503.272op/s 21879326.758op/s ± 54739.748op/s 21877173.362op/s ± 40063.147op/s 21916274.478op/s 21974944.450op/s 22011336.274op/s 22042586.882op/s 0.76% 0.403 -0.316 0.25% 3870.685op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.551µs 6.616µs ± 0.018µs 6.617µs ± 0.012µs 6.630µs 6.642µs 6.648µs 6.649µs 0.48% -0.709 0.773 0.27% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150406380.732op/s 151145282.831op/s ± 416668.754op/s 151125125.058op/s ± 283228.440op/s 151397903.557op/s 151839833.415op/s 152366342.302op/s 152637679.035op/s 1.00% 0.728 0.825 0.27% 29462.930op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255349702.790op/s; 255409458.030op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.054µs; 80.242µs] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12463195.907op/s; 12492516.057op/s] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.684µs; 71.745µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13938361.297op/s; 13950291.786op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.916µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/37828224631 throughput [255387345.623op/s; 255544054.317op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.529µs; 68.598µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/378282246310005 throughput [14577799.384op/s; 14592561.190op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.621µs; 45.643µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21909062.166op/s; 21919726.725op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.618µs; 6.623µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/x371413321323331 throughput [150998104.278op/s; 151110247.711op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255399642.922op/s; 255449930.886op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.788µs; 65.802µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15197055.264op/s; 15200355.060op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.413µs; 53.422µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18718851.949op/s; 18721957.595op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255416952.021op/s; 255467100.798op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.202µs; 50.211µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19916009.667op/s; 19919708.014op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.690µs; 45.721µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21871740.355op/s; 21886913.160op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.614µs; 6.619µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151087536.549op/s; 151203029.113op/s] or [-0.038%; +0.038%] None None None

Baseline

Omitted due to size.

@gyuheon0h gyuheon0h force-pushed the gyuheon0h/flaky-thread-count branch from f74f626 to 1feb236 Compare February 24, 2026 10:01
#[cfg(test)]
mod tests {
use super::*;
use rusty_fork::rusty_fork_test;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you just want to run tests single threaded you can isolate them in a module called single_threaded_tests (example) and nextest will not run them in parallel https://github.com/DataDog/libdatadog/blob/main/.config/nextest.toml#L25

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great idea! Thanks for the tip

Copy link
Contributor

@ekump ekump left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no objection to rusty-fork if it works, but made an alternate suggestion with no new dev deps.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Feb 24, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 97.20 MB 97.20 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.51 MB 8.51 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 112.84 MB 112.84 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.12 MB 11.12 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.13 MB 27.13 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 185.72 MB 185.72 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 912.24 MB 912.24 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.75 MB 24.75 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.40 MB 51.40 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.95 MB 22.95 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.07 MB 190.08 MB +0% (+8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 896.28 MB 896.28 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.50 MB 26.50 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.03 MB 47.03 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 85.25 MB 85.25 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.04 MB 10.04 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.88 MB 105.88 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.79 MB 11.79 MB 0% (0 B) 👌

@gyuheon0h
Copy link
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Feb 24, 2026

View all feedbacks in Devflow UI.

2026-02-24 10:49:54 UTC ℹ️ Start processing command /merge


2026-02-24 10:50:00 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.


2026-02-24 11:28:06 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in main is approximately 45m (p90).


2026-02-24 13:28:31 UTCMergeQueue: The build pipeline has timeout

The merge request has been interrupted because the build 98527062 took longer than expected. The current limit for the base branch 'main' is 120 minutes.

@gyuheon0h
Copy link
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Feb 24, 2026

View all feedbacks in Devflow UI.

2026-02-24 14:56:40 UTC ℹ️ Start processing command /merge


2026-02-24 14:56:47 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.


2026-02-24 15:39:15 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in main is approximately 45m (p90).


2026-02-24 16:20:36 UTC ℹ️ MergeQueue: This merge request was merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants