Draft
Conversation
Contributor
|
Merging to
|
|
Your pull request contains more than 1000 changes. It is strongly encouraged to split big PRs into smaller chunks. 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf. |
Member
|
This change is |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/d8a391c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/d8a391cc12f13e72dd3a37af2a57ff35e1cd1077/bin/pkg_sql_tests benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=d8a391c --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/d8a391c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/d8a391cc12f13e72dd3a37af2a57ff35e1cd1077/bin/pkg_sql_tests benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=d8a391c --memprofile ./pkg/sql/tests🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/d8a391c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/d8a391cc12f13e72dd3a37af2a57ff35e1cd1077/bin/pkg_sql_tests benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/d8a391c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=d8a391c --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/d8a391cc12f13e72dd3a37af2a57ff35e1cd1077/22502415652-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22502415652-1/\* old/built with commit: d8a391cc12f13e72dd3a37af2a57ff35e1cd1077 |
cockroach-teamcity
added
the
X-perf-check
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/8f77e5c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/8f77e5cfbdc1076872d31de0471b6723ee3bb91f/bin/pkg_sql_tests benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=8f77e5c --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/8f77e5c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/8f77e5cfbdc1076872d31de0471b6723ee3bb91f/bin/pkg_sql_tests benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=8f77e5c --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/8f77e5c/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/8f77e5cfbdc1076872d31de0471b6723ee3bb91f/bin/pkg_sql_tests benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/8f77e5c/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=8f77e5c --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/8f77e5cfbdc1076872d31de0471b6723ee3bb91f/22505192309-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22505192309-1/\* old/built with commit: 8f77e5cfbdc1076872d31de0471b6723ee3bb91f |
golgeek
force-pushed
the
ludo/rp-tofu
branch
2 times, most recently
from
08674b6 to
dbfc5c3
Compare
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/dbfc5c3/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dbfc5c3132755b853a6c003c8db5de8784851fca/bin/pkg_sql_tests benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=dbfc5c3 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/dbfc5c3/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dbfc5c3132755b853a6c003c8db5de8784851fca/bin/pkg_sql_tests benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=dbfc5c3 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/dbfc5c3/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dbfc5c3132755b853a6c003c8db5de8784851fca/bin/pkg_sql_tests benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dbfc5c3/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=dbfc5c3 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dbfc5c3132755b853a6c003c8db5de8784851fca/22507362698-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22507362698-1/\* old/built with commit: dbfc5c3132755b853a6c003c8db5de8784851fca |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/dc0d6e6/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc0d6e66374cd0a00b314b2645d19ea709d6de24/bin/pkg_sql_tests benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=dc0d6e6 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/dc0d6e6/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc0d6e66374cd0a00b314b2645d19ea709d6de24/bin/pkg_sql_tests benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=dc0d6e6 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/dc0d6e6/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc0d6e66374cd0a00b314b2645d19ea709d6de24/bin/pkg_sql_tests benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc0d6e6/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=dc0d6e6 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc0d6e66374cd0a00b314b2645d19ea709d6de24/22591676463-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22591676463-1/\* old/built with commit: dc0d6e66374cd0a00b314b2645d19ea709d6de24 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/6c07e50/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/6c07e50f85111ea87161682bd6978d0bcfcec25c/bin/pkg_sql_tests benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=6c07e50 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/6c07e50/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/6c07e50f85111ea87161682bd6978d0bcfcec25c/bin/pkg_sql_tests benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=6c07e50 --memprofile ./pkg/sql/tests🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/6c07e50/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/6c07e50f85111ea87161682bd6978d0bcfcec25c/bin/pkg_sql_tests benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/6c07e50/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=6c07e50 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/6c07e50f85111ea87161682bd6978d0bcfcec25c/22597300279-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22597300279-1/\* old/built with commit: 6c07e50f85111ea87161682bd6978d0bcfcec25c |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/ae86a7f/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ae86a7f93f25ab57da0bac3e4d4c79ebeace9878/bin/pkg_sql_tests benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=ae86a7f --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/ae86a7f/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ae86a7f93f25ab57da0bac3e4d4c79ebeace9878/bin/pkg_sql_tests benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=ae86a7f --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/ae86a7f/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ae86a7f93f25ab57da0bac3e4d4c79ebeace9878/bin/pkg_sql_tests benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ae86a7f/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=ae86a7f --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ae86a7f93f25ab57da0bac3e4d4c79ebeace9878/22600464828-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22600464828-1/\* old/built with commit: ae86a7f93f25ab57da0bac3e4d4c79ebeace9878 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/1aced78/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/1aced7867b26f5cf9863a9898142c8f6e0ea0b40/bin/pkg_sql_tests benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=1aced78 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/1aced78/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/1aced7867b26f5cf9863a9898142c8f6e0ea0b40/bin/pkg_sql_tests benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=1aced78 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/1aced78/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/1aced7867b26f5cf9863a9898142c8f6e0ea0b40/bin/pkg_sql_tests benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/1aced78/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=1aced78 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/1aced7867b26f5cf9863a9898142c8f6e0ea0b40/22646556387-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22646556387-1/\* old/built with commit: 1aced7867b26f5cf9863a9898142c8f6e0ea0b40 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/72723d0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/72723d0d74d70a4f7448df688caf5ac432a48a7f/bin/pkg_sql_tests benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=72723d0 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/72723d0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/72723d0d74d70a4f7448df688caf5ac432a48a7f/bin/pkg_sql_tests benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=72723d0 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/72723d0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/72723d0d74d70a4f7448df688caf5ac432a48a7f/bin/pkg_sql_tests benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/72723d0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=72723d0 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/72723d0d74d70a4f7448df688caf5ac432a48a7f/22688499737-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22688499737-1/\* old/built with commit: 72723d0d74d70a4f7448df688caf5ac432a48a7f |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/9c58916/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/9c58916751e8d2c2c2e9d1f9413f868143a8866b/bin/pkg_sql_tests benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=9c58916 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/9c58916/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/9c58916751e8d2c2c2e9d1f9413f868143a8866b/bin/pkg_sql_tests benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=9c58916 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/9c58916/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/9c58916751e8d2c2c2e9d1f9413f868143a8866b/bin/pkg_sql_tests benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/9c58916/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=9c58916 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/9c58916751e8d2c2c2e9d1f9413f868143a8866b/22691190048-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22691190048-1/\* old/built with commit: 9c58916751e8d2c2c2e9d1f9413f868143a8866b |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/3f4f71e/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/3f4f71eb595b47aa127f5406149171be90e6bd8e/bin/pkg_sql_tests benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=3f4f71e --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/3f4f71e/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/3f4f71eb595b47aa127f5406149171be90e6bd8e/bin/pkg_sql_tests benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=3f4f71e --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/3f4f71e/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/3f4f71eb595b47aa127f5406149171be90e6bd8e/bin/pkg_sql_tests benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/3f4f71e/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=3f4f71e --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/3f4f71eb595b47aa127f5406149171be90e6bd8e/22695842536-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22695842536-1/\* old/built with commit: 3f4f71eb595b47aa127f5406149171be90e6bd8e |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/06754cd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06754cd37c1cc0d78263ff3488d1e1d4e461c794/bin/pkg_sql_tests benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=06754cd --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/06754cd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06754cd37c1cc0d78263ff3488d1e1d4e461c794/bin/pkg_sql_tests benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=06754cd --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/06754cd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06754cd37c1cc0d78263ff3488d1e1d4e461c794/bin/pkg_sql_tests benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/06754cd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=06754cd --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/06754cd37c1cc0d78263ff3488d1e1d4e461c794/22724557294-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22724557294-1/\* old/built with commit: 06754cd37c1cc0d78263ff3488d1e1d4e461c794 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/b5b285b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/b5b285bff24eb2f538735e6d868646ff6615e03c/bin/pkg_sql_tests benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=dc43fa0 --new=b5b285b --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/b5b285b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/b5b285bff24eb2f538735e6d868646ff6615e03c/bin/pkg_sql_tests benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=dc43fa0 --new=b5b285b --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/b5b285b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/b5b285bff24eb2f538735e6d868646ff6615e03c/bin/pkg_sql_tests benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/b5b285b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/dc43fa0/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/bin/pkg_sql_tests benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/dc43fa0/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=dc43fa0 --new=b5b285b --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/b5b285bff24eb2f538735e6d868646ff6615e03c/22728976146-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/dc43fa01233a3b8bfc6fce48f9f560bc2c13201f/22728976146-1/\* old/built with commit: b5b285bff24eb2f538735e6d868646ff6615e03c |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/e816394/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/e81639417b1ee31d7d1dafa7cfc7da3aa06734d4/bin/pkg_sql_tests benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=ce9a33a --new=e816394 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/e816394/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/e81639417b1ee31d7d1dafa7cfc7da3aa06734d4/bin/pkg_sql_tests benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=ce9a33a --new=e816394 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/e816394/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/e81639417b1ee31d7d1dafa7cfc7da3aa06734d4/bin/pkg_sql_tests benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/e816394/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=ce9a33a --new=e816394 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/e81639417b1ee31d7d1dafa7cfc7da3aa06734d4/22916841122-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ce9a33aebef23f6caed363b80b2eca5adb772744/22916841122-1/\* old/built with commit: e81639417b1ee31d7d1dafa7cfc7da3aa06734d4 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/54d8314/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/54d8314f246950006fa80017da5be608f9434e6d/bin/pkg_sql_tests benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=ce9a33a --new=54d8314 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/54d8314/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/54d8314f246950006fa80017da5be608f9434e6d/bin/pkg_sql_tests benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=ce9a33a --new=54d8314 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/54d8314/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/54d8314f246950006fa80017da5be608f9434e6d/bin/pkg_sql_tests benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/54d8314/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=ce9a33a --new=54d8314 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/54d8314f246950006fa80017da5be608f9434e6d/22920769882-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ce9a33aebef23f6caed363b80b2eca5adb772744/22920769882-1/\* old/built with commit: 54d8314f246950006fa80017da5be608f9434e6d |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/0689512/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06895123e9aef9b53cc35b4eeb261eab25bc2587/bin/pkg_sql_tests benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=ce9a33a --new=0689512 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/0689512/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06895123e9aef9b53cc35b4eeb261eab25bc2587/bin/pkg_sql_tests benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=ce9a33a --new=0689512 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/0689512/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/06895123e9aef9b53cc35b4eeb261eab25bc2587/bin/pkg_sql_tests benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/0689512/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=ce9a33a --new=0689512 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/06895123e9aef9b53cc35b4eeb261eab25bc2587/22922190618-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ce9a33aebef23f6caed363b80b2eca5adb772744/22922190618-1/\* old/built with commit: 06895123e9aef9b53cc35b4eeb261eab25bc2587 |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/fc0bb7b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/fc0bb7b626a39f01515441bb85ab174196ca3c1f/bin/pkg_sql_tests benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=ce9a33a --new=fc0bb7b --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/fc0bb7b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/fc0bb7b626a39f01515441bb85ab174196ca3c1f/bin/pkg_sql_tests benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=ce9a33a --new=fc0bb7b --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/fc0bb7b/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/fc0bb7b626a39f01515441bb85ab174196ca3c1f/bin/pkg_sql_tests benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/fc0bb7b/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=ce9a33a --new=fc0bb7b --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/fc0bb7b626a39f01515441bb85ab174196ca3c1f/22975127321-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ce9a33aebef23f6caed363b80b2eca5adb772744/22975127321-1/\* old/built with commit: fc0bb7b626a39f01515441bb85ab174196ca3c1f |
Member
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/debdb53/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/debdb53d9fbec142ec0960424ff58431299202e3/bin/pkg_sql_tests benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=ce9a33a --new=debdb53 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/debdb53/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/debdb53d9fbec142ec0960424ff58431299202e3/bin/pkg_sql_tests benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=ce9a33a --new=debdb53 --memprofile ./pkg/sql/tests⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/debdb53/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/debdb53d9fbec142ec0960424ff58431299202e3/bin/pkg_sql_tests benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/debdb53/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/ce9a33a/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ce9a33aebef23f6caed363b80b2eca5adb772744/bin/pkg_sql_tests benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ce9a33a/bin/1058449141/cockroachdb_cockroach_pkg_sql_testsbenchdiff command: # NB: for best (most stable) results, also add a suitable `--benchtime` that
# results in ~1s to ~5s of benchmark runs. For example, if ops average ~3ms, a
# benchtime of `1000x` is appropriate.
#
# Some benchmarks (in particular BenchmarkSysbench) output additional memory
# profiles covering only the execution (excluding the setup/teardown) - those
# should be preferred for analysis since they more closely correspond to what's
# reported as B/op and alloc/op.
benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=ce9a33a --new=debdb53 --memprofile ./pkg/sql/testsArtifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/debdb53d9fbec142ec0960424ff58431299202e3/22978621352-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ce9a33aebef23f6caed363b80b2eca5adb772744/22978621352-1/\* old/built with commit: debdb53d9fbec142ec0960424ff58431299202e3 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Previously, provisioning infrastructure was relying on SDK or CLI calls, which is fine for simple setups (spinning up one VM), but gets more complicated for complex setups (e.g. one auto-scaling group with two EC2 instances attached, in a dedicated VPC, with a target group and a load balancer in front) as it becomes harder to manage the lifecycle of the resources while spinning them up, but even more so while garbage collecting them.
To try and fix these shortcomings, this patch introduces an OpenTofu orchestrator in
roachprod-centralizedwith a set of templates. A template is expected to be a self-contained ephemeral infrastructure unit that can be provisioned multiple times at once. Roachprod-centralized manages the complete lifecycle of the provisioning via its internal task mechanism, removing the need for an external garbage collection process.To facilitate the user experience, this patch also introduces a concept of environment and environment variables to
roachprod-centralized. The user chooses to provision a template unit in an environment (e.g. the engineering AWS account) and the template automatically inherits from this environment variables: default VPC and AMI IDs, AWS credentials, etc. All variables can be overridden when provisioning a new template via overrides.OpenTofu plans and states, and apply/destroy task logs are written to GCS, and are exposed on the API or the CLI via a streaming mechanism. Environment variable secrets are stored in GCP SecretManager, and are never exposed to the end-user.
A test infrastructure has been provisioned to help trying out and testing the new feature.
Fixes: #164210
Epic: CRDB-60563