Skip to content

data: update ZillizCloud benchmark results (v2026.4)#748

Merged
liliu-z merged 1 commit intozilliztech:mainfrom
CLiqing:fix-zillizcloud-duplicate-entries
Apr 8, 2026
Merged

data: update ZillizCloud benchmark results (v2026.4)#748
liliu-z merged 1 commit intozilliztech:mainfrom
CLiqing:fix-zillizcloud-duplicate-entries

Conversation

@CLiqing
Copy link
Copy Markdown
Contributor

@CLiqing CLiqing commented Apr 7, 2026

Summary

  • Update ZillizCloud-8cu-perf benchmark results with latest Cardinal backend (v2026.4)
  • 1M and 10M datasets, level 1-9

🤖 Generated with Claude Code

@CLiqing CLiqing force-pushed the fix-zillizcloud-duplicate-entries branch 3 times, most recently from 9f2f4ea to e7eece8 Compare April 8, 2026 02:25
Replace ZillizCloud-8cu-perf case_id=4/5 data with new Cardinal backend
benchmark results (level 1-9, 1M and 10M datasets, v2026.4). Remove
force_merge entries as Cardinal uses unified 4-segment architecture for 10M.

New results show significant QPS improvement:
- 1M: 13,316 QPS (was 9,704) at recall 0.938
- 10M: 7,385 QPS (was 3,957) at recall 0.938

Sort all leaderboard entries by (db_name, dataset, filter_ratio, qps DESC)
to fix line chart rendering. Remove one SQ4U 1M outlier (recall=0.84).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@CLiqing CLiqing force-pushed the fix-zillizcloud-duplicate-entries branch from d36f243 to 5d09483 Compare April 8, 2026 02:41
@CLiqing CLiqing changed the title fix: remove duplicate ZillizCloud-8cu-perf entries from leaderboard data: update ZillizCloud benchmark results (v2026.4) Apr 8, 2026
Copy link
Copy Markdown
Collaborator

@liliu-z liliu-z left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@sre-ci-robot
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: CLiqing, liliu-z
To complete the pull request process, please assign xuanyang-cn after the PR has been reviewed.
You can assign the PR to them by writing /assign @xuanyang-cn in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@liliu-z liliu-z merged commit 51c5158 into zilliztech:main Apr 8, 2026
4 checks passed
@CLiqing CLiqing deleted the fix-zillizcloud-duplicate-entries branch April 8, 2026 06:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants