Skip to content

bound concurrent namespace scanning to less than k8s client QPS limit #629

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
sami-alajrami merged 2 commits into from
Jan 20, 2026
Merged

bound concurrent namespace scanning to less than k8s client QPS limit #629

sami-alajrami merged 2 commits into from
Jan 20, 2026

Conversation

@sami-alajrami
Copy link
Contributor

@sami-alajrami sami-alajrami commented Jan 19, 2026 •
edited
Loading

related to kosli-dev/server#4467

  • limit the number of concurrent goroutines (and therefore requests) that read pods from a namespace to k8s sdk client's (Burst / 2) -1. This achieves best utilization of concurrency while preventing request queue explosion and eliminating throttling.
  • add a test to confirm scanning 200 namespaces does not take more than 5 seconds (should take 4.x seconds)

@sami-alajrami sami-alajrami merged commit 9eb27b0 into main Jan 20, 2026
10 checks passed
@sami-alajrami sami-alajrami deleted the bound-concurrency-for-k8s-snapshotting branch January 20, 2026 06:18
github-actions bot pushed a commit that referenced this pull request Jan 20, 2026
@sami-alajrami
Release: bound concurrent namespace scanning to less than k8s client …
f857497 
…QPS limit (#629)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JonJagger JonJagger JonJagger approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@sami-alajrami @JonJagger