rocmlir-tuning-driver improvements

[mirza-halilcevic]

Motivation

Improvements to reduce memory usage and improve performance when tuning. Excessive memory usage causes problems on APU systems.

Technical Details

rocmlir-tuning-driver.cpp:

• Avoid unnecessary iterations when greedy falls back to exhaustive in non-accel case
• Create stream and allocate gpu buffers once, and initialize them with memset instead of using extra host buffers

ConcurrentQueue.h

• Implement rate-adaptiveness so we don't accumulate more compile results than necessary

Test Plan

Several problem configs that were previously crashing on Hark Point are now able to run.

Submission Checklist

• Look over the contributing guidelines at https://github.com/ROCm/ROCm/blob/develop/CONTRIBUTING.md#pull-requests.

[Copilot]

Pull request overview

This PR improves the rocmlir-tuning-driver to reduce memory usage and improve performance during tuning operations, particularly targeting issues on APU systems with limited memory.

Changes:

• Eliminates host buffer allocation by initializing GPU buffers directly with hipMemsetAsync
• Implements rate-adaptive concurrent queue to provide backpressure and prevent excessive memory accumulation
• Caches and reuses thread resources (MLIR contexts, PassManagers) across greedy tuning iterations
• Tracks effective tuning kind to avoid unnecessary iterations when greedy mode falls back to exhaustive

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.

File	Description
mlir/tools/rocmlir-tuning-driver/rocmlir-tuning-driver.cpp	Refactored buffer management to use GPU-direct initialization, moved stream creation outside benchmarking loop, implemented thread resource caching, and added effectiveKind tracking
mlir/tools/rocmlir-tuning-driver/ConcurrentQueue.h	Added rate-adaptive queue with dynamic capacity adjustment to limit memory usage from compilation results
mlir/lib/Dialect/Rock/Tuning/RockTuningImpl.cpp	Set effectiveKind field when creating tuning space and when falling back from Greedy to Exhaustive
mlir/include/mlir/Dialect/Rock/Tuning/RockTuning.h	Added effectiveKind field to TuningParamSet struct to track actual tuning mode used

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.