[Feature] Support launching multiple GenAI-Examples on one Machine

[xiguiw]

Priority

Undecided

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

Support launching multiple GenAI-Examples on one Machine.

To launch multiple GenAI-Examples on one Machine, host service ports should be configurable in case there is confliction.

[xiguiw]

Resolve software resources conflict:
host network port conflict,
Resolve hardware resources conflict:
Compute resource /CPU, Accelerator conflict, memory capacity

[joshuayao]

It’s a reasonable request, particularly for new users getting started. However, enterprise users typically prefer scalable deployments tailored for specific use cases. Given that, I consider this a lower priority issue, and we’ll address it based on available resources.