[Feature] Add remote inference endpoint support in CI/CD

[joshuayao]

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

PRs related to this feature

Enable remote inference endpoints CI/CD for

Enable remote inference endpoints for

• AgentQnA : Sin, Alex
  • [ ]
• Productivity Suite : (Sri?) (P0)
  • add test script #2199
• ChatQnA : (Sri?) (P0)
  • add test script #2199
• DocSum : (Sri?) (P0)
  • add test script #2199
• CodeGen : (Sri?) (P0)
  • add test script #2199
• FinanceAgent : Alex
  • [ ]
• workflowExecAgent : Louie
  • [ ]
• CodeTrans : Alex
  • [ ]
• AudioQnA : Alex
  • [ ]

Add remote inference endpoint support in CI/CD.

[louie-tsai]

@devpramod has worked on GenAIInfra. the same changes could be on GenAIExamples.

[louie-tsai]

@devpramod any update for this task?

[louie-tsai]

just need to remote endpoint online.