Skip to content

Commit a14527f

Browse files
diazagasatyadiazagasatya
authored
Regenerate API client + add forwarder_max_concurrency wrapper (MLI-6875) (#180)
Regenerates the API client from the latest llm-engine OpenAPI schema and exposes `forwarder_max_concurrency` on the user-facing client. Companion to scaleapi/llm-engine#835 (MLI-6876). This regen also picks up four months of additive schema drift since #176 — `queue_message_timeout_seconds` and `task_expires_seconds` on the Create/Update model endpoint variants. Verified non-breaking: - 0 paths/operations/schemas removed - 0 fields removed or type-changed - 0 fields newly required - 20/20 unit tests pass; black, ruff, pylint, mypy, isort all clean Wrapper changes (`launch/client.py`): - `create_model_endpoint` and `edit_model_endpoint`: add `forwarder_max_concurrency` kwarg + docstring - `update_if_exists` branch in `create_model_endpoint` forwards the kwarg - `create_llm_model_endpoint` intentionally untouched (upstream LLM schemas don't expose the field) Version bumped to 0.4.2.
1 parent ea44618 commit a14527f

87 files changed

Lines changed: 1692 additions & 558 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.openapi-generator/FILES‎

Lines changed: 0 additions & 223 deletions
Original file line numberDiff line numberDiff line change
@@ -3,228 +3,6 @@ launch/api_client/api_client.py
33
launch/api_client/apis/__init__.py
44
launch/api_client/apis/tags/default_api.py
55
launch/api_client/configuration.py
6-
launch/api_client/docs/apis/tags/DefaultApi.md
7-
launch/api_client/docs/models/Annotation.md
8-
launch/api_client/docs/models/Audio.md
9-
launch/api_client/docs/models/Audio1.md
10-
launch/api_client/docs/models/Audio2.md
11-
launch/api_client/docs/models/BatchCompletionsJob.md
12-
launch/api_client/docs/models/BatchCompletionsJobStatus.md
13-
launch/api_client/docs/models/BatchCompletionsModelConfig.md
14-
launch/api_client/docs/models/BatchJobSerializationFormat.md
15-
launch/api_client/docs/models/BatchJobStatus.md
16-
launch/api_client/docs/models/CallbackAuth.md
17-
launch/api_client/docs/models/CallbackBasicAuth.md
18-
launch/api_client/docs/models/CallbackmTLSAuth.md
19-
launch/api_client/docs/models/CancelBatchCompletionsV2Response.md
20-
launch/api_client/docs/models/CancelFineTuneResponse.md
21-
launch/api_client/docs/models/ChatCompletionFunctionCallOption.md
22-
launch/api_client/docs/models/ChatCompletionFunctions.md
23-
launch/api_client/docs/models/ChatCompletionMessageToolCall.md
24-
launch/api_client/docs/models/ChatCompletionMessageToolCallChunk.md
25-
launch/api_client/docs/models/ChatCompletionMessageToolCallsInput.md
26-
launch/api_client/docs/models/ChatCompletionMessageToolCallsOutput.md
27-
launch/api_client/docs/models/ChatCompletionNamedToolChoice.md
28-
launch/api_client/docs/models/ChatCompletionRequestAssistantMessage.md
29-
launch/api_client/docs/models/ChatCompletionRequestAssistantMessageContentPart.md
30-
launch/api_client/docs/models/ChatCompletionRequestDeveloperMessage.md
31-
launch/api_client/docs/models/ChatCompletionRequestFunctionMessage.md
32-
launch/api_client/docs/models/ChatCompletionRequestMessage.md
33-
launch/api_client/docs/models/ChatCompletionRequestMessageContentPartAudio.md
34-
launch/api_client/docs/models/ChatCompletionRequestMessageContentPartFile.md
35-
launch/api_client/docs/models/ChatCompletionRequestMessageContentPartImage.md
36-
launch/api_client/docs/models/ChatCompletionRequestMessageContentPartRefusal.md
37-
launch/api_client/docs/models/ChatCompletionRequestMessageContentPartText.md
38-
launch/api_client/docs/models/ChatCompletionRequestSystemMessage.md
39-
launch/api_client/docs/models/ChatCompletionRequestSystemMessageContentPart.md
40-
launch/api_client/docs/models/ChatCompletionRequestToolMessage.md
41-
launch/api_client/docs/models/ChatCompletionRequestToolMessageContentPart.md
42-
launch/api_client/docs/models/ChatCompletionRequestUserMessage.md
43-
launch/api_client/docs/models/ChatCompletionRequestUserMessageContentPart.md
44-
launch/api_client/docs/models/ChatCompletionResponseMessage.md
45-
launch/api_client/docs/models/ChatCompletionStreamOptions.md
46-
launch/api_client/docs/models/ChatCompletionStreamResponseDelta.md
47-
launch/api_client/docs/models/ChatCompletionTokenLogprob.md
48-
launch/api_client/docs/models/ChatCompletionTool.md
49-
launch/api_client/docs/models/ChatCompletionToolChoiceOption.md
50-
launch/api_client/docs/models/ChatCompletionV2Request.md
51-
launch/api_client/docs/models/ChatCompletionV2StreamErrorChunk.md
52-
launch/api_client/docs/models/Choice.md
53-
launch/api_client/docs/models/Choice1.md
54-
launch/api_client/docs/models/Choice2.md
55-
launch/api_client/docs/models/CloneModelBundleV1Request.md
56-
launch/api_client/docs/models/CloneModelBundleV2Request.md
57-
launch/api_client/docs/models/CloudpickleArtifactFlavor.md
58-
launch/api_client/docs/models/CompletionOutput.md
59-
launch/api_client/docs/models/CompletionStreamOutput.md
60-
launch/api_client/docs/models/CompletionStreamV1Request.md
61-
launch/api_client/docs/models/CompletionStreamV1Response.md
62-
launch/api_client/docs/models/CompletionSyncV1Request.md
63-
launch/api_client/docs/models/CompletionSyncV1Response.md
64-
launch/api_client/docs/models/CompletionTokensDetails.md
65-
launch/api_client/docs/models/CompletionUsage.md
66-
launch/api_client/docs/models/CompletionV2Request.md
67-
launch/api_client/docs/models/CompletionV2StreamErrorChunk.md
68-
launch/api_client/docs/models/Content.md
69-
launch/api_client/docs/models/Content1.md
70-
launch/api_client/docs/models/Content2.md
71-
launch/api_client/docs/models/Content3.md
72-
launch/api_client/docs/models/Content4.md
73-
launch/api_client/docs/models/Content8.md
74-
launch/api_client/docs/models/CreateAsyncTaskV1Response.md
75-
launch/api_client/docs/models/CreateBatchCompletionsV1ModelConfig.md
76-
launch/api_client/docs/models/CreateBatchCompletionsV1Request.md
77-
launch/api_client/docs/models/CreateBatchCompletionsV1RequestContent.md
78-
launch/api_client/docs/models/CreateBatchCompletionsV1Response.md
79-
launch/api_client/docs/models/CreateBatchCompletionsV2Request.md
80-
launch/api_client/docs/models/CreateBatchJobResourceRequests.md
81-
launch/api_client/docs/models/CreateBatchJobV1Request.md
82-
launch/api_client/docs/models/CreateBatchJobV1Response.md
83-
launch/api_client/docs/models/CreateChatCompletionResponse.md
84-
launch/api_client/docs/models/CreateChatCompletionStreamResponse.md
85-
launch/api_client/docs/models/CreateCompletionResponse.md
86-
launch/api_client/docs/models/CreateDeepSpeedModelEndpointRequest.md
87-
launch/api_client/docs/models/CreateDockerImageBatchJobBundleV1Request.md
88-
launch/api_client/docs/models/CreateDockerImageBatchJobBundleV1Response.md
89-
launch/api_client/docs/models/CreateDockerImageBatchJobResourceRequests.md
90-
launch/api_client/docs/models/CreateDockerImageBatchJobV1Request.md
91-
launch/api_client/docs/models/CreateDockerImageBatchJobV1Response.md
92-
launch/api_client/docs/models/CreateFineTuneRequest.md
93-
launch/api_client/docs/models/CreateFineTuneResponse.md
94-
launch/api_client/docs/models/CreateLLMModelEndpointV1Request.md
95-
launch/api_client/docs/models/CreateLLMModelEndpointV1Response.md
96-
launch/api_client/docs/models/CreateLightLLMModelEndpointRequest.md
97-
launch/api_client/docs/models/CreateModelBundleV1Request.md
98-
launch/api_client/docs/models/CreateModelBundleV1Response.md
99-
launch/api_client/docs/models/CreateModelBundleV2Request.md
100-
launch/api_client/docs/models/CreateModelBundleV2Response.md
101-
launch/api_client/docs/models/CreateModelEndpointV1Request.md
102-
launch/api_client/docs/models/CreateModelEndpointV1Response.md
103-
launch/api_client/docs/models/CreateSGLangModelEndpointRequest.md
104-
launch/api_client/docs/models/CreateTensorRTLLMModelEndpointRequest.md
105-
launch/api_client/docs/models/CreateTextGenerationInferenceModelEndpointRequest.md
106-
launch/api_client/docs/models/CreateTriggerV1Request.md
107-
launch/api_client/docs/models/CreateTriggerV1Response.md
108-
launch/api_client/docs/models/CreateVLLMModelEndpointRequest.md
109-
launch/api_client/docs/models/CustomFramework.md
110-
launch/api_client/docs/models/DeleteFileResponse.md
111-
launch/api_client/docs/models/DeleteLLMEndpointResponse.md
112-
launch/api_client/docs/models/DeleteModelEndpointV1Response.md
113-
launch/api_client/docs/models/DeleteTriggerV1Response.md
114-
launch/api_client/docs/models/DockerImageBatchJob.md
115-
launch/api_client/docs/models/DockerImageBatchJobBundleV1Response.md
116-
launch/api_client/docs/models/EndpointPredictV1Request.md
117-
launch/api_client/docs/models/File.md
118-
launch/api_client/docs/models/FilteredChatCompletionV2Request.md
119-
launch/api_client/docs/models/FilteredCompletionV2Request.md
120-
launch/api_client/docs/models/Function1.md
121-
launch/api_client/docs/models/Function2.md
122-
launch/api_client/docs/models/Function3.md
123-
launch/api_client/docs/models/FunctionCall.md
124-
launch/api_client/docs/models/FunctionCall2.md
125-
launch/api_client/docs/models/FunctionObject.md
126-
launch/api_client/docs/models/FunctionParameters.md
127-
launch/api_client/docs/models/GetAsyncTaskV1Response.md
128-
launch/api_client/docs/models/GetBatchCompletionV2Response.md
129-
launch/api_client/docs/models/GetBatchJobV1Response.md
130-
launch/api_client/docs/models/GetDockerImageBatchJobV1Response.md
131-
launch/api_client/docs/models/GetFileContentResponse.md
132-
launch/api_client/docs/models/GetFileResponse.md
133-
launch/api_client/docs/models/GetFineTuneEventsResponse.md
134-
launch/api_client/docs/models/GetFineTuneResponse.md
135-
launch/api_client/docs/models/GetLLMModelEndpointV1Response.md
136-
launch/api_client/docs/models/GetModelEndpointV1Response.md
137-
launch/api_client/docs/models/GetTriggerV1Response.md
138-
launch/api_client/docs/models/GpuType.md
139-
launch/api_client/docs/models/HTTPValidationError.md
140-
launch/api_client/docs/models/ImageUrl.md
141-
launch/api_client/docs/models/InputAudio.md
142-
launch/api_client/docs/models/JsonSchema.md
143-
launch/api_client/docs/models/LLMFineTuneEvent.md
144-
launch/api_client/docs/models/LLMInferenceFramework.md
145-
launch/api_client/docs/models/LLMSource.md
146-
launch/api_client/docs/models/ListDockerImageBatchJobBundleV1Response.md
147-
launch/api_client/docs/models/ListDockerImageBatchJobsV1Response.md
148-
launch/api_client/docs/models/ListFilesResponse.md
149-
launch/api_client/docs/models/ListFineTunesResponse.md
150-
launch/api_client/docs/models/ListLLMModelEndpointsV1Response.md
151-
launch/api_client/docs/models/ListModelBundlesV1Response.md
152-
launch/api_client/docs/models/ListModelBundlesV2Response.md
153-
launch/api_client/docs/models/ListModelEndpointsV1Response.md
154-
launch/api_client/docs/models/ListTriggersV1Response.md
155-
launch/api_client/docs/models/Logprobs.md
156-
launch/api_client/docs/models/Logprobs2.md
157-
launch/api_client/docs/models/Metadata.md
158-
launch/api_client/docs/models/ModelBundleEnvironmentParams.md
159-
launch/api_client/docs/models/ModelBundleFrameworkType.md
160-
launch/api_client/docs/models/ModelBundleOrderBy.md
161-
launch/api_client/docs/models/ModelBundlePackagingType.md
162-
launch/api_client/docs/models/ModelBundleV1Response.md
163-
launch/api_client/docs/models/ModelBundleV2Response.md
164-
launch/api_client/docs/models/ModelDownloadRequest.md
165-
launch/api_client/docs/models/ModelDownloadResponse.md
166-
launch/api_client/docs/models/ModelEndpointDeploymentState.md
167-
launch/api_client/docs/models/ModelEndpointOrderBy.md
168-
launch/api_client/docs/models/ModelEndpointResourceState.md
169-
launch/api_client/docs/models/ModelEndpointStatus.md
170-
launch/api_client/docs/models/ModelEndpointType.md
171-
launch/api_client/docs/models/ParallelToolCalls.md
172-
launch/api_client/docs/models/PredictionContent.md
173-
launch/api_client/docs/models/Prompt.md
174-
launch/api_client/docs/models/Prompt1.md
175-
launch/api_client/docs/models/Prompt1Item.md
176-
launch/api_client/docs/models/PromptTokensDetails.md
177-
launch/api_client/docs/models/PytorchFramework.md
178-
launch/api_client/docs/models/Quantization.md
179-
launch/api_client/docs/models/ReasoningEffort.md
180-
launch/api_client/docs/models/RequestSchema.md
181-
launch/api_client/docs/models/ResponseFormatJsonObject.md
182-
launch/api_client/docs/models/ResponseFormatJsonSchema.md
183-
launch/api_client/docs/models/ResponseFormatJsonSchemaSchema.md
184-
launch/api_client/docs/models/ResponseFormatText.md
185-
launch/api_client/docs/models/ResponseModalities.md
186-
launch/api_client/docs/models/ResponseSchema.md
187-
launch/api_client/docs/models/RestartModelEndpointV1Response.md
188-
launch/api_client/docs/models/RunnableImageFlavor.md
189-
launch/api_client/docs/models/ServiceTier.md
190-
launch/api_client/docs/models/StopConfiguration.md
191-
launch/api_client/docs/models/StopConfiguration1.md
192-
launch/api_client/docs/models/StreamError.md
193-
launch/api_client/docs/models/StreamErrorContent.md
194-
launch/api_client/docs/models/StreamingEnhancedRunnableImageFlavor.md
195-
launch/api_client/docs/models/SyncEndpointPredictV1Request.md
196-
launch/api_client/docs/models/SyncEndpointPredictV1Response.md
197-
launch/api_client/docs/models/TaskStatus.md
198-
launch/api_client/docs/models/TensorflowFramework.md
199-
launch/api_client/docs/models/TokenOutput.md
200-
launch/api_client/docs/models/ToolConfig.md
201-
launch/api_client/docs/models/TopLogprob.md
202-
launch/api_client/docs/models/TritonEnhancedRunnableImageFlavor.md
203-
launch/api_client/docs/models/UpdateBatchCompletionsV2Request.md
204-
launch/api_client/docs/models/UpdateBatchCompletionsV2Response.md
205-
launch/api_client/docs/models/UpdateBatchJobV1Request.md
206-
launch/api_client/docs/models/UpdateBatchJobV1Response.md
207-
launch/api_client/docs/models/UpdateDeepSpeedModelEndpointRequest.md
208-
launch/api_client/docs/models/UpdateDockerImageBatchJobV1Request.md
209-
launch/api_client/docs/models/UpdateDockerImageBatchJobV1Response.md
210-
launch/api_client/docs/models/UpdateLLMModelEndpointV1Request.md
211-
launch/api_client/docs/models/UpdateLLMModelEndpointV1Response.md
212-
launch/api_client/docs/models/UpdateModelEndpointV1Request.md
213-
launch/api_client/docs/models/UpdateModelEndpointV1Response.md
214-
launch/api_client/docs/models/UpdateSGLangModelEndpointRequest.md
215-
launch/api_client/docs/models/UpdateTextGenerationInferenceModelEndpointRequest.md
216-
launch/api_client/docs/models/UpdateTriggerV1Request.md
217-
launch/api_client/docs/models/UpdateTriggerV1Response.md
218-
launch/api_client/docs/models/UpdateVLLMModelEndpointRequest.md
219-
launch/api_client/docs/models/UploadFileResponse.md
220-
launch/api_client/docs/models/UrlCitation.md
221-
launch/api_client/docs/models/UserLocation.md
222-
launch/api_client/docs/models/ValidationError.md
223-
launch/api_client/docs/models/VoiceIdsShared.md
224-
launch/api_client/docs/models/WebSearchContextSize.md
225-
launch/api_client/docs/models/WebSearchLocation.md
226-
launch/api_client/docs/models/WebSearchOptions.md
227-
launch/api_client/docs/models/ZipArtifactFlavor.md
2286
launch/api_client/exceptions.py
2297
launch/api_client/model/__init__.py
2308
launch/api_client/model/annotation.py
@@ -453,4 +231,3 @@ launch/api_client/rest.py
453231
launch/api_client/schemas.py
454232
launch/api_client/test/__init__.py
455233
launch/api_client/test/test_models/__init__.py
456-
launch/api_client_README.md

0 commit comments

Comments
 (0)