You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+50Lines changed: 50 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -136,6 +136,56 @@ Hash-based routing intelligently handles failures at the workflow level (not cli
136
136
137
137
See [Hash-Based Routing Guide](./docs/hash-routing-guide.md) for details and demos.
138
138
139
+
### Advanced: `MultiWorkflowPool` for Heterogeneous Clusters
140
+
141
+
For complex use cases involving a heterogeneous cluster of workers (e.g., some with SDXL models, others for video generation), `MultiWorkflowPool` provides fine-grained control over job routing based on workflow requirements.
142
+
143
+
It uses an event-driven architecture to manage clients with specific **workflow affinities**, ensuring that jobs are only sent to nodes capable of processing them.
144
+
145
+
-**Workflow Affinity:** Assign clients to specific workflows. Jobs are automatically routed to the correct client.
146
+
-**Dynamic Job Queues:** A separate job queue is created for each workflow type, preventing head-of-line blocking.
147
+
-**Event-Driven Architecture:** Zero polling for maximum efficiency and responsiveness.
148
+
-**Built-in Monitoring:** Optional real-time monitoring of client and queue states.
0 commit comments