-
Notifications
You must be signed in to change notification settings - Fork 39
[Feature]: GEMM + ReduceScatter #105
Copy link
Copy link
Closed
1 / 21 of 2 issues completedLabels
enhancementNew feature or requestNew feature or requestexamplesExamples showcasing Iris APIs and usageExamples showcasing Iris APIs and usagehelp wantedExtra attention is neededExtra attention is neededirisIris project issueIris project issue
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestexamplesExamples showcasing Iris APIs and usageExamples showcasing Iris APIs and usagehelp wantedExtra attention is neededExtra attention is neededirisIris project issueIris project issue
Suggestion Description
Implement GEMM+ReduceScatter using Iris. See TritonDistributed example for reference.
Also see: https://github.com/vllm-project/vllm/blob/b78bed1bc5debead116092f429eee51398691fc8/vllm/compilation/collective_fusion.py#L53-L84
Implementation variants:
See comment here: #169 (comment)
Operating System
No response
GPU
No response
ROCm Component
No response