What is the difference between shift parallelism and vllm's decode context parallelism? #219
Description
vllm decode context parallelism: vllm-project/vllm#23734
Metadata
Metadata
Assignees
Labels
No labels
{{ message }}
vllm decode context parallelism: vllm-project/vllm#23734