[Feature]: Stop removing the vllm-specific/non openai native fields

[ExtReMLapin]

🚀 The feature, motivation and pitch

router/src/routers/http/openai_router.rs

Line 220 in d48e55c

if let Some(obj) = payload.as_object_mut() {

I really don't see the reason behind it, it's not documented anywhere also

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[ExtReMLapin]

Long story short, at the office we have 8 a100 @ 40gb.

When trying to run data parallel 8 on Qwen 3.5 35b MoE, it still share experts (we even have to enable expert parallel) so there is no real isolated data parallel when using MoEs.

One solution would be as we're using vllm .... to use vllm router, which makes sense, but fucking hell it removes all extra params that are supported by vllm and degrades the quality of the answer.

One better solution was to setup a HAProxy load ballancer with "least connection" as rule.