Conversation
Try out this PRQuick install: pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@a2d0a1821105bd0a8caad6c2933ffe046a347dbeRecommended with virtual environment (using uv): uv venv --python 3.12 && source .venv/bin/activate
uv pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@a2d0a1821105bd0a8caad6c2933ffe046a347dbeLast updated for commit: |
WalkthroughThe pull request introduces a new Changes
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~20 minutes Poem
🚥 Pre-merge checks | ✅ 3✅ Passed checks (3 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. No actionable comments were generated in the recent review. 🎉 Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
I think we might want to hold off on merging until we get feedback about it. I think I remember now the nuance of a seamless warmup is that the warmup requests will still be using up concurrency slots from profiling requests, leading to potentially degraded performance. |
Summary by CodeRabbit
Release Notes
New Features
--warmup-seamlessflag to enable immediate profiling start after warmup completion.Improvements
--request-cancellation-ratevalidation constraints to enforce bounds > 0.0 and ≤ 100.0.