Commit 2eae688
committed
Disable ONNX Runtime thread pool spin-waiting
Set session.intra_op.allow_spinning=0 and
session.inter_op.allow_spinning=0 to prevent ORT worker threads
from busy-waiting between inference calls. This eliminates idle
CPU burn without affecting inference latency.1 parent f9af273 commit 2eae688
1 file changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
| 31 | + | |
30 | 32 | | |
31 | 33 | | |
32 | 34 | | |
| |||
0 commit comments