Conversation
c10c2f7 to
636d5ee
Compare
Codeowners resolved as |
Performance SLOsComparing candidate gyuheon0h/manual-checkout-verif (636d5ee) with baseline main (5a9e351) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 103.477µs (SLO: <130.000µs 📉 -20.4%) vs baseline: +1.5% Memory: ✅ 44.004MB (SLO: <46.000MB -4.3%) vs baseline: +5.2% ✅ add_inplace_aspectTime: ✅ 102.346µs (SLO: <130.000µs 📉 -21.3%) vs baseline: +1.2% Memory: ✅ 43.962MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ add_inplace_noaspectTime: ✅ 28.229µs (SLO: <40.000µs 📉 -29.4%) vs baseline: ~same Memory: ✅ 43.937MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 48.921µs (SLO: <70.000µs 📉 -30.1%) vs baseline: -1.2% Memory: ✅ 43.845MB (SLO: <46.000MB -4.7%) vs baseline: +4.6% ✅ bytearray_aspectTime: ✅ 264.396µs (SLO: <400.000µs 📉 -33.9%) vs baseline: +0.2% Memory: ✅ 43.949MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ bytearray_extend_aspectTime: ✅ 657.695µs (SLO: <800.000µs 📉 -17.8%) vs baseline: ~same Memory: ✅ 43.783MB (SLO: <46.000MB -4.8%) vs baseline: +4.6% ✅ bytearray_extend_noaspectTime: ✅ 270.775µs (SLO: <400.000µs 📉 -32.3%) vs baseline: -0.4% Memory: ✅ 43.907MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ bytearray_noaspectTime: ✅ 147.316µs (SLO: <300.000µs 📉 -50.9%) vs baseline: +0.7% Memory: ✅ 43.904MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ bytes_aspectTime: ✅ 229.016µs (SLO: <300.000µs 📉 -23.7%) vs baseline: -0.4% Memory: ✅ 43.917MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ bytes_noaspectTime: ✅ 139.020µs (SLO: <200.000µs 📉 -30.5%) vs baseline: ~same Memory: ✅ 43.913MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ bytesio_aspectTime: ✅ 3.830ms (SLO: <5.000ms 📉 -23.4%) vs baseline: ~same Memory: ✅ 43.884MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ bytesio_noaspectTime: ✅ 317.750µs (SLO: <420.000µs 📉 -24.3%) vs baseline: -1.2% Memory: ✅ 44.004MB (SLO: <46.000MB -4.3%) vs baseline: +4.8% ✅ capitalize_aspectTime: ✅ 90.240µs (SLO: <300.000µs 📉 -69.9%) vs baseline: +0.9% Memory: ✅ 44.063MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ capitalize_noaspectTime: ✅ 274.271µs (SLO: <300.000µs -8.6%) vs baseline: +7.3% Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ casefold_aspectTime: ✅ 89.667µs (SLO: <500.000µs 📉 -82.1%) vs baseline: +0.4% Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +5.4% ✅ casefold_noaspectTime: ✅ 310.299µs (SLO: <500.000µs 📉 -37.9%) vs baseline: +0.8% Memory: ✅ 43.700MB (SLO: <46.000MB -5.0%) vs baseline: +4.5% ✅ decode_aspectTime: ✅ 86.818µs (SLO: <100.000µs 📉 -13.2%) vs baseline: -0.2% Memory: ✅ 44.050MB (SLO: <46.000MB -4.2%) vs baseline: +5.0% ✅ decode_noaspectTime: ✅ 155.262µs (SLO: <210.000µs 📉 -26.1%) vs baseline: -1.7% Memory: ✅ 43.959MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 85.038µs (SLO: <200.000µs 📉 -57.5%) vs baseline: -0.1% Memory: ✅ 44.017MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 144.442µs (SLO: <200.000µs 📉 -27.8%) vs baseline: +0.3% Memory: ✅ 43.985MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 14.606ms (SLO: <19.200ms 📉 -23.9%) vs baseline: +0.2% Memory: ✅ 43.964MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ format_map_aspectTime: ✅ 16.356ms (SLO: <21.500ms 📉 -23.9%) vs baseline: -0.2% Memory: ✅ 43.975MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ format_map_noaspectTime: ✅ 361.917µs (SLO: <500.000µs 📉 -27.6%) vs baseline: +0.3% Memory: ✅ 44.082MB (SLO: <46.000MB -4.2%) vs baseline: +5.5% ✅ format_noaspectTime: ✅ 309.582µs (SLO: <500.000µs 📉 -38.1%) vs baseline: -0.6% Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ index_aspectTime: ✅ 129.182µs (SLO: <300.000µs 📉 -56.9%) vs baseline: +5.8% Memory: ✅ 43.965MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ index_noaspectTime: ✅ 40.766µs (SLO: <300.000µs 📉 -86.4%) vs baseline: -0.7% Memory: ✅ 43.965MB (SLO: <46.000MB -4.4%) vs baseline: +5.1% ✅ join_aspectTime: ✅ 216.065µs (SLO: <300.000µs 📉 -28.0%) vs baseline: ~same Memory: ✅ 43.989MB (SLO: <46.000MB -4.4%) vs baseline: +5.3% ✅ join_noaspectTime: ✅ 141.663µs (SLO: <300.000µs 📉 -52.8%) vs baseline: -0.8% Memory: ✅ 43.898MB (SLO: <46.000MB -4.6%) vs baseline: +5.0% ✅ ljust_aspectTime: ✅ 586.082µs (SLO: <700.000µs 📉 -16.3%) vs baseline: 📈 +15.8% Memory: ✅ 43.869MB (SLO: <46.000MB -4.6%) vs baseline: +5.0% ✅ ljust_noaspectTime: ✅ 261.382µs (SLO: <300.000µs 📉 -12.9%) vs baseline: +1.0% Memory: ✅ 43.926MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ lower_aspectTime: ✅ 316.868µs (SLO: <500.000µs 📉 -36.6%) vs baseline: +1.5% Memory: ✅ 43.867MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ lower_noaspectTime: ✅ 236.022µs (SLO: <300.000µs 📉 -21.3%) vs baseline: -0.6% Memory: ✅ 43.899MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ lstrip_aspectTime: ✅ 0.274ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -0.4% Memory: ✅ 43.947MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ lstrip_noaspectTime: ✅ 0.181ms (SLO: <3.000ms 📉 -94.0%) vs baseline: +1.0% Memory: ✅ 43.905MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ modulo_aspectTime: ✅ 14.185ms (SLO: <18.750ms 📉 -24.3%) vs baseline: -0.5% Memory: ✅ 44.030MB (SLO: <46.000MB -4.3%) vs baseline: +4.8% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.791ms (SLO: <19.350ms 📉 -23.6%) vs baseline: +0.1% Memory: ✅ 43.992MB (SLO: <46.000MB -4.4%) vs baseline: +5.1% ✅ modulo_aspect_for_bytesTime: ✅ 14.380ms (SLO: <18.900ms 📉 -23.9%) vs baseline: +0.3% Memory: ✅ 43.958MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.633ms (SLO: <19.150ms 📉 -23.6%) vs baseline: +0.3% Memory: ✅ 43.791MB (SLO: <46.000MB -4.8%) vs baseline: +4.4% ✅ modulo_noaspectTime: ✅ 0.362ms (SLO: <3.000ms 📉 -87.9%) vs baseline: +0.6% Memory: ✅ 43.877MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ replace_aspectTime: ✅ 18.342ms (SLO: <24.000ms 📉 -23.6%) vs baseline: +0.2% Memory: ✅ 44.004MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ replace_noaspectTime: ✅ 285.489µs (SLO: <400.000µs 📉 -28.6%) vs baseline: -0.6% Memory: ✅ 43.992MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ repr_aspectTime: ✅ 325.139µs (SLO: <420.000µs 📉 -22.6%) vs baseline: +0.4% Memory: ✅ 44.067MB (SLO: <46.000MB -4.2%) vs baseline: +5.3% ✅ repr_noaspectTime: ✅ 47.087µs (SLO: <90.000µs 📉 -47.7%) vs baseline: +0.3% Memory: ✅ 43.835MB (SLO: <46.000MB -4.7%) vs baseline: +4.4% ✅ rstrip_aspectTime: ✅ 386.211µs (SLO: <500.000µs 📉 -22.8%) vs baseline: -0.6% Memory: ✅ 43.879MB (SLO: <46.000MB -4.6%) vs baseline: +4.6% ✅ rstrip_noaspectTime: ✅ 187.365µs (SLO: <300.000µs 📉 -37.5%) vs baseline: +1.9% Memory: ✅ 43.928MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ slice_aspectTime: ✅ 182.327µs (SLO: <300.000µs 📉 -39.2%) vs baseline: +0.7% Memory: ✅ 43.977MB (SLO: <46.000MB -4.4%) vs baseline: +5.3% ✅ slice_noaspectTime: ✅ 54.287µs (SLO: <90.000µs 📉 -39.7%) vs baseline: -0.3% Memory: ✅ 43.958MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ stringio_aspectTime: ✅ 3.896ms (SLO: <5.000ms 📉 -22.1%) vs baseline: +0.4% Memory: ✅ 43.989MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ stringio_noaspectTime: ✅ 399.905µs (SLO: <500.000µs 📉 -20.0%) vs baseline: 📈 +11.4% Memory: ✅ 43.881MB (SLO: <46.000MB -4.6%) vs baseline: +4.6% ✅ strip_aspectTime: ✅ 275.373µs (SLO: <350.000µs 📉 -21.3%) vs baseline: +0.4% Memory: ✅ 43.998MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ strip_noaspectTime: ✅ 176.948µs (SLO: <240.000µs 📉 -26.3%) vs baseline: +1.1% Memory: ✅ 43.913MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ swapcase_aspectTime: ✅ 347.592µs (SLO: <500.000µs 📉 -30.5%) vs baseline: +0.6% Memory: ✅ 43.959MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ swapcase_noaspectTime: ✅ 279.224µs (SLO: <400.000µs 📉 -30.2%) vs baseline: +0.9% Memory: ✅ 43.978MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ title_aspectTime: ✅ 334.377µs (SLO: <500.000µs 📉 -33.1%) vs baseline: -0.5% Memory: ✅ 43.835MB (SLO: <46.000MB -4.7%) vs baseline: +4.7% ✅ title_noaspectTime: ✅ 263.597µs (SLO: <400.000µs 📉 -34.1%) vs baseline: +0.2% Memory: ✅ 43.849MB (SLO: <46.000MB -4.7%) vs baseline: +4.5% ✅ translate_aspectTime: ✅ 520.454µs (SLO: <700.000µs 📉 -25.6%) vs baseline: +1.0% Memory: ✅ 43.889MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ translate_noaspectTime: ✅ 426.452µs (SLO: <500.000µs 📉 -14.7%) vs baseline: -1.2% Memory: ✅ 43.907MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ upper_aspectTime: ✅ 312.095µs (SLO: <500.000µs 📉 -37.6%) vs baseline: +1.8% Memory: ✅ 43.941MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ upper_noaspectTime: ✅ 240.384µs (SLO: <400.000µs 📉 -39.9%) vs baseline: +1.2% Memory: ✅ 43.845MB (SLO: <46.000MB -4.7%) vs baseline: +4.5% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 523.032µs (SLO: <700.000µs 📉 -25.3%) vs baseline: 📈 +24.8% Memory: ✅ 43.902MB (SLO: <46.000MB -4.6%) vs baseline: +5.0% ✅ ospathbasename_noaspectTime: ✅ 428.009µs (SLO: <700.000µs 📉 -38.9%) vs baseline: -0.7% Memory: ✅ 43.933MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ ospathjoin_aspectTime: ✅ 632.905µs (SLO: <700.000µs -9.6%) vs baseline: +1.1% Memory: ✅ 43.856MB (SLO: <46.000MB -4.7%) vs baseline: +4.8% ✅ ospathjoin_noaspectTime: ✅ 636.154µs (SLO: <700.000µs -9.1%) vs baseline: +0.4% Memory: ✅ 43.953MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ ospathnormcase_aspectTime: ✅ 351.355µs (SLO: <700.000µs 📉 -49.8%) vs baseline: -0.4% Memory: ✅ 43.781MB (SLO: <46.000MB -4.8%) vs baseline: +4.5% ✅ ospathnormcase_noaspectTime: ✅ 358.265µs (SLO: <700.000µs 📉 -48.8%) vs baseline: -0.5% Memory: ✅ 43.953MB (SLO: <46.000MB -4.4%) vs baseline: +4.7% ✅ ospathsplit_aspectTime: ✅ 480.891µs (SLO: <700.000µs 📉 -31.3%) vs baseline: -0.3% Memory: ✅ 43.853MB (SLO: <46.000MB -4.7%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 491.887µs (SLO: <700.000µs 📉 -29.7%) vs baseline: ~same Memory: ✅ 43.857MB (SLO: <46.000MB -4.7%) vs baseline: +4.9% ✅ ospathsplitdrive_aspectTime: ✅ 371.939µs (SLO: <700.000µs 📉 -46.9%) vs baseline: -0.1% Memory: ✅ 43.909MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ ospathsplitdrive_noaspectTime: ✅ 72.553µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -1.1% Memory: ✅ 43.865MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ ospathsplitext_aspectTime: ✅ 458.532µs (SLO: <700.000µs 📉 -34.5%) vs baseline: ~same Memory: ✅ 43.930MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 468.870µs (SLO: <700.000µs 📉 -33.0%) vs baseline: +0.9% Memory: ✅ 43.827MB (SLO: <46.000MB -4.7%) vs baseline: +4.8% 🟡 Near SLO Breach (6 suites)🟡 djangosimple - 28/28✅ appsecTime: ✅ 19.601ms (SLO: <22.300ms 📉 -12.1%) vs baseline: ~same Memory: ✅ 71.378MB (SLO: <73.500MB -2.9%) vs baseline: +4.7% ✅ exception-replay-enabledTime: ✅ 1.364ms (SLO: <1.450ms -6.0%) vs baseline: ~same Memory: ✅ 69.680MB (SLO: <71.500MB -2.5%) vs baseline: +4.8% ✅ iastTime: ✅ 19.608ms (SLO: <22.250ms 📉 -11.9%) vs baseline: -0.3% Memory: ✅ 71.516MB (SLO: <75.000MB -4.6%) vs baseline: +5.2% ✅ profilerTime: ✅ 15.124ms (SLO: <16.550ms -8.6%) vs baseline: -0.7% Memory: ✅ 60.375MB (SLO: <61.000MB 🟡 -1.0%) vs baseline: +4.9% ✅ resource-renamingTime: ✅ 19.476ms (SLO: <21.750ms 📉 -10.5%) vs baseline: -0.4% Memory: ✅ 71.626MB (SLO: <73.500MB -2.6%) vs baseline: +5.1% ✅ span-code-originTime: ✅ 20.145ms (SLO: <28.200ms 📉 -28.6%) vs baseline: +1.6% Memory: ✅ 71.752MB (SLO: <75.000MB -4.3%) vs baseline: +4.8% ✅ tracerTime: ✅ 19.639ms (SLO: <21.750ms -9.7%) vs baseline: +0.3% Memory: ✅ 71.487MB (SLO: <75.000MB -4.7%) vs baseline: +4.9% ✅ tracer-and-profilerTime: ✅ 20.981ms (SLO: <23.500ms 📉 -10.7%) vs baseline: -0.2% Memory: ✅ 73.570MB (SLO: <75.000MB 🟡 -1.9%) vs baseline: +5.0% ✅ tracer-dont-create-db-spansTime: ✅ 19.670ms (SLO: <21.500ms -8.5%) vs baseline: -0.5% Memory: ✅ 71.496MB (SLO: <75.000MB -4.7%) vs baseline: +4.7% ✅ tracer-minimalTime: ✅ 17.873ms (SLO: <18.500ms -3.4%) vs baseline: -0.2% Memory: ✅ 71.505MB (SLO: <75.000MB -4.7%) vs baseline: +5.0% ✅ tracer-no-cachesTime: ✅ 18.763ms (SLO: <19.650ms -4.5%) vs baseline: -1.0% Memory: ✅ 71.481MB (SLO: <75.000MB -4.7%) vs baseline: +4.9% ✅ tracer-no-databasesTime: ✅ 20.803ms (SLO: <21.100ms 🟡 -1.4%) vs baseline: +0.3% Memory: ✅ 71.516MB (SLO: <75.000MB -4.6%) vs baseline: +5.1% ✅ tracer-no-middlewareTime: ✅ 20.780ms (SLO: <21.500ms -3.3%) vs baseline: +0.8% Memory: ✅ 71.428MB (SLO: <75.000MB -4.8%) vs baseline: +4.9% ✅ tracer-no-templatesTime: ✅ 19.437ms (SLO: <22.000ms 📉 -11.7%) vs baseline: ~same Memory: ✅ 71.558MB (SLO: <73.500MB -2.6%) vs baseline: +5.0% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 41.478ms (SLO: <47.150ms 📉 -12.0%) vs baseline: +0.4% Memory: ✅ 41.576MB (SLO: <47.000MB 📉 -11.5%) vs baseline: +4.8% ✅ add-metricsTime: ✅ 236.208ms (SLO: <344.800ms 📉 -31.5%) vs baseline: +0.4% Memory: ✅ 45.584MB (SLO: <47.500MB -4.0%) vs baseline: +4.8% ✅ add-tagsTime: ✅ 264.822ms (SLO: <330.000ms 📉 -19.8%) vs baseline: -0.1% Memory: ✅ 45.600MB (SLO: <47.500MB -4.0%) vs baseline: +5.2% ✅ get-contextTime: ✅ 80.981ms (SLO: <92.350ms 📉 -12.3%) vs baseline: ~same Memory: ✅ 41.347MB (SLO: <46.500MB 📉 -11.1%) vs baseline: +5.1% ✅ is-recordingTime: ✅ 37.991ms (SLO: <44.500ms 📉 -14.6%) vs baseline: ~same Memory: ✅ 41.046MB (SLO: <47.500MB 📉 -13.6%) vs baseline: +5.0% ✅ record-exceptionTime: ✅ 62.659ms (SLO: <67.650ms -7.4%) vs baseline: ~same Memory: ✅ 41.794MB (SLO: <47.000MB 📉 -11.1%) vs baseline: +4.7% ✅ set-statusTime: ✅ 43.672ms (SLO: <50.400ms 📉 -13.3%) vs baseline: -0.1% Memory: ✅ 40.959MB (SLO: <47.000MB 📉 -12.9%) vs baseline: +4.8% ✅ startTime: ✅ 38.992ms (SLO: <44.500ms 📉 -12.4%) vs baseline: +4.1% Memory: ✅ 40.921MB (SLO: <47.000MB 📉 -12.9%) vs baseline: +4.8% ✅ start-finishTime: ✅ 89.835ms (SLO: <92.000ms -2.4%) vs baseline: -0.2% Memory: ✅ 38.830MB (SLO: <46.500MB 📉 -16.5%) vs baseline: +4.5% ✅ start-finish-telemetryTime: ✅ 91.764ms (SLO: <93.000ms 🟡 -1.3%) vs baseline: -0.1% Memory: ✅ 38.633MB (SLO: <46.500MB 📉 -16.9%) vs baseline: +4.3% ✅ update-nameTime: ✅ 39.132ms (SLO: <45.150ms 📉 -13.3%) vs baseline: ~same Memory: ✅ 41.003MB (SLO: <47.000MB 📉 -12.8%) vs baseline: +5.2% 🟡 packagesupdateimporteddependencies - 24/24 (1 unstable)✅ import_manyTime: ✅ 168.086µs (SLO: <170.000µs 🟡 -1.1%) vs baseline: -0.2% Memory: ✅ 40.768MB (SLO: <46.000MB 📉 -11.4%) vs baseline: +5.0% ✅ import_many_cachedTime: ✅ 131.747µs (SLO: <170.000µs 📉 -22.5%) vs baseline: -0.1% Memory: ✅ 40.625MB (SLO: <46.000MB 📉 -11.7%) vs baseline: +4.2% ✅ import_many_stdlibTime: ✅ 1.261ms (SLO: <1.750ms 📉 -27.9%) vs baseline: +1.1% Memory: ✅ 40.986MB (SLO: <46.000MB 📉 -10.9%) vs baseline: +4.7%
|
Description
Testing
Risks
Additional Notes