Run every trace test in both fast and exhaustive modes

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

This pull request is too large for Augment to review. The PR exceeds the maximum size limit of 100000 tokens (approximately 400000 characters) for automated code review. Please consider breaking this PR into smaller, more focused changes.

[cubic-dev-ai]

No issues found across 9 files

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
E2E_Compiler_adaptivecard	66938689.22222161 ns/iter	66230890.22222454 ns/iter	1.01
E2E_Compiler_ansible_meta	29287415.374999642 ns/iter	30264006.30434854 ns/iter	0.97
E2E_Compiler_aws_cdk	373836.38136047975 ns/iter	387328.11018363904 ns/iter	0.97
E2E_Compiler_babelrc	2600187.431734432 ns/iter	2658774.932075295 ns/iter	0.98
E2E_Compiler_clang_format	18713322.27026998 ns/iter	18767952.394736502 ns/iter	1.00
E2E_Compiler_cmake_presets	25950437.888887472 ns/iter	26379672.923077088 ns/iter	0.98
E2E_Compiler_code_climate	2585073.7999999435 ns/iter	2639537.969811422 ns/iter	0.98
E2E_Compiler_cql2	13696952.611110402 ns/iter	13611449.354166657 ns/iter	1.01
E2E_Compiler_cspell	24703249.758619584 ns/iter	23506398.50000107 ns/iter	1.05
E2E_Compiler_cypress	3911807.3238636376 ns/iter	4007185.801136227 ns/iter	0.98
E2E_Compiler_deno	7647370.152173741 ns/iter	8010630.954545531 ns/iter	0.95
E2E_Compiler_dependabot	3883165.277777796 ns/iter	3981771.0568179623 ns/iter	0.98
E2E_Compiler_draft_04	2663779.851710922 ns/iter	2707097.738281261 ns/iter	0.98
E2E_Compiler_fabric_mod	4711467.979729845 ns/iter	4989494.258741256 ns/iter	0.94
E2E_Compiler_geojson	21791590.718750697 ns/iter	23431776.899999097 ns/iter	0.93
E2E_Compiler_gitpod_configuration	4892921.374999698 ns/iter	5255253.507462541 ns/iter	0.93
E2E_Compiler_helm_chart_lock	702978.2921686699 ns/iter	733407.3692480345 ns/iter	0.96
E2E_Compiler_importmap	284510.12646940426 ns/iter	298772.0377027667 ns/iter	0.95
E2E_Compiler_jasmine	1366889.9550781655 ns/iter	1402539.5384614985 ns/iter	0.97
E2E_Compiler_jshintrc	4325405.50000017 ns/iter	4539555.457516179 ns/iter	0.95
E2E_Compiler_jsconfig	22468985.709677313 ns/iter	23229379.064517733 ns/iter	0.97
E2E_Compiler_krakend	150833909.74999133 ns/iter	154237544.59999374 ns/iter	0.98
E2E_Compiler_lazygit	33070475.04762024 ns/iter	35162616.40000096 ns/iter	0.94
E2E_Compiler_lerna	1582335.9213482803 ns/iter	1625204.0509708629 ns/iter	0.97
E2E_Compiler_nest_cli	7447337.393616781 ns/iter	7599017.307692255 ns/iter	0.98
E2E_Compiler_omc	169204348.99999747 ns/iter	164748392.50000173 ns/iter	1.03
E2E_Compiler_omnisharp	6667926.980952373 ns/iter	6930068.357142861 ns/iter	0.96
E2E_Compiler_openapi	24900900.35714283 ns/iter	25591096.777778454 ns/iter	0.97
E2E_Compiler_pre_commit_hooks	5333678.259541786 ns/iter	5392727.526717783 ns/iter	0.99
E2E_Compiler_pulumi	4007429.1771426424 ns/iter	4243195.763313495 ns/iter	0.94
E2E_Compiler_semantic_release	1559157.8102678938 ns/iter	1594750.3035293748 ns/iter	0.98
E2E_Compiler_stale	1543668.6079295408 ns/iter	1662786.5922551958 ns/iter	0.93
E2E_Compiler_stylecop	6134878.315789325 ns/iter	6412673.581818043 ns/iter	0.96
E2E_Compiler_tmuxinator	1910947.2486339193 ns/iter	2023296.959999925 ns/iter	0.94
E2E_Compiler_ui5	46671099.13333055 ns/iter	49803643.92308117 ns/iter	0.94
E2E_Compiler_ui5_manifest	321130460.0000062 ns/iter	330321752.99999267 ns/iter	0.97
E2E_Compiler_unreal_engine_uproject	4549826.350649317 ns/iter	4800292.285714087 ns/iter	0.95
E2E_Compiler_vercel	12212877.4385964 ns/iter	12602268.64285739 ns/iter	0.97
E2E_Compiler_yamllint	345856.7755808411 ns/iter	359013.893138342 ns/iter	0.96
E2E_Evaluator_adaptivecard	24772.38556993482 ns/iter	25702.36786492414 ns/iter	0.96
E2E_Evaluator_ansible_meta	228938.63041354783 ns/iter	237210.24822453863 ns/iter	0.97
E2E_Evaluator_aws_cdk	50923.76706739785 ns/iter	51162.866138296966 ns/iter	1.00
E2E_Evaluator_babelrc	112839.1060358832 ns/iter	114479.31972680528 ns/iter	0.99
E2E_Evaluator_cerebrum_criminal_case	1218243.9549393486 ns/iter	1281258.9449378708 ns/iter	0.95
E2E_Evaluator_clang_format	124959.20504562084 ns/iter	129146.98584639264 ns/iter	0.97
E2E_Evaluator_cmake_presets	4292743.9316769885 ns/iter	4555407.586777124 ns/iter	0.94
E2E_Evaluator_code_climate	170389.31294964685 ns/iter	178424.42817747942 ns/iter	0.95
E2E_Evaluator_cql2	226292.80736196315 ns/iter	232757.26421838626 ns/iter	0.97
E2E_Evaluator_cspell	561141.6802557716 ns/iter	597738.1809685453 ns/iter	0.94
E2E_Evaluator_cypress	193703.00989282393 ns/iter	201888.25346710745 ns/iter	0.96
E2E_Evaluator_deno	311936.39162995474 ns/iter	317595.7760652759 ns/iter	0.98
E2E_Evaluator_dependabot	424674.04090353474 ns/iter	432150.34102243884 ns/iter	0.98
E2E_Evaluator_draft_04	7747283.679999934 ns/iter	10710426.171875121 ns/iter	0.72
E2E_Evaluator_fabric_mod	720826.2788066216 ns/iter	740177.2761506443 ns/iter	0.97
E2E_Evaluator_geojson	17182307.307692576 ns/iter	18873305.378378604 ns/iter	0.91
E2E_Evaluator_gitpod_configuration	224890.0505181404 ns/iter	230513.28187703146 ns/iter	0.98
E2E_Evaluator_helm_chart_lock	343331.3890562123 ns/iter	360644.84532925196 ns/iter	0.95
E2E_Evaluator_importmap	47707.36478419315 ns/iter	50281.36559213845 ns/iter	0.95
E2E_Evaluator_jasmine	115506.47558140046 ns/iter	119966.83470508145 ns/iter	0.96
E2E_Evaluator_jshintrc	1193252.8054607993 ns/iter	1305600.370642215 ns/iter	0.91
E2E_Evaluator_jsconfig	431508.4626682967 ns/iter	445799.71663503087 ns/iter	0.97
E2E_Evaluator_krakend	206568.236208932 ns/iter	212586.96310854482 ns/iter	0.97
E2E_Evaluator_lazygit	142012.9458257538 ns/iter	146924.2677514776 ns/iter	0.97
E2E_Evaluator_lerna	138159.48815815465 ns/iter	141942.77479297298 ns/iter	0.97
E2E_Evaluator_nest_cli	178088.5602515695 ns/iter	181459.10400209719 ns/iter	0.98
E2E_Evaluator_omc	19147.33902825314 ns/iter	19889.60797200513 ns/iter	0.96
E2E_Evaluator_omnisharp	607962.7534842916 ns/iter	620593.7987697533 ns/iter	0.98
E2E_Evaluator_openapi	13882557.905660333 ns/iter	15100365.512195114 ns/iter	0.92
E2E_Evaluator_pre_commit_hooks	470769.8255033591 ns/iter	480573.7242547263 ns/iter	0.98
E2E_Evaluator_pulumi	703918.5721544859 ns/iter	708857.4774678054 ns/iter	0.99
E2E_Evaluator_semantic_release	101700.7169430413 ns/iter	103380.20386389228 ns/iter	0.98
E2E_Evaluator_stale	150376.27429668137 ns/iter	153053.37802527015 ns/iter	0.98
E2E_Evaluator_stylecop	283859.44659410184 ns/iter	288145.4554455667 ns/iter	0.99
E2E_Evaluator_tmuxinator	95966.96289221782 ns/iter	99770.35787671637 ns/iter	0.96
E2E_Evaluator_ui5	503848.69399999845 ns/iter	506970.6366906522 ns/iter	0.99
E2E_Evaluator_ui5_manifest	2490655.580645148 ns/iter	2666057.5913979304 ns/iter	0.93
E2E_Evaluator_unreal_engine_uproject	437564.6936993476 ns/iter	460646.52491693845 ns/iter	0.95
E2E_Evaluator_vercel	307077.093227791 ns/iter	317126.1042418888 ns/iter	0.97
E2E_Evaluator_yamllint	8457.033237115613 ns/iter	8787.545156846305 ns/iter	0.96
Micro_Draft4_Meta_1_No_Callback	194.9193461682167 ns/iter	201.08325586435856 ns/iter	0.97
Micro_Draft4_Required_Properties	846.1893750188628 ns/iter	868.193245335707 ns/iter	0.97
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.254313550272155 ns/iter	22.09051655935607 ns/iter	1.05
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.208099392207716 ns/iter	11.939610337366553 ns/iter	0.94
Micro_Draft4_Items_Schema	302.9305802838371 ns/iter	294.91288749636624 ns/iter	1.03
Micro_Draft4_Nested_Object	1.7766015680619878 ns/iter	1.7803636613357876 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	337.3840240670605 ns/iter	358.42310925561 ns/iter	0.94
Micro_Draft4_Properties_Triad_Closed	268.06773116841913 ns/iter	279.334878824917 ns/iter	0.96
Micro_Draft4_Properties_Triad_Required	334.81937130857364 ns/iter	349.3639571625127 ns/iter	0.96
Micro_Draft4_Properties_Closed	55.56443325477169 ns/iter	57.82930430905246 ns/iter	0.96
Micro_Draft4_Non_Recursive_Ref	14.419414251324001 ns/iter	14.529071796989042 ns/iter	0.99
Micro_Draft4_Pattern_Properties_True	157.28067054868302 ns/iter	157.7389386311956 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	11.212965484282954 ns/iter	11.56535490217847 ns/iter	0.97
Micro_Draft4_Additional_Properties_Type	28.350300737987542 ns/iter	28.662049043013592 ns/iter	0.99
Micro_Draft4_Nested_Oneof	56.37011142544862 ns/iter	58.5165748570387 ns/iter	0.96
Micro_Draft4_Short_Enum	14.17553628074907 ns/iter	14.19458041191001 ns/iter	1.00
Micro_Draft4_Long_Enum	14.970620630160177 ns/iter	15.116524328327728 ns/iter	0.99
Micro_Draft4_Long_Enum_Short_Strings	14.11347110413663 ns/iter	14.241917795058235 ns/iter	0.99
Micro_Draft4_Type_Object	3.739286869743286 ns/iter	3.8731702339542347 ns/iter	0.97
Micro_Draft4_Ref_Single_100	2347109.9395973147 ns/iter	2454435.0761246146 ns/iter	0.96
Micro_Draft4_Compile_Ref_Many_Nested	1705863.187804819 ns/iter	1815575.724226742 ns/iter	0.94
Micro_Draft4_Compile_Wrap	2377188.5743242535 ns/iter	2467084.9965035375 ns/iter	0.96
Micro_Draft6_Property_Names	134.82481239067275 ns/iter	142.9610422193453 ns/iter	0.94
Micro_Draft6_Compile_FHIR	13969301576.000021 ns/iter	15366753567.000046 ns/iter	0.91
Micro_Draft7_If_Then_Else	23.99575635908183 ns/iter	25.42211878326979 ns/iter	0.94
Micro_2019_09_Unevaluated_Properties	27.467539099885034 ns/iter	28.82604463133673 ns/iter	0.95
Micro_2019_09_Compile_Wrap	283898176.5000028 ns/iter	335076929.4999623 ns/iter	0.85
Micro_2019_09_KrakenD_Linter_Check	1158685263.9999847 ns/iter	1235574494.0000477 ns/iter	0.94
Micro_2019_09_KrakenD_Linter_Apply	10355831633.000036 ns/iter	11035529981.999958 ns/iter	0.94
Micro_2020_12_Dynamic_Ref	227.58984356917819 ns/iter	239.19441234646422 ns/iter	0.95
Micro_2020_12_Dynamic_Ref_Single	3.425378093426824 ns/iter	3.471435710110157 ns/iter	0.99
Micro_2020_12_Simple_Output_Mask	65308.311349834745 ns/iter	67490.84252121094 ns/iter	0.97
Micro_2020_12_Simple_Output_Annotations	101770.2780046631 ns/iter	106211.15190062237 ns/iter	0.96
Micro_2020_12_Compile_NonCircular_Shared_Refs	1108526.4347825516 ns/iter	1107740.3067092267 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric	8250.953167437327 ns/iter	10267.513746934635 ns/iter	0.80
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	181244.49677085594 ns/iter	181451.14424799458 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22480.97047045627 ns/iter	23331.195076391574 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	140.80488629460592 ns/iter	143.38219832557405 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4302.55584612132 ns/iter	4330.850487773035 ns/iter	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
E2E_Evaluator_adaptivecard	111999 ns	120408 ns	0.93
E2E_Evaluator_ansible-meta	952199 ns	1043345 ns	0.91
E2E_Evaluator_aws-cdk	213555 ns	236597 ns	0.90
E2E_Evaluator_babelrc	403091 ns	427663 ns	0.94
E2E_Evaluator_cerebrum-criminal-case	4260050 ns	4636367 ns	0.92
E2E_Evaluator_clang-format	151069 ns	165242 ns	0.91
E2E_Evaluator_cmake-presets	18964075 ns	17616132 ns	1.08
E2E_Evaluator_code-climate	874727 ns	886943 ns	0.99
E2E_Evaluator_cql2	1084825 ns	1099382 ns	0.99
E2E_Evaluator_cspell	1750589 ns	1810414 ns	0.97
E2E_Evaluator_cypress	533281 ns	543936 ns	0.98
E2E_Evaluator_deno	1009482 ns	1042126 ns	0.97
E2E_Evaluator_dependabot	1514915 ns	1609284 ns	0.94
E2E_Evaluator_draft-04	22916265 ns	23993758 ns	0.96
E2E_Evaluator_fabric-mod	3045806 ns	3168530 ns	0.96
E2E_Evaluator_geojson	59525475 ns	61927950 ns	0.96
E2E_Evaluator_gitpod-configuration	923901 ns	944198 ns	0.98
E2E_Evaluator_helm-chart-lock	1474509 ns	1530095 ns	0.96
E2E_Evaluator_importmap	414920 ns	442464 ns	0.94
E2E_Evaluator_jasmine	487320 ns	516990 ns	0.94
E2E_Evaluator_jsconfig	1309990 ns	1416443 ns	0.92
E2E_Evaluator_jshintrc	1840543 ns	1897687 ns	0.97
E2E_Evaluator_krakend	699511 ns	706909 ns	0.99
E2E_Evaluator_lazygit	501147 ns	509565 ns	0.98
E2E_Evaluator_lerna	528299 ns	549937 ns	0.96
E2E_Evaluator_nest-cli	824236 ns	867424 ns	0.95
E2E_Evaluator_omc	84281 ns	92216 ns	0.91
E2E_Evaluator_omnisharp	1158121 ns	1245933 ns	0.93
E2E_Evaluator_openapi	39491976 ns	53828136 ns	0.73
E2E_Evaluator_pre-commit-hooks	1493354 ns	1576120 ns	0.95
E2E_Evaluator_pulumi	2559699 ns	2904962 ns	0.88
E2E_Evaluator_semantic-release	470328 ns	532795 ns	0.88
E2E_Evaluator_stale	560976 ns	616429 ns	0.91
E2E_Evaluator_stylecop	982562 ns	1018345 ns	0.96
E2E_Evaluator_tmuxinator	373642 ns	392157 ns	0.95
E2E_Evaluator_ui5	2239521 ns	2307108 ns	0.97
E2E_Evaluator_ui5-manifest	9983843 ns	11785465 ns	0.85
E2E_Evaluator_unreal-engine-uproject	1595965 ns	1701358 ns	0.94
E2E_Evaluator_vercel	1104577 ns	1144597 ns	0.97
E2E_Evaluator_yamllint	72455 ns	75943 ns	0.95

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
E2E_Compiler_adaptivecard	79225888.88888842 ns/iter	57224778.846156925 ns/iter	1.38
E2E_Compiler_ansible_meta	36414043.59090798 ns/iter	25587636.482759204 ns/iter	1.42
E2E_Compiler_aws_cdk	541010.6918239368 ns/iter	283812.5505663469 ns/iter	1.91
E2E_Compiler_babelrc	3744661.1095236093 ns/iter	2219090.0455927895 ns/iter	1.69
E2E_Compiler_clang_format	22005685.71428708 ns/iter	15746580.775510443 ns/iter	1.40
E2E_Compiler_cmake_presets	36762184.52380908 ns/iter	26017697.555554755 ns/iter	1.41
E2E_Compiler_code_climate	3059627.2723739278 ns/iter	2217987.6616313243 ns/iter	1.38
E2E_Compiler_cql2	15872587.71052659 ns/iter	12017999.999999793 ns/iter	1.32
E2E_Compiler_cspell	25080493.57692681 ns/iter	22770108.77777583 ns/iter	1.10
E2E_Compiler_cypress	4785260.948905203 ns/iter	3660270.1648932714 ns/iter	1.31
E2E_Compiler_deno	8705116.22368416 ns/iter	6877288.0775866425 ns/iter	1.27
E2E_Compiler_dependabot	4312144.375796182 ns/iter	3789966.7113402546 ns/iter	1.14
E2E_Compiler_draft_04	2590312.7804054758 ns/iter	2029658.2633054333 ns/iter	1.28
E2E_Compiler_fabric_mod	5250618.838028656 ns/iter	3751078.947368569 ns/iter	1.40
E2E_Compiler_geojson	34163153.40909002 ns/iter	22539051.75757609 ns/iter	1.52
E2E_Compiler_gitpod_configuration	6476072.919999751 ns/iter	4134459.580838072 ns/iter	1.57
E2E_Compiler_helm_chart_lock	1045163.487485039 ns/iter	529687.5000000227 ns/iter	1.97
E2E_Compiler_importmap	307178.26586235635 ns/iter	208870.9689134073 ns/iter	1.47
E2E_Compiler_jasmine	1479183.0246914276 ns/iter	1146547.4373178342 ns/iter	1.29
E2E_Compiler_jshintrc	4520236.013986123 ns/iter	3348436.0328635857 ns/iter	1.35
E2E_Compiler_jsconfig	26700825.307692904 ns/iter	19072284.722224392 ns/iter	1.40
E2E_Compiler_krakend	188440072.74998376 ns/iter	129038367.99999149 ns/iter	1.46
E2E_Compiler_lazygit	47328698.52940733 ns/iter	31489920.454548195 ns/iter	1.50
E2E_Compiler_lerna	1983888.4378695448 ns/iter	1340681.1131386203 ns/iter	1.48
E2E_Compiler_nest_cli	9093777.96202517 ns/iter	6109961.161016753 ns/iter	1.49
E2E_Compiler_omc	246983562.50002006 ns/iter	160562449.99999762 ns/iter	1.54
E2E_Compiler_omnisharp	8561836.773195602 ns/iter	5903156.000000308 ns/iter	1.45
E2E_Compiler_openapi	32743891.680001978 ns/iter	21299580.645158894 ns/iter	1.54
E2E_Compiler_pre_commit_hooks	5518205.22388062 ns/iter	4116656.54913272 ns/iter	1.34
E2E_Compiler_pulumi	3900403.773480682 ns/iter	3326466.8190046665 ns/iter	1.17
E2E_Compiler_semantic_release	1510085.3250479228 ns/iter	1277596.2239316853 ns/iter	1.18
E2E_Compiler_stale	1851496.6358267658 ns/iter	1282382.1381118307 ns/iter	1.44
E2E_Compiler_stylecop	8061641.343137099 ns/iter	5543763.789473917 ns/iter	1.45
E2E_Compiler_tmuxinator	2471617.308724749 ns/iter	1544175.3974081785 ns/iter	1.60
E2E_Compiler_ui5	83320388.88888998 ns/iter	50552937.49999236 ns/iter	1.65
E2E_Compiler_ui5_manifest	524457374.9999972 ns/iter	287363611.3333381 ns/iter	1.83
E2E_Compiler_unreal_engine_uproject	5376330.830000597 ns/iter	4145801.432291781 ns/iter	1.30
E2E_Compiler_vercel	18145852.07499988 ns/iter	13117474.467741607 ns/iter	1.38
E2E_Compiler_yamllint	365315.02672150097 ns/iter	258901.3231457475 ns/iter	1.41
E2E_Evaluator_adaptivecard	27273.95010751088 ns/iter	18803.998251793917 ns/iter	1.45
E2E_Evaluator_ansible_meta	225084.2756183448 ns/iter	164626.91763037557 ns/iter	1.37
E2E_Evaluator_aws_cdk	44952.45807697825 ns/iter	36816.96039167797 ns/iter	1.22
E2E_Evaluator_babelrc	103088.57046397433 ns/iter	84608.27598854585 ns/iter	1.22
E2E_Evaluator_cerebrum_criminal_case	1385137.1499175802 ns/iter	920859.6582781462 ns/iter	1.50
E2E_Evaluator_clang_format	128201.34932907126 ns/iter	105669.97759533676 ns/iter	1.21
E2E_Evaluator_cmake_presets	3801428.072625264 ns/iter	3142835.119048132 ns/iter	1.21
E2E_Evaluator_code_climate	186921.22782556422 ns/iter	121157.37129483584 ns/iter	1.54
E2E_Evaluator_cql2	171794.77426701575 ns/iter	145254.6257681244 ns/iter	1.18
E2E_Evaluator_cspell	486642.8710937676 ns/iter	381426.21509008494 ns/iter	1.28
E2E_Evaluator_cypress	188837.24585270663 ns/iter	147177.08151880495 ns/iter	1.28
E2E_Evaluator_deno	338636.82504968514 ns/iter	230137.04958411845 ns/iter	1.47
E2E_Evaluator_dependabot	417157.27988945384 ns/iter	324624.4984395837 ns/iter	1.29
E2E_Evaluator_draft_04	7110160.569105921 ns/iter	5140344.4244602965 ns/iter	1.38
E2E_Evaluator_fabric_mod	837945.6662856422 ns/iter	461187.61088977876 ns/iter	1.82
E2E_Evaluator_geojson	14642217.592592243 ns/iter	10213918.514705589 ns/iter	1.43
E2E_Evaluator_gitpod_configuration	217718.99216645941 ns/iter	147207.93775056853 ns/iter	1.48
E2E_Evaluator_helm_chart_lock	222765.03548646925 ns/iter	203113.58502739875 ns/iter	1.10
E2E_Evaluator_importmap	33637.086618254005 ns/iter	27839.68094876915 ns/iter	1.21
E2E_Evaluator_jasmine	96336.16780623705 ns/iter	73392.69250915886 ns/iter	1.31
E2E_Evaluator_jshintrc	1094462.2982954723 ns/iter	857199.1758242223 ns/iter	1.28
E2E_Evaluator_jsconfig	313983.04202080675 ns/iter	301018.27164888044 ns/iter	1.04
E2E_Evaluator_krakend	141217.24470136777 ns/iter	118485.48332486898 ns/iter	1.19
E2E_Evaluator_lazygit	103836.24217511283 ns/iter	90183.36456680957 ns/iter	1.15
E2E_Evaluator_lerna	177182.96106813967 ns/iter	106885.52959406265 ns/iter	1.66
E2E_Evaluator_nest_cli	133012.43646285243 ns/iter	113017.12633452914 ns/iter	1.18
E2E_Evaluator_omc	16316.842466805498 ns/iter	13331.021749530224 ns/iter	1.22
E2E_Evaluator_omnisharp	436203.1327561439 ns/iter	394199.59776205785 ns/iter	1.11
E2E_Evaluator_openapi	8211942.545453137 ns/iter	7179539.9484537635 ns/iter	1.14
E2E_Evaluator_pre_commit_hooks	342917.1511627854 ns/iter	319831.19757686695 ns/iter	1.07
E2E_Evaluator_pulumi	520143.9964158097 ns/iter	467824.16406247293 ns/iter	1.11
E2E_Evaluator_semantic_release	68423.71418799882 ns/iter	62569.148985821455 ns/iter	1.09
E2E_Evaluator_stale	136613.63448506646 ns/iter	100391.37476674595 ns/iter	1.36
E2E_Evaluator_stylecop	206121.32952693375 ns/iter	168651.79147978735 ns/iter	1.22
E2E_Evaluator_tmuxinator	75626.2359955766 ns/iter	66090.95836947976 ns/iter	1.14
E2E_Evaluator_ui5	376781.7606609942 ns/iter	301262.3390557471 ns/iter	1.25
E2E_Evaluator_ui5_manifest	1799765.4622641567 ns/iter	1389977.2206760985 ns/iter	1.29
E2E_Evaluator_unreal_engine_uproject	360999.97688496637 ns/iter	285240.88448973215 ns/iter	1.27
E2E_Evaluator_vercel	267003.41866201046 ns/iter	211979.14129113036 ns/iter	1.26
E2E_Evaluator_yamllint	6674.362282146659 ns/iter	5464.336424883665 ns/iter	1.22
Micro_Draft4_Meta_1_No_Callback	135.36610915058088 ns/iter	116.98608747884428 ns/iter	1.16
Micro_Draft4_Required_Properties	661.745520979404 ns/iter	569.3528354652269 ns/iter	1.16
Micro_Draft4_Many_Optional_Properties_Minimal_Match	17.6772525116333 ns/iter	14.684698828707512 ns/iter	1.20
Micro_Draft4_Few_Optional_Properties_Minimal_Match	8.207049962815605 ns/iter	6.7820079785151455 ns/iter	1.21
Micro_Draft4_Items_Schema	277.03899072793075 ns/iter	235.34885416407494 ns/iter	1.18
Micro_Draft4_Nested_Object	0.7128717783471539 ns/iter	0.6273201890724627 ns/iter	1.14
Micro_Draft4_Properties_Triad_Optional	213.84718409390774 ns/iter	191.63146775139992 ns/iter	1.12
Micro_Draft4_Properties_Triad_Closed	180.8086915323539 ns/iter	151.93205720827743 ns/iter	1.19
Micro_Draft4_Properties_Triad_Required	225.09624382501514 ns/iter	193.30299501389297 ns/iter	1.16
Micro_Draft4_Properties_Closed	39.32264412008233 ns/iter	34.05023979647731 ns/iter	1.15
Micro_Draft4_Non_Recursive_Ref	13.514103629643706 ns/iter	11.660301817311405 ns/iter	1.16
Micro_Draft4_Pattern_Properties_True	145.38936517634897 ns/iter	134.94798902328338 ns/iter	1.08
Micro_Draft4_Ref_To_Single_Property	7.429139687204046 ns/iter	6.669946457670161 ns/iter	1.11
Micro_Draft4_Additional_Properties_Type	27.279990950739503 ns/iter	23.614534174936754 ns/iter	1.16
Micro_Draft4_Nested_Oneof	46.04249866233735 ns/iter	37.52537755801621 ns/iter	1.23
Micro_Draft4_Short_Enum	5.355911844171105 ns/iter	4.4933284404452865 ns/iter	1.19
Micro_Draft4_Long_Enum	10.925728842837 ns/iter	9.114707099067848 ns/iter	1.20
Micro_Draft4_Long_Enum_Short_Strings	6.717510556616711 ns/iter	5.806401780510787 ns/iter	1.16
Micro_Draft4_Type_Object	2.303937921739715 ns/iter	2.0406498967852045 ns/iter	1.13
Micro_Draft4_Ref_Single_100	1910854.8778406358 ns/iter	1522858.1885965373 ns/iter	1.25
Micro_Draft4_Compile_Ref_Many_Nested	1417951.8384031055 ns/iter	1167466.573954967 ns/iter	1.21
Micro_Draft4_Compile_Wrap	2262398.311897086 ns/iter	1820075.5621759472 ns/iter	1.24
Micro_Draft6_Property_Names	101.61292745556196 ns/iter	88.70639445588151 ns/iter	1.15
Micro_Draft6_Compile_FHIR	11035198499.999979 ns/iter	6820258874.999808 ns/iter	1.62
Micro_Draft7_If_Then_Else	19.10847201808895 ns/iter	15.98403374386119 ns/iter	1.20
Micro_2019_09_Unevaluated_Properties	27.351696060765764 ns/iter	24.165905529833513 ns/iter	1.13
Micro_2019_09_Compile_Wrap	355729750.0000232 ns/iter	262324208.33336315 ns/iter	1.36
Micro_2019_09_KrakenD_Linter_Check	874895166.999977 ns/iter	534820207.99992824 ns/iter	1.64
Micro_2019_09_KrakenD_Linter_Apply	6897089042.000061 ns/iter	4919127957.000001 ns/iter	1.40
Micro_2020_12_Dynamic_Ref	197.2931421689216 ns/iter	171.99848094865052 ns/iter	1.15
Micro_2020_12_Dynamic_Ref_Single	2.3083624171991635 ns/iter	2.14324329243658 ns/iter	1.08
Micro_2020_12_Simple_Output_Mask	65300.4728796021 ns/iter	55919.630210420095 ns/iter	1.17
Micro_2020_12_Simple_Output_Annotations	99457.79952268253 ns/iter	78671.24972053489 ns/iter	1.26
Micro_2020_12_Compile_NonCircular_Shared_Refs	915892.4906417653 ns/iter	728668.5649201395 ns/iter	1.26
Micro_2020_12_Exhaustive_Deep_Numeric	5822.298426817128 ns/iter	4856.952438848626 ns/iter	1.20
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	124278.03438792336 ns/iter	105327.6373111759 ns/iter	1.18
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	15407.329349207195 ns/iter	13257.64643918318 ns/iter	1.16
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	103.00850552665086 ns/iter	86.06056468701489 ns/iter	1.20
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	5397.788729937327 ns/iter	4441.487778151476 ns/iter	1.22

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
E2E_Evaluator_adaptivecard	95424 ns	93654 ns	1.02
E2E_Evaluator_ansible-meta	849087 ns	842281 ns	1.01
E2E_Evaluator_aws-cdk	181098 ns	171278 ns	1.06
E2E_Evaluator_babelrc	313839 ns	297012 ns	1.06
E2E_Evaluator_cerebrum-criminal-case	3954101 ns	2937601 ns	1.35
E2E_Evaluator_clang-format	132770 ns	113036 ns	1.17
E2E_Evaluator_cmake-presets	18850363 ns	13284218 ns	1.42
E2E_Evaluator_code-climate	1218491 ns	670362 ns	1.82
E2E_Evaluator_cql2	1555918 ns	844158 ns	1.84
E2E_Evaluator_cspell	1726159 ns	1507050 ns	1.15
E2E_Evaluator_cypress	545963 ns	438706 ns	1.24
E2E_Evaluator_deno	814610 ns	702166 ns	1.16
E2E_Evaluator_dependabot	1222087 ns	1172126 ns	1.04
E2E_Evaluator_draft-04	17085227 ns	15923391 ns	1.07
E2E_Evaluator_fabric-mod	2319703 ns	2178150 ns	1.06
E2E_Evaluator_geojson	52439225 ns	43920156 ns	1.19
E2E_Evaluator_gitpod-configuration	745159 ns	630977 ns	1.18
E2E_Evaluator_helm-chart-lock	1560831 ns	1286194 ns	1.21
E2E_Evaluator_importmap	386628 ns	338653 ns	1.14
E2E_Evaluator_jasmine	402584 ns	455014 ns	0.88
E2E_Evaluator_jsconfig	1083238 ns	1233626 ns	0.88
E2E_Evaluator_jshintrc	1851982 ns	1642035 ns	1.13
E2E_Evaluator_krakend	527063 ns	464125 ns	1.14
E2E_Evaluator_lazygit	395159 ns	344224 ns	1.15
E2E_Evaluator_lerna	513431 ns	422321 ns	1.22
E2E_Evaluator_nest-cli	706989 ns	594372 ns	1.19
E2E_Evaluator_omc	95081 ns	66562 ns	1.43
E2E_Evaluator_omnisharp	1230360 ns	931186 ns	1.32
E2E_Evaluator_openapi	31991931 ns	27492452 ns	1.16
E2E_Evaluator_pre-commit-hooks	1309615 ns	1216511 ns	1.08
E2E_Evaluator_pulumi	2302242 ns	2121697 ns	1.09
E2E_Evaluator_semantic-release	402500 ns	370180 ns	1.09
E2E_Evaluator_stale	547785 ns	440740 ns	1.24
E2E_Evaluator_stylecop	808083 ns	664070 ns	1.22
E2E_Evaluator_tmuxinator	330842 ns	280948 ns	1.18
E2E_Evaluator_ui5	2151942 ns	1544322 ns	1.39
E2E_Evaluator_ui5-manifest	10805918 ns	7776370 ns	1.39
E2E_Evaluator_unreal-engine-uproject	1624040 ns	1359916 ns	1.19
E2E_Evaluator_vercel	1086308 ns	860020 ns	1.26
E2E_Evaluator_yamllint	65821 ns	53104 ns	1.24

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
Micro_2020_12_Dynamic_Ref	260.5640614712991 ns/iter	263.27259839034775 ns/iter	0.99
Micro_2020_12_Dynamic_Ref_Single	4.980543681730856 ns/iter	4.981060966790661 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	75061.45139476242 ns/iter	75370.19278394298 ns/iter	1.00
Micro_2020_12_Simple_Output_Annotations	113401.60579427956 ns/iter	115696.39196812466 ns/iter	0.98
Micro_2020_12_Compile_NonCircular_Shared_Refs	1208089.8969073356 ns/iter	1197059.9863013285 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric	8240.262163277219 ns/iter	8250.450569717263 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	167093.17930376838 ns/iter	167644.08343293826 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25550.013701139105 ns/iter	25305.139849297557 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	126.36692785832832 ns/iter	126.62772544527219 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4753.984717879428 ns/iter	4726.116241037391 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	28.76882913172483 ns/iter	28.66953276626815 ns/iter	1.00
Micro_2019_09_Compile_Wrap	303308287.9999824 ns/iter	310409701.000026 ns/iter	0.98
Micro_2019_09_KrakenD_Linter_Check	1256447378.9999511 ns/iter	1234042428.000066 ns/iter	1.02
Micro_2019_09_KrakenD_Linter_Apply	11209384390.000082 ns/iter	11015937974.99993 ns/iter	1.02
Micro_Draft7_If_Then_Else	24.649174635030818 ns/iter	24.629150678358606 ns/iter	1.00
Micro_Draft6_Property_Names	142.0614527407322 ns/iter	141.85991428693532 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14110651407.000092 ns/iter	14616578831.000084 ns/iter	0.97
Micro_Draft4_Meta_1_No_Callback	167.13155291883535 ns/iter	166.26667672386728 ns/iter	1.01
Micro_Draft4_Required_Properties	816.223126798438 ns/iter	820.9981544424471 ns/iter	0.99
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.203342786074092 ns/iter	21.34734079245638 ns/iter	0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match	13.10031360616058 ns/iter	13.096093694692504 ns/iter	1.00
Micro_Draft4_Items_Schema	327.31973703563233 ns/iter	338.9296410835497 ns/iter	0.97
Micro_Draft4_Nested_Object	1.8698485808571086 ns/iter	1.8695586395720896 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	393.0242529894026 ns/iter	410.5347617240683 ns/iter	0.96
Micro_Draft4_Properties_Triad_Closed	321.5710779241749 ns/iter	333.37092178162436 ns/iter	0.96
Micro_Draft4_Properties_Triad_Required	417.57864177111475 ns/iter	422.4765509799138 ns/iter	0.99
Micro_Draft4_Properties_Closed	62.976132552079434 ns/iter	63.01147162679256 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	9.653552126470798 ns/iter	9.654273240885084 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	207.9968149573849 ns/iter	207.90517604900566 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	13.405384504833918 ns/iter	13.41552259217135 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	15.259909984400048 ns/iter	15.617066008466887 ns/iter	0.98
Micro_Draft4_Nested_Oneof	66.33762280952776 ns/iter	65.39917726407916 ns/iter	1.01
Micro_Draft4_Short_Enum	14.685464004342569 ns/iter	14.645549016858098 ns/iter	1.00
Micro_Draft4_Long_Enum	14.346772852087398 ns/iter	14.341900078802668 ns/iter	1.00
Micro_Draft4_Long_Enum_Short_Strings	14.68315332137983 ns/iter	14.714063641841516 ns/iter	1.00
Micro_Draft4_Type_Object	4.670913358004428 ns/iter	4.669951308457571 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2523542.856631047 ns/iter	2508195.348920983 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1835644.3749999823 ns/iter	1826876.2604165545 ns/iter	1.00
Micro_Draft4_Compile_Wrap	2565265.3003665665 ns/iter	2592662.5202951627 ns/iter	0.99
E2E_Compiler_adaptivecard	64864543.27272317 ns/iter	66955037.100001395 ns/iter	0.97
E2E_Compiler_ansible_meta	30378342.260870222 ns/iter	30416549.2608688 ns/iter	1.00
E2E_Compiler_aws_cdk	413740.906139321 ns/iter	413230.2565011312 ns/iter	1.00
E2E_Compiler_babelrc	2783384.079365413 ns/iter	2771582.4126982535 ns/iter	1.00
E2E_Compiler_clang_format	19567551.944444656 ns/iter	19718766.44444453 ns/iter	0.99
E2E_Compiler_cmake_presets	26852318.615383938 ns/iter	27498874.56000124 ns/iter	0.98
E2E_Compiler_code_climate	2794873.0476190406 ns/iter	2785427.174603322 ns/iter	1.00
E2E_Compiler_cql2	13824504.980392454 ns/iter	14041340.579999542 ns/iter	0.98
E2E_Compiler_cspell	23760686.82758614 ns/iter	24132629.689657293 ns/iter	0.98
E2E_Compiler_cypress	4111385.187134572 ns/iter	4162349.7724555167 ns/iter	0.99
E2E_Compiler_deno	8199271.435293721 ns/iter	8226832.43529408 ns/iter	1.00
E2E_Compiler_dependabot	4173094.0654766914 ns/iter	4185378.2500005485 ns/iter	1.00
E2E_Compiler_draft_04	2990840.995798461 ns/iter	2955041.90756328 ns/iter	1.01
E2E_Compiler_fabric_mod	5114779.2554742955 ns/iter	5146766.9179100655 ns/iter	0.99
E2E_Compiler_geojson	23641340.965515815 ns/iter	23735229.103447728 ns/iter	1.00
E2E_Compiler_gitpod_configuration	5286370.789473292 ns/iter	5285541.654134967 ns/iter	1.00
E2E_Compiler_helm_chart_lock	750855.5786096301 ns/iter	754557.2840299555 ns/iter	1.00
E2E_Compiler_importmap	308754.69496019726 ns/iter	309260.29681977356 ns/iter	1.00
E2E_Compiler_jasmine	1462832.3736952401 ns/iter	1473158.0125785982 ns/iter	0.99
E2E_Compiler_jshintrc	4685219.852349108 ns/iter	4701224.710344894 ns/iter	1.00
E2E_Compiler_jsconfig	23175017.899999753 ns/iter	23460159.43333365 ns/iter	0.99
E2E_Compiler_krakend	141170114.800002 ns/iter	145404115.40001515 ns/iter	0.97
E2E_Compiler_lazygit	35418105.849998936 ns/iter	35795005.52631854 ns/iter	0.99
E2E_Compiler_lerna	1724431.4518519684 ns/iter	1747500.8254365535 ns/iter	0.99
E2E_Compiler_nest_cli	7965407.295455665 ns/iter	8059126.33333442 ns/iter	0.99
E2E_Compiler_omc	161449648.74999344 ns/iter	166387653.24998417 ns/iter	0.97
E2E_Compiler_omnisharp	7157763.020407922 ns/iter	7154299.602040728 ns/iter	1.00
E2E_Compiler_openapi	26831362.23076697 ns/iter	27004415.26923214 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5691827.0325211305 ns/iter	5711430.634146086 ns/iter	1.00
E2E_Compiler_pulumi	4380959.19374959 ns/iter	4375644.743750229 ns/iter	1.00
E2E_Compiler_semantic_release	1695473.84708738 ns/iter	1707679.5752426207 ns/iter	0.99
E2E_Compiler_stale	1660517.199524932 ns/iter	1680839.7740382801 ns/iter	0.99
E2E_Compiler_stylecop	6335235.690909775 ns/iter	6419833.5963297775 ns/iter	0.99
E2E_Compiler_tmuxinator	2097488.2305391002 ns/iter	2102123.464071692 ns/iter	1.00
E2E_Compiler_ui5	48662051.35713894 ns/iter	49723695.071423076 ns/iter	0.98
E2E_Compiler_ui5_manifest	321910764.99998415 ns/iter	340552700.9999787 ns/iter	0.95
E2E_Compiler_unreal_engine_uproject	4952705.858155654 ns/iter	4946776.359155381 ns/iter	1.00
E2E_Compiler_vercel	13054760.851852514 ns/iter	13206451.71698151 ns/iter	0.99
E2E_Compiler_yamllint	377498.89476526686 ns/iter	378762.7474309983 ns/iter	1.00
E2E_Evaluator_adaptivecard	23942.081394199664 ns/iter	23482.325005059774 ns/iter	1.02
E2E_Evaluator_ansible_meta	244458.95515534538 ns/iter	250331.98108493994 ns/iter	0.98
E2E_Evaluator_aws_cdk	51313.25816220919 ns/iter	51871.14607900317 ns/iter	0.99
E2E_Evaluator_babelrc	104175.39006358893 ns/iter	106149.6295799754 ns/iter	0.98
E2E_Evaluator_cerebrum_criminal_case	1280174.8675136666 ns/iter	1284368.9739777457 ns/iter	1.00
E2E_Evaluator_clang_format	109587.42687747492 ns/iter	105595.3644660862 ns/iter	1.04
E2E_Evaluator_cmake_presets	4403336.6289306525 ns/iter	4464043.113923881 ns/iter	0.99
E2E_Evaluator_code_climate	182786.02738654445 ns/iter	183980.66078017929 ns/iter	0.99
E2E_Evaluator_cql2	211312.3053458191 ns/iter	213126.9897404926 ns/iter	0.99
E2E_Evaluator_cspell	538123.2501901162 ns/iter	543190.5897435733 ns/iter	0.99
E2E_Evaluator_cypress	168863.95756547284 ns/iter	168664.18439024794 ns/iter	1.00
E2E_Evaluator_deno	333935.3107210595 ns/iter	337709.60639313783 ns/iter	0.99
E2E_Evaluator_dependabot	461870.2303110505 ns/iter	463313.6279225399 ns/iter	1.00
E2E_Evaluator_draft_04	6364769.657407291 ns/iter	7278759.353534905 ns/iter	0.87
E2E_Evaluator_fabric_mod	742018.9474237567 ns/iter	737446.4856839802 ns/iter	1.01
E2E_Evaluator_geojson	16666738.232558155 ns/iter	16584865.309525976 ns/iter	1.00
E2E_Evaluator_gitpod_configuration	254344.71542650365 ns/iter	250861.09259259756 ns/iter	1.01
E2E_Evaluator_helm_chart_lock	319466.7877813754 ns/iter	322898.4160218072 ns/iter	0.99
E2E_Evaluator_importmap	48107.505844701845 ns/iter	48492.64938896662 ns/iter	0.99
E2E_Evaluator_jasmine	115571.48616600009 ns/iter	115871.15016667818 ns/iter	1.00
E2E_Evaluator_jshintrc	1019537.4497816295 ns/iter	1025423.434462409 ns/iter	0.99
E2E_Evaluator_jsconfig	407876.31141871744 ns/iter	398254.31545914244 ns/iter	1.02
E2E_Evaluator_krakend	208527.4359829891 ns/iter	206316.456393575 ns/iter	1.01
E2E_Evaluator_lazygit	135636.5103501537 ns/iter	132308.15606149007 ns/iter	1.03
E2E_Evaluator_lerna	149143.7616984349 ns/iter	150696.94832762465 ns/iter	0.99
E2E_Evaluator_nest_cli	195582.9573632475 ns/iter	195035.39163177944 ns/iter	1.00
E2E_Evaluator_omc	19072.994073028767 ns/iter	19284.734988783846 ns/iter	0.99
E2E_Evaluator_omnisharp	552154.8817967363 ns/iter	554414.3856574496 ns/iter	1.00
E2E_Evaluator_openapi	11846953.58620635 ns/iter	13781903.6603757 ns/iter	0.86
E2E_Evaluator_pre_commit_hooks	509012.9992695876 ns/iter	513320.33999996283 ns/iter	0.99
E2E_Evaluator_pulumi	709480.6358148269 ns/iter	702318.1731959264 ns/iter	1.01
E2E_Evaluator_semantic_release	101394.74178269717 ns/iter	101902.41315297586 ns/iter	1.00
E2E_Evaluator_stale	153178.51650993762 ns/iter	153982.9973521708 ns/iter	0.99
E2E_Evaluator_stylecop	309546.97993023053 ns/iter	301269.89264335955 ns/iter	1.03
E2E_Evaluator_tmuxinator	98587.21212963779 ns/iter	98183.23684575366 ns/iter	1.00
E2E_Evaluator_ui5	530203.2539443531 ns/iter	531653.9051322362 ns/iter	1.00
E2E_Evaluator_ui5_manifest	2739556.6996046873 ns/iter	2744552.8267714586 ns/iter	1.00
E2E_Evaluator_unreal_engine_uproject	471792.78156306775 ns/iter	456695.7322011536 ns/iter	1.03
E2E_Evaluator_vercel	317114.85390202346 ns/iter	320756.2554545844 ns/iter	0.99
E2E_Evaluator_yamllint	10998.308120634467 ns/iter	10959.165939280292 ns/iter	1.00

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 076e7a2	Previous: 9afc5f4	Ratio
E2E_Evaluator_adaptivecard	111065 ns	111535 ns	1.00
E2E_Evaluator_ansible-meta	957202 ns	963524 ns	0.99
E2E_Evaluator_aws-cdk	213534 ns	213355 ns	1.00
E2E_Evaluator_babelrc	411847 ns	396861 ns	1.04
E2E_Evaluator_cerebrum-criminal-case	4309199 ns	4312680 ns	1.00
E2E_Evaluator_clang-format	154733 ns	152338 ns	1.02
E2E_Evaluator_cmake-presets	16240027 ns	16452803 ns	0.99
E2E_Evaluator_code-climate	827972 ns	820968 ns	1.01
E2E_Evaluator_cql2	1073597 ns	1050701 ns	1.02
E2E_Evaluator_cspell	1751369 ns	1730341 ns	1.01
E2E_Evaluator_cypress	518475 ns	524677 ns	0.99
E2E_Evaluator_deno	1031435 ns	998620 ns	1.03
E2E_Evaluator_dependabot	1537749 ns	1510129 ns	1.02
E2E_Evaluator_draft-04	19828417 ns	20049059 ns	0.99
E2E_Evaluator_fabric-mod	3096441 ns	3005187 ns	1.03
E2E_Evaluator_geojson	52344995 ns	53359058 ns	0.98
E2E_Evaluator_gitpod-configuration	887965 ns	929177 ns	0.96
E2E_Evaluator_helm-chart-lock	1428347 ns	1424509 ns	1.00
E2E_Evaluator_importmap	396376 ns	412376 ns	0.96
E2E_Evaluator_jasmine	474292 ns	470598 ns	1.01
E2E_Evaluator_jsconfig	1358973 ns	1384035 ns	0.98
E2E_Evaluator_jshintrc	1874131 ns	1886340 ns	0.99
E2E_Evaluator_krakend	689124 ns	682778 ns	1.01
E2E_Evaluator_lazygit	500196 ns	468254 ns	1.07
E2E_Evaluator_lerna	529818 ns	529021 ns	1.00
E2E_Evaluator_nest-cli	835361 ns	823005 ns	1.02
E2E_Evaluator_omc	83819 ns	85374 ns	0.98
E2E_Evaluator_omnisharp	1175927 ns	1152136 ns	1.02
E2E_Evaluator_openapi	39360033 ns	42420103 ns	0.93
E2E_Evaluator_pre-commit-hooks	1502685 ns	1512879 ns	0.99
E2E_Evaluator_pulumi	2621038 ns	2621380 ns	1.00
E2E_Evaluator_semantic-release	485566 ns	484250 ns	1.00
E2E_Evaluator_stale	574939 ns	561265 ns	1.02
E2E_Evaluator_stylecop	998011 ns	1000789 ns	1.00
E2E_Evaluator_tmuxinator	376486 ns	382789 ns	0.98
E2E_Evaluator_ui5	2186398 ns	2216221 ns	0.99
E2E_Evaluator_ui5-manifest	10037524 ns	10263531 ns	0.98
E2E_Evaluator_unreal-engine-uproject	1619897 ns	1649674 ns	0.98
E2E_Evaluator_vercel	1103666 ns	1110750 ns	0.99
E2E_Evaluator_yamllint	71013 ns	71020 ns	1.00

This comment was automatically generated by workflow using github-action-benchmark.