Skip to content

[improve](profile) Skip _init_profile in load_v1 if enable_profile is false#61027

Closed
0AyanamiRei wants to merge 5 commits intoapache:masterfrom
0AyanamiRei:improv-load_profile_v1
Closed

[improve](profile) Skip _init_profile in load_v1 if enable_profile is false#61027
0AyanamiRei wants to merge 5 commits intoapache:masterfrom
0AyanamiRei:improv-load_profile_v1

Conversation

@0AyanamiRei
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Mar 4, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@0AyanamiRei 0AyanamiRei changed the title [improve](profile) Skip _init_profile in load if enable_profile is false [improve](profile) Skip _init_profile in load_v1 if enable_profile is false Mar 4, 2026
@0AyanamiRei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 28615 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ad03c42e3740db5927797388a6200963c1c4a528, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17675	4496	4271	4271
q2	q3	10641	785	551	551
q4	4671	369	257	257
q5	7549	1202	1013	1013
q6	175	175	146	146
q7	782	846	656	656
q8	9299	1465	1315	1315
q9	4882	4763	4489	4489
q10	6838	1884	1651	1651
q11	481	263	233	233
q12	724	574	465	465
q13	17780	4217	3422	3422
q14	232	220	215	215
q15	931	783	800	783
q16	737	726	657	657
q17	719	866	402	402
q18	5827	5380	5245	5245
q19	1119	964	610	610
q20	516	502	395	395
q21	4757	1935	1576	1576
q22	354	314	263	263
Total cold run time: 96689 ms
Total hot run time: 28615 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4603	4645	4683	4645
q2	q3	1790	2211	1774	1774
q4	864	1193	766	766
q5	4034	4327	4312	4312
q6	183	179	141	141
q7	1726	1646	1567	1567
q8	2475	2775	2549	2549
q9	7451	7356	7326	7326
q10	2609	2892	2457	2457
q11	548	423	421	421
q12	498	593	461	461
q13	4178	4369	3592	3592
q14	274	290	273	273
q15	838	790	788	788
q16	730	780	700	700
q17	1166	1554	1304	1304
q18	7196	6972	6722	6722
q19	930	963	908	908
q20	2129	2245	2070	2070
q21	4017	3439	3454	3439
q22	466	441	388	388
Total cold run time: 48705 ms
Total hot run time: 46603 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183996 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad03c42e3740db5927797388a6200963c1c4a528, data reload: false

query5	4765	631	513	513
query6	334	213	208	208
query7	4226	463	274	274
query8	339	261	230	230
query9	8716	2749	2768	2749
query10	509	370	329	329
query11	17006	17908	17329	17329
query12	186	125	126	125
query13	1247	462	342	342
query14	7026	3276	3038	3038
query14_1	2901	2888	2828	2828
query15	214	213	260	213
query16	4614	503	471	471
query17	1185	747	609	609
query18	2944	451	358	358
query19	226	221	176	176
query20	140	134	125	125
query21	215	137	112	112
query22	4771	4947	4753	4753
query23	17182	16778	16549	16549
query23_1	16826	16741	16651	16651
query24	7067	1642	1241	1241
query24_1	1229	1233	1221	1221
query25	549	462	417	417
query26	1197	258	148	148
query27	2776	485	290	290
query28	4496	1892	1898	1892
query29	741	565	470	470
query30	307	244	201	201
query31	885	731	629	629
query32	83	72	73	72
query33	520	343	273	273
query34	933	915	563	563
query35	636	678	604	604
query36	1084	1121	971	971
query37	128	95	83	83
query38	2979	2929	2886	2886
query39	887	865	868	865
query39_1	837	850	829	829
query40	233	145	137	137
query41	62	61	58	58
query42	105	104	106	104
query43	375	382	351	351
query44	
query45	200	190	187	187
query46	891	1007	635	635
query47	2113	2160	2071	2071
query48	312	334	239	239
query49	614	460	385	385
query50	695	297	223	223
query51	4078	4111	4045	4045
query52	109	114	99	99
query53	294	332	279	279
query54	299	275	257	257
query55	96	85	82	82
query56	346	306	308	306
query57	1359	1359	1275	1275
query58	287	277	292	277
query59	2671	2680	2528	2528
query60	342	330	332	330
query61	154	145	145	145
query62	611	597	533	533
query63	315	279	276	276
query64	4499	1361	1071	1071
query65	
query66	1308	464	387	387
query67	16528	16428	16280	16280
query68	
query69	415	309	301	301
query70	929	991	984	984
query71	362	311	312	311
query72	2925	2826	2552	2552
query73	539	553	318	318
query74	10002	9990	9760	9760
query75	2865	2750	2474	2474
query76	1859	1040	713	713
query77	364	394	308	308
query78	11220	11358	10712	10712
query79	2638	795	630	630
query80	1739	629	525	525
query81	571	281	248	248
query82	1030	149	119	119
query83	347	256	246	246
query84	256	113	97	97
query85	870	470	426	426
query86	418	340	284	284
query87	3105	3080	2949	2949
query88	3527	2677	2650	2650
query89	432	372	342	342
query90	2006	176	166	166
query91	166	157	142	142
query92	81	74	72	72
query93	1361	888	509	509
query94	632	324	282	282
query95	576	392	310	310
query96	638	526	232	232
query97	2453	2510	2428	2428
query98	227	223	214	214
query99	1023	981	913	913
Total cold run time: 259306 ms
Total hot run time: 183996 ms

@0AyanamiRei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 28875 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2889bc5f077c41f7f9b52be741a4e4c1a91fda89, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17706	4471	4347	4347
q2	q3	10659	772	553	553
q4	4681	360	261	261
q5	7537	1204	1015	1015
q6	176	179	145	145
q7	788	842	673	673
q8	9288	1453	1315	1315
q9	4731	4710	4717	4710
q10	6757	1865	1640	1640
q11	456	254	236	236
q12	685	556	466	466
q13	17769	4218	3395	3395
q14	236	227	207	207
q15	912	791	785	785
q16	726	720	678	678
q17	719	863	403	403
q18	5792	5286	5402	5286
q19	1246	981	592	592
q20	499	496	381	381
q21	4922	2014	1506	1506
q22	370	314	281	281
Total cold run time: 96655 ms
Total hot run time: 28875 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4609	4609	4577	4577
q2	q3	1805	2199	1743	1743
q4	857	1210	769	769
q5	4018	4384	4343	4343
q6	185	171	140	140
q7	1791	1666	1505	1505
q8	2477	2848	2552	2552
q9	7576	7261	7492	7261
q10	2637	2810	2415	2415
q11	514	434	420	420
q12	512	575	443	443
q13	3939	4394	3622	3622
q14	285	302	274	274
q15	854	817	846	817
q16	740	764	718	718
q17	1159	1562	1297	1297
q18	7068	6863	6700	6700
q19	957	886	865	865
q20	2066	2177	2009	2009
q21	3930	3476	3352	3352
q22	445	463	436	436
Total cold run time: 48424 ms
Total hot run time: 46258 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184007 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2889bc5f077c41f7f9b52be741a4e4c1a91fda89, data reload: false

query5	5803	637	519	519
query6	334	228	205	205
query7	4212	463	271	271
query8	340	233	234	233
query9	8764	2760	2761	2760
query10	579	363	337	337
query11	16888	16708	16516	16516
query12	185	129	128	128
query13	1260	463	356	356
query14	7403	3232	3014	3014
query14_1	2903	2865	2886	2865
query15	200	189	178	178
query16	976	479	382	382
query17	1226	737	596	596
query18	2690	437	338	338
query19	203	203	173	173
query20	140	128	128	128
query21	221	147	126	126
query22	5620	5776	5655	5655
query23	17578	16998	16894	16894
query23_1	16883	16917	16678	16678
query24	6904	1652	1220	1220
query24_1	1230	1219	1222	1219
query25	544	458	397	397
query26	1273	259	150	150
query27	2784	471	289	289
query28	4528	1870	1864	1864
query29	798	561	464	464
query30	304	238	212	212
query31	863	742	668	668
query32	88	69	71	69
query33	521	330	272	272
query34	924	921	571	571
query35	635	673	605	605
query36	1019	1159	968	968
query37	140	99	79	79
query38	2892	2914	2891	2891
query39	860	867	827	827
query39_1	838	832	810	810
query40	220	154	135	135
query41	61	59	56	56
query42	112	102	103	102
query43	395	385	361	361
query44	
query45	203	183	179	179
query46	877	978	608	608
query47	2099	2146	2071	2071
query48	300	321	247	247
query49	618	459	374	374
query50	688	279	220	220
query51	4099	4083	4062	4062
query52	106	114	96	96
query53	290	341	287	287
query54	305	266	293	266
query55	86	85	83	83
query56	309	310	308	308
query57	1372	1333	1250	1250
query58	283	271	271	271
query59	2640	2762	2545	2545
query60	340	332	308	308
query61	142	138	147	138
query62	612	601	532	532
query63	315	284	277	277
query64	4846	1241	973	973
query65	
query66	1349	452	352	352
query67	16397	16391	16264	16264
query68	
query69	398	306	280	280
query70	981	954	961	954
query71	347	309	307	307
query72	2819	2823	2524	2524
query73	556	573	331	331
query74	9972	9950	9732	9732
query75	2896	2756	2472	2472
query76	2270	1062	686	686
query77	373	396	329	329
query78	11236	11396	10751	10751
query79	1132	807	614	614
query80	730	650	571	571
query81	493	279	250	250
query82	1369	153	119	119
query83	379	275	257	257
query84	264	117	98	98
query85	903	486	437	437
query86	372	312	331	312
query87	3092	3117	2982	2982
query88	3567	2700	2699	2699
query89	431	369	351	351
query90	1680	178	178	178
query91	161	163	132	132
query92	79	81	73	73
query93	942	852	505	505
query94	484	330	282	282
query95	569	398	323	323
query96	664	548	232	232
query97	2539	2459	2387	2387
query98	235	221	220	220
query99	1011	996	907	907
Total cold run time: 254874 ms
Total hot run time: 184007 ms

@0AyanamiRei 0AyanamiRei closed this Mar 9, 2026
@0AyanamiRei 0AyanamiRei deleted the improv-load_profile_v1 branch March 9, 2026 02:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants