Skip to content

[refactor](type) Use DataType to replace TypeDescriptor #50290

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

[refactor](type) Use DataType to replace TypeDescriptor #50290

wants to merge 4 commits into from

Conversation

Gabriel39
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Apr 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39 Gabriel39 changed the title [refactor](type) Use DataType to replace TypeDescriptor [refactor](type) Use DataType to replace TypeDescriptor (PART I) Apr 22, 2025
@Gabriel39
Copy link
Contributor Author

run buildall

2 similar comments
@Gabriel39
Copy link
Contributor Author

run buildall

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34079 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5a953c8a912986ba6ad4e15101d35c175444bb51, data reload: false

------ Round 1 ----------------------------------
q1	26211	5067	5036	5036
q2	2073	279	181	181
q3	10635	1264	718	718
q4	10245	1003	534	534
q5	7859	2383	2564	2383
q6	190	161	130	130
q7	926	771	624	624
q8	9308	1293	1090	1090
q9	6815	5099	5154	5099
q10	6829	2311	1902	1902
q11	483	287	281	281
q12	351	351	218	218
q13	17799	3740	3104	3104
q14	239	229	208	208
q15	552	478	488	478
q16	458	444	405	405
q17	600	872	369	369
q18	7566	7353	7139	7139
q19	1415	956	563	563
q20	340	340	228	228
q21	4193	3451	2416	2416
q22	1077	1004	973	973
Total cold run time: 116164 ms
Total hot run time: 34079 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5152	5097	5081	5081
q2	235	330	239	239
q3	2182	2692	2291	2291
q4	1412	1829	1498	1498
q5	4446	4505	4372	4372
q6	210	173	137	137
q7	2006	1937	1737	1737
q8	2601	2481	2559	2481
q9	7221	7189	7026	7026
q10	2993	3220	2791	2791
q11	578	520	475	475
q12	664	776	619	619
q13	3603	3988	3356	3356
q14	293	309	296	296
q15	551	488	473	473
q16	471	505	471	471
q17	1196	1566	1374	1374
q18	7757	7665	7474	7474
q19	831	900	854	854
q20	2003	2069	1813	1813
q21	5287	4823	4845	4823
q22	1128	1051	1030	1030
Total cold run time: 52820 ms
Total hot run time: 50711 ms

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34148 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 614c44bc54f72baf092ea468a2c3aab270d79991, data reload: false

------ Round 1 ----------------------------------
q1	26350	5157	4975	4975
q2	2076	277	192	192
q3	10382	1261	683	683
q4	10219	1020	549	549
q5	7572	2390	2402	2390
q6	187	163	135	135
q7	916	746	606	606
q8	9339	1292	1110	1110
q9	6824	5149	5134	5134
q10	6874	2305	1911	1911
q11	476	282	271	271
q12	362	360	215	215
q13	17776	3732	3079	3079
q14	237	227	216	216
q15	529	494	487	487
q16	448	454	399	399
q17	612	866	360	360
q18	7556	7297	7197	7197
q19	1792	955	569	569
q20	340	333	228	228
q21	4146	3388	2457	2457
q22	1036	1015	985	985
Total cold run time: 116049 ms
Total hot run time: 34148 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5220	5058	5014	5014
q2	236	331	229	229
q3	2196	2644	2305	2305
q4	1458	1829	1506	1506
q5	4445	4374	4341	4341
q6	219	174	134	134
q7	1994	1922	1756	1756
q8	2597	2614	2576	2576
q9	7284	7131	7118	7118
q10	3020	3207	2748	2748
q11	573	519	505	505
q12	677	759	631	631
q13	3437	3857	3363	3363
q14	290	293	262	262
q15	526	468	462	462
q16	463	496	466	466
q17	1169	1507	1404	1404
q18	7698	7734	7395	7395
q19	829	805	849	805
q20	1949	1985	1882	1882
q21	5133	4804	4708	4708
q22	1073	1092	1024	1024
Total cold run time: 52486 ms
Total hot run time: 50634 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191412 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 614c44bc54f72baf092ea468a2c3aab270d79991, data reload: false

query1	1406	1085	1082	1082
query2	6028	1766	1784	1766
query3	10997	4627	4498	4498
query4	25846	23949	23130	23130
query5	5235	615	441	441
query6	317	211	217	211
query7	4005	486	283	283
query8	310	259	237	237
query9	8515	2587	2577	2577
query10	541	347	269	269
query11	15279	15123	14927	14927
query12	156	112	109	109
query13	1572	521	399	399
query14	9528	6155	6114	6114
query15	212	196	176	176
query16	7608	640	481	481
query17	1314	795	588	588
query18	2057	419	309	309
query19	195	186	159	159
query20	125	126	126	126
query21	239	129	118	118
query22	4511	4469	4492	4469
query23	34418	33723	33469	33469
query24	8374	2453	2373	2373
query25	519	464	410	410
query26	823	284	153	153
query27	2732	504	335	335
query28	5273	2194	2154	2154
query29	633	578	425	425
query30	264	228	191	191
query31	925	872	798	798
query32	72	68	65	65
query33	525	386	293	293
query34	800	908	520	520
query35	785	821	753	753
query36	934	995	882	882
query37	113	98	78	78
query38	4232	4313	4103	4103
query39	1479	1449	1488	1449
query40	248	117	111	111
query41	55	51	53	51
query42	122	107	109	107
query43	502	509	466	466
query44	1305	809	809	809
query45	179	182	176	176
query46	858	1034	641	641
query47	1854	1866	1761	1761
query48	392	429	320	320
query49	722	527	432	432
query50	664	694	401	401
query51	4181	4239	4175	4175
query52	114	109	101	101
query53	228	268	194	194
query54	591	601	528	528
query55	82	88	84	84
query56	304	303	282	282
query57	1206	1200	1121	1121
query58	270	266	263	263
query59	2579	2651	2632	2632
query60	321	328	295	295
query61	128	141	125	125
query62	744	736	660	660
query63	225	188	185	185
query64	3296	1043	684	684
query65	4450	4339	4319	4319
query66	787	418	323	323
query67	16003	15487	15386	15386
query68	8307	880	507	507
query69	512	298	276	276
query70	1185	1049	1088	1049
query71	491	307	292	292
query72	5726	4672	4608	4608
query73	670	560	339	339
query74	8872	8860	8588	8588
query75	4007	3181	2666	2666
query76	3757	1202	753	753
query77	785	375	280	280
query78	10062	10222	9229	9229
query79	2221	871	559	559
query80	571	496	443	443
query81	493	255	227	227
query82	473	127	93	93
query83	248	244	227	227
query84	242	111	88	88
query85	827	351	317	317
query86	370	273	281	273
query87	4326	4538	4187	4187
query88	3745	2228	2157	2157
query89	395	310	281	281
query90	1928	208	209	208
query91	136	142	117	117
query92	80	58	58	58
query93	1920	939	571	571
query94	650	389	306	306
query95	366	294	283	283
query96	491	572	272	272
query97	3138	3226	3120	3120
query98	217	209	201	201
query99	1391	1367	1285	1285
Total cold run time: 279909 ms
Total hot run time: 191412 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.05 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 614c44bc54f72baf092ea468a2c3aab270d79991, data reload: false

query1	0.04	0.04	0.03
query2	0.14	0.10	0.12
query3	0.26	0.19	0.19
query4	1.60	0.19	0.20
query5	0.62	0.59	0.59
query6	1.21	0.70	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.53	0.50
query10	0.58	0.58	0.55
query11	0.15	0.10	0.10
query12	0.15	0.11	0.12
query13	0.61	0.61	0.60
query14	1.15	1.17	1.16
query15	0.87	0.88	0.86
query16	0.40	0.39	0.39
query17	1.06	1.05	1.00
query18	0.21	0.20	0.20
query19	1.93	1.81	1.82
query20	0.02	0.01	0.01
query21	15.40	0.91	0.53
query22	0.76	1.19	0.63
query23	14.94	1.33	0.64
query24	7.54	1.03	0.44
query25	0.46	0.23	0.06
query26	0.64	0.17	0.14
query27	0.05	0.04	0.04
query28	8.97	0.86	0.43
query29	12.55	3.91	3.27
query30	0.26	0.09	0.07
query31	2.83	0.59	0.37
query32	3.22	0.54	0.46
query33	3.08	3.08	3.05
query34	15.83	5.09	4.48
query35	4.49	4.50	4.49
query36	0.68	0.49	0.48
query37	0.09	0.07	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 103.85 s
Total hot run time: 29.05 s

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34674 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c0315c6e69f3773896d1166e583ba29a5648a7e3, data reload: false

------ Round 1 ----------------------------------
q1	26134	5261	5034	5034
q2	2091	289	180	180
q3	10388	1277	723	723
q4	10228	1004	530	530
q5	7546	2437	2330	2330
q6	188	164	131	131
q7	928	754	626	626
q8	9309	1250	1086	1086
q9	6729	4973	5140	4973
q10	6818	2277	1896	1896
q11	493	286	279	279
q12	361	356	223	223
q13	17752	3711	3145	3145
q14	225	233	224	224
q15	532	487	494	487
q16	460	449	404	404
q17	597	873	372	372
q18	7640	7232	7075	7075
q19	1417	944	583	583
q20	340	343	221	221
q21	4286	3364	3176	3176
q22	1049	1020	976	976
Total cold run time: 115511 ms
Total hot run time: 34674 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5324	5029	5067	5029
q2	253	328	229	229
q3	2292	2693	2327	2327
q4	1426	1870	1489	1489
q5	4551	4451	4348	4348
q6	233	164	124	124
q7	1990	1913	1724	1724
q8	2565	2509	2457	2457
q9	6999	7200	7125	7125
q10	2991	3254	2757	2757
q11	550	507	514	507
q12	705	749	578	578
q13	3507	3907	3332	3332
q14	279	315	288	288
q15	529	504	477	477
q16	467	527	480	480
q17	1139	1538	1442	1442
q18	7687	7455	7387	7387
q19	792	797	881	797
q20	1970	2083	1872	1872
q21	5294	4634	4614	4614
q22	1046	1047	1008	1008
Total cold run time: 52589 ms
Total hot run time: 50391 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186451 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c0315c6e69f3773896d1166e583ba29a5648a7e3, data reload: false

query1	1028	471	507	471
query2	6568	1835	1875	1835
query3	6765	234	236	234
query4	26493	23690	23382	23382
query5	4318	603	446	446
query6	303	203	183	183
query7	4616	496	282	282
query8	280	243	238	238
query9	8618	2580	2587	2580
query10	470	319	263	263
query11	15309	15050	14791	14791
query12	154	111	103	103
query13	1646	537	398	398
query14	8693	6227	6340	6227
query15	197	200	170	170
query16	7199	662	507	507
query17	1213	728	589	589
query18	1988	415	311	311
query19	195	192	170	170
query20	125	119	127	119
query21	216	131	114	114
query22	4108	4020	4126	4020
query23	33917	33207	33096	33096
query24	8515	2399	2410	2399
query25	560	476	421	421
query26	1237	274	155	155
query27	2745	503	352	352
query28	4334	2170	2116	2116
query29	779	562	441	441
query30	280	209	179	179
query31	913	864	785	785
query32	74	68	64	64
query33	556	371	314	314
query34	791	842	519	519
query35	833	815	729	729
query36	940	976	908	908
query37	112	101	80	80
query38	4089	4129	4143	4129
query39	1436	1463	1380	1380
query40	212	119	105	105
query41	56	54	53	53
query42	122	107	109	107
query43	490	504	473	473
query44	1275	802	797	797
query45	183	173	165	165
query46	834	1008	627	627
query47	1765	1778	1714	1714
query48	369	427	303	303
query49	775	500	411	411
query50	666	679	410	410
query51	4163	4149	4027	4027
query52	109	108	96	96
query53	217	255	189	189
query54	591	598	508	508
query55	84	81	82	81
query56	314	288	273	273
query57	1126	1152	1104	1104
query58	272	253	243	243
query59	2609	2677	2544	2544
query60	352	316	298	298
query61	132	134	128	128
query62	835	733	687	687
query63	238	194	201	194
query64	4452	1029	692	692
query65	4360	4243	4283	4243
query66	1146	407	306	306
query67	15704	15495	15304	15304
query68	8516	889	518	518
query69	473	327	265	265
query70	1228	1097	1122	1097
query71	465	314	290	290
query72	5579	4730	4717	4717
query73	722	604	351	351
query74	8876	9154	9133	9133
query75	3858	3214	2681	2681
query76	3644	1199	734	734
query77	789	401	284	284
query78	9995	10134	9283	9283
query79	2627	813	560	560
query80	627	524	446	446
query81	486	258	216	216
query82	452	127	100	100
query83	277	250	231	231
query84	296	99	87	87
query85	854	354	312	312
query86	396	295	263	263
query87	4405	4403	4301	4301
query88	3506	2251	2278	2251
query89	383	316	283	283
query90	1844	221	219	219
query91	140	137	111	111
query92	82	63	59	59
query93	1867	949	590	590
query94	673	418	321	321
query95	374	297	298	297
query96	478	572	284	284
query97	3149	3192	3115	3115
query98	250	218	214	214
query99	1474	1412	1256	1256
Total cold run time: 274849 ms
Total hot run time: 186451 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c0315c6e69f3773896d1166e583ba29a5648a7e3, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.12
query3	0.26	0.18	0.20
query4	1.59	0.20	0.20
query5	0.58	0.57	0.57
query6	1.17	0.72	0.71
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.51
query10	0.56	0.56	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	1.16	1.16	1.17
query15	0.87	0.86	0.86
query16	0.37	0.39	0.40
query17	1.04	1.02	1.04
query18	0.20	0.19	0.20
query19	1.90	1.75	1.84
query20	0.01	0.01	0.01
query21	15.44	0.94	0.55
query22	0.75	0.99	0.60
query23	15.20	1.41	0.60
query24	7.57	1.01	0.70
query25	0.45	0.09	0.07
query26	0.66	0.18	0.13
query27	0.04	0.05	0.06
query28	9.41	0.91	0.44
query29	12.55	4.04	3.30
query30	0.25	0.09	0.06
query31	2.82	0.61	0.39
query32	3.23	0.55	0.46
query33	3.13	3.09	3.02
query34	15.83	5.15	4.55
query35	4.55	4.55	4.53
query36	0.66	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.14	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.49 s
Total hot run time: 29.37 s

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34120 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 12b36c38e262e41f93a09b3ab1651743b6abd030, data reload: false

------ Round 1 ----------------------------------
q1	26019	5016	5084	5016
q2	2076	268	183	183
q3	10400	1228	700	700
q4	10216	978	526	526
q5	7555	2382	2331	2331
q6	183	162	131	131
q7	898	747	613	613
q8	9314	1266	1113	1113
q9	6707	5073	5063	5063
q10	6774	2289	1929	1929
q11	453	281	263	263
q12	333	353	216	216
q13	17758	3673	3099	3099
q14	244	231	206	206
q15	539	486	512	486
q16	452	455	410	410
q17	626	874	393	393
q18	7654	7216	7248	7216
q19	1207	946	556	556
q20	341	336	234	234
q21	4112	3419	2494	2494
q22	1012	1020	942	942
Total cold run time: 114873 ms
Total hot run time: 34120 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5101	5113	5024	5024
q2	228	323	230	230
q3	2143	2621	2260	2260
q4	1409	1829	1434	1434
q5	4524	4463	4462	4462
q6	219	165	123	123
q7	1935	1886	1752	1752
q8	2570	2510	2456	2456
q9	7187	7105	7144	7105
q10	2969	3174	2705	2705
q11	559	519	504	504
q12	656	766	627	627
q13	3512	3836	3335	3335
q14	271	286	283	283
q15	543	504	501	501
q16	455	488	455	455
q17	1145	1590	1339	1339
q18	7661	7438	7390	7390
q19	821	795	826	795
q20	1971	2013	1844	1844
q21	5133	4720	4709	4709
q22	1033	1017	969	969
Total cold run time: 52045 ms
Total hot run time: 50302 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185079 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 12b36c38e262e41f93a09b3ab1651743b6abd030, data reload: false

query1	1008	470	492	470
query2	6569	1863	1823	1823
query3	6745	225	224	224
query4	25932	23218	23393	23218
query5	4322	626	489	489
query6	311	209	189	189
query7	4617	488	277	277
query8	293	244	260	244
query9	8626	2554	2557	2554
query10	481	322	264	264
query11	15640	15066	14825	14825
query12	148	113	108	108
query13	1651	533	400	400
query14	8677	6151	6156	6151
query15	222	196	161	161
query16	7152	606	427	427
query17	924	735	555	555
query18	1968	393	299	299
query19	192	189	188	188
query20	119	111	113	111
query21	207	124	110	110
query22	4070	4204	4084	4084
query23	33796	32886	33097	32886
query24	8429	2362	2383	2362
query25	547	444	388	388
query26	1223	270	149	149
query27	2752	491	329	329
query28	4365	2134	2107	2107
query29	747	544	431	431
query30	279	214	191	191
query31	913	877	778	778
query32	72	65	61	61
query33	583	370	302	302
query34	788	861	509	509
query35	783	807	726	726
query36	959	992	894	894
query37	114	102	74	74
query38	4285	4241	4092	4092
query39	1457	1404	1412	1404
query40	204	116	105	105
query41	57	57	54	54
query42	120	101	107	101
query43	497	506	484	484
query44	1276	800	787	787
query45	177	167	168	167
query46	827	1006	620	620
query47	1743	1807	1757	1757
query48	385	409	305	305
query49	803	542	445	445
query50	656	669	392	392
query51	4140	4063	4018	4018
query52	112	110	104	104
query53	237	257	192	192
query54	598	586	544	544
query55	87	84	82	82
query56	305	298	296	296
query57	1140	1198	1069	1069
query58	263	256	248	248
query59	2644	2647	2630	2630
query60	322	328	299	299
query61	168	124	128	124
query62	789	731	667	667
query63	233	186	187	186
query64	4353	995	682	682
query65	4258	4207	4243	4207
query66	1152	437	308	308
query67	15708	15521	15297	15297
query68	8596	875	510	510
query69	470	322	276	276
query70	1202	1112	1080	1080
query71	452	313	289	289
query72	5659	4626	4554	4554
query73	710	554	344	344
query74	8872	9199	8655	8655
query75	4070	3235	2677	2677
query76	3635	1197	752	752
query77	788	393	291	291
query78	9909	10153	9335	9335
query79	1491	820	564	564
query80	619	529	427	427
query81	464	262	213	213
query82	424	129	97	97
query83	319	248	235	235
query84	307	114	87	87
query85	786	357	303	303
query86	333	289	282	282
query87	4389	4485	4276	4276
query88	2754	2207	2196	2196
query89	382	308	276	276
query90	1921	207	208	207
query91	140	146	113	113
query92	74	61	58	58
query93	1067	951	583	583
query94	671	433	309	309
query95	373	295	285	285
query96	488	572	276	276
query97	3154	3248	3054	3054
query98	228	205	201	201
query99	1387	1367	1250	1250
Total cold run time: 271354 ms
Total hot run time: 185079 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.87 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 12b36c38e262e41f93a09b3ab1651743b6abd030, data reload: false

query1	0.03	0.03	0.03
query2	0.14	0.11	0.10
query3	0.26	0.20	0.20
query4	1.59	0.19	0.20
query5	0.55	0.57	0.56
query6	1.20	0.71	0.72
query7	0.03	0.01	0.02
query8	0.05	0.04	0.04
query9	0.58	0.51	0.52
query10	0.57	0.57	0.56
query11	0.16	0.11	0.10
query12	0.15	0.12	0.12
query13	0.61	0.60	0.60
query14	1.19	1.15	1.18
query15	0.88	0.85	0.84
query16	0.40	0.38	0.39
query17	1.01	1.02	1.05
query18	0.21	0.20	0.20
query19	1.89	1.75	1.83
query20	0.01	0.01	0.01
query21	15.41	0.90	0.55
query22	0.77	1.27	0.67
query23	14.80	1.34	0.61
query24	7.01	1.79	1.16
query25	0.48	0.12	0.15
query26	0.71	0.16	0.13
query27	0.05	0.05	0.05
query28	9.98	0.80	0.43
query29	12.60	4.04	3.36
query30	0.25	0.09	0.07
query31	2.83	0.60	0.38
query32	3.23	0.53	0.47
query33	3.03	3.04	3.08
query34	15.75	5.05	4.48
query35	4.50	4.50	4.50
query36	0.67	0.50	0.47
query37	0.09	0.07	0.06
query38	0.06	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.09 s
Total hot run time: 29.87 s

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33809 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2e756764873b7f7c96842e06e4cbb410cfebdecd, data reload: false

------ Round 1 ----------------------------------
q1	25918	5026	5006	5006
q2	2065	279	190	190
q3	10461	1239	684	684
q4	10272	1021	557	557
q5	8364	2356	2356	2356
q6	186	160	128	128
q7	898	749	604	604
q8	9314	1304	1075	1075
q9	6929	5165	5106	5106
q10	6814	2289	1875	1875
q11	487	288	282	282
q12	346	367	216	216
q13	17772	3633	3058	3058
q14	219	230	217	217
q15	530	482	490	482
q16	433	451	396	396
q17	623	858	392	392
q18	7559	7079	7034	7034
q19	1296	932	550	550
q20	327	331	222	222
q21	4479	3408	2429	2429
q22	1050	993	950	950
Total cold run time: 116342 ms
Total hot run time: 33809 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5105	5154	5131	5131
q2	235	328	231	231
q3	2164	2616	2281	2281
q4	1402	1858	1474	1474
q5	4571	4430	4403	4403
q6	212	163	124	124
q7	1949	1900	1747	1747
q8	2546	2530	2449	2449
q9	7189	7109	7167	7109
q10	3008	3141	2703	2703
q11	575	514	491	491
q12	679	787	631	631
q13	3502	3903	3249	3249
q14	278	282	268	268
q15	510	479	474	474
q16	457	491	465	465
q17	1155	1549	1403	1403
q18	7696	7396	7315	7315
q19	785	827	958	827
q20	1971	2002	1821	1821
q21	5111	4814	4706	4706
q22	1039	1039	992	992
Total cold run time: 52139 ms
Total hot run time: 50294 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185360 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2e756764873b7f7c96842e06e4cbb410cfebdecd, data reload: false

query1	1040	471	501	471
query2	6573	1824	1839	1824
query3	6754	228	220	220
query4	26454	23247	23508	23247
query5	4366	623	472	472
query6	312	212	210	210
query7	4636	478	279	279
query8	286	238	234	234
query9	8598	2530	2541	2530
query10	450	327	260	260
query11	15144	15047	14864	14864
query12	156	109	107	107
query13	1655	511	374	374
query14	8606	5961	5991	5961
query15	203	179	162	162
query16	7139	633	447	447
query17	1215	740	561	561
query18	1971	407	298	298
query19	194	217	151	151
query20	114	112	118	112
query21	204	119	103	103
query22	4155	4261	4202	4202
query23	33854	32975	33053	32975
query24	8408	2373	2385	2373
query25	528	455	399	399
query26	1219	264	151	151
query27	2769	491	329	329
query28	4367	2102	2120	2102
query29	760	540	429	429
query30	275	210	186	186
query31	919	871	767	767
query32	76	64	63	63
query33	559	373	317	317
query34	792	875	512	512
query35	781	812	746	746
query36	935	965	884	884
query37	104	108	74	74
query38	4112	4088	4101	4088
query39	1427	1379	1384	1379
query40	208	117	104	104
query41	61	58	53	53
query42	114	102	104	102
query43	484	487	465	465
query44	1277	777	790	777
query45	173	172	162	162
query46	815	1014	607	607
query47	1746	1807	1702	1702
query48	379	407	297	297
query49	786	504	419	419
query50	637	684	386	386
query51	4096	4176	4114	4114
query52	106	103	101	101
query53	224	251	178	178
query54	591	583	526	526
query55	84	80	83	80
query56	313	291	306	291
query57	1141	1168	1084	1084
query58	273	256	266	256
query59	2598	2595	2537	2537
query60	330	342	316	316
query61	150	152	167	152
query62	769	734	643	643
query63	230	185	184	184
query64	4457	1089	666	666
query65	4299	4202	4236	4202
query66	1149	407	301	301
query67	15704	15546	15121	15121
query68	7902	892	512	512
query69	474	306	277	277
query70	1211	1088	1097	1088
query71	454	327	285	285
query72	5642	4669	4772	4669
query73	709	611	347	347
query74	8850	9031	9061	9031
query75	3763	3206	2680	2680
query76	3651	1181	728	728
query77	811	382	282	282
query78	10020	10023	9268	9268
query79	2513	823	570	570
query80	573	512	446	446
query81	496	268	221	221
query82	453	125	98	98
query83	290	247	225	225
query84	299	98	80	80
query85	778	434	308	308
query86	384	323	289	289
query87	4296	4435	4319	4319
query88	3395	2213	2240	2213
query89	388	310	288	288
query90	1847	206	207	206
query91	138	140	111	111
query92	73	58	61	58
query93	1822	946	577	577
query94	660	420	310	310
query95	368	292	284	284
query96	479	569	275	275
query97	3169	3257	3153	3153
query98	246	206	206	206
query99	1426	1411	1267	1267
Total cold run time: 272884 ms
Total hot run time: 185360 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.14 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2e756764873b7f7c96842e06e4cbb410cfebdecd, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.10
query3	0.26	0.20	0.19
query4	1.60	0.19	0.19
query5	0.61	0.58	0.60
query6	1.20	0.71	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.54	0.51
query10	0.56	0.57	0.57
query11	0.15	0.10	0.11
query12	0.14	0.11	0.12
query13	0.62	0.59	0.60
query14	1.15	1.15	1.21
query15	0.86	0.84	0.85
query16	0.37	0.38	0.38
query17	1.06	1.00	1.04
query18	0.21	0.20	0.19
query19	1.86	1.79	1.80
query20	0.01	0.02	0.01
query21	15.40	0.89	0.55
query22	0.75	1.24	0.67
query23	14.89	1.39	0.61
query24	7.02	1.79	0.48
query25	0.50	0.16	0.09
query26	0.57	0.17	0.14
query27	0.05	0.05	0.05
query28	9.62	0.84	0.46
query29	12.52	3.89	3.29
query30	0.25	0.09	0.07
query31	2.82	0.60	0.37
query32	3.23	0.55	0.48
query33	3.07	3.05	3.10
query34	15.80	5.08	4.46
query35	4.54	4.49	4.52
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.03
query40	0.18	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 103.66 s
Total hot run time: 29.14 s

@Gabriel39
Copy link
Contributor Author

run buildall

yiguolei
yiguolei reviewed Apr 24, 2025
View reviewed changes
be/src/olap/rowset/segment_v2/segment_iterator.cpp
@@ -1480,7 +1480,7 @@ bool SegmentIterator::_can_evaluated_by_vectorized(ColumnPredicate* predicate) {
if (field_type == FieldType::OLAP_FIELD_TYPE_VARIANT) {
// Use variant cast dst type
field_type = TabletColumn::get_field_type_by_type(
_opts.target_cast_type_for_variants[_schema->column(cid)->name()].type);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个@lihangyu 看看

@doris-robot
Copy link

ClickBench: Total hot run time: 29.18 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e879d5b95395015b9cfd9b4aad128c9559b10490, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.19	0.20
query4	1.59	0.20	0.18
query5	0.60	0.59	0.58
query6	1.18	0.71	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.54	0.52
query10	0.56	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	1.16	1.20	1.23
query15	0.86	0.85	0.85
query16	0.38	0.38	0.38
query17	0.99	1.03	1.02
query18	0.21	0.21	0.20
query19	1.92	1.80	1.80
query20	0.02	0.02	0.01
query21	15.39	0.89	0.55
query22	0.75	1.32	0.66
query23	14.85	1.40	0.64
query24	6.88	1.27	0.41
query25	0.51	0.13	0.11
query26	0.57	0.17	0.15
query27	0.05	0.06	0.04
query28	10.02	0.91	0.41
query29	12.54	3.93	3.26
query30	0.25	0.08	0.06
query31	2.85	0.60	0.39
query32	3.22	0.55	0.46
query33	3.06	2.98	3.06
query34	15.90	5.11	4.52
query35	4.59	4.53	4.53
query36	0.66	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 104.02 s
Total hot run time: 29.18 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 43.62% (622/1426) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.76% (14591/27139)
Line Coverage 42.56% (126498/297227)
Region Coverage 41.34% (64646/156358)
Branch Coverage 35.84% (32412/90442)

@hello-stephen
Copy link
Contributor

BE Regression P0 && UT Coverage Report

Increment line coverage 40.53% (554/1367) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage
Line Coverage
Region Coverage
Branch Coverage

@Gabriel39
Copy link
Contributor Author

run buildall

1 similar comment
@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34956 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 116694aff6f854bee42d4646c8ed8b1327b91265, data reload: false

------ Round 1 ----------------------------------
q1	26180	5156	5163	5156
q2	2081	281	188	188
q3	10518	1375	725	725
q4	10230	1067	567	567
q5	7729	2598	2543	2543
q6	206	172	136	136
q7	998	758	631	631
q8	9311	1472	1264	1264
q9	6868	5339	5301	5301
q10	6869	2323	1903	1903
q11	489	290	272	272
q12	350	390	226	226
q13	17765	3810	3096	3096
q14	232	226	207	207
q15	542	497	494	494
q16	457	456	405	405
q17	628	928	393	393
q18	7738	7185	7134	7134
q19	1488	1098	586	586
q20	349	349	233	233
q21	4502	3624	2532	2532
q22	1096	1010	964	964
Total cold run time: 116626 ms
Total hot run time: 34956 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5408	5306	5345	5306
q2	262	356	233	233
q3	2238	2736	2334	2334
q4	1623	2027	1521	1521
q5	4604	4329	4359	4329
q6	248	176	126	126
q7	2023	1929	1755	1755
q8	2876	2796	2748	2748
q9	7262	7142	7113	7113
q10	3143	3224	2800	2800
q11	622	497	483	483
q12	725	813	635	635
q13	3617	4108	3244	3244
q14	288	287	257	257
q15	529	471	478	471
q16	490	518	474	474
q17	1226	1717	1445	1445
q18	7779	7636	7529	7529
q19	868	904	1286	904
q20	1982	1951	1816	1816
q21	5275	4710	4760	4710
q22	1086	1079	960	960
Total cold run time: 54174 ms
Total hot run time: 51193 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186070 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 116694aff6f854bee42d4646c8ed8b1327b91265, data reload: false

query1	1005	482	502	482
query2	6569	1875	1908	1875
query3	6739	223	218	218
query4	26778	23829	23830	23829
query5	4929	628	470	470
query6	315	212	200	200
query7	4632	488	295	295
query8	298	241	241	241
query9	8629	2546	2569	2546
query10	511	308	260	260
query11	15396	15028	14872	14872
query12	153	110	110	110
query13	1654	553	427	427
query14	8954	6004	6130	6004
query15	202	186	177	177
query16	7537	649	509	509
query17	1184	732	583	583
query18	1983	398	294	294
query19	188	179	165	165
query20	119	119	111	111
query21	208	133	105	105
query22	4106	4219	4023	4023
query23	33912	32914	32931	32914
query24	8424	2383	2347	2347
query25	543	474	403	403
query26	1239	272	150	150
query27	2769	504	326	326
query28	4312	2103	2108	2103
query29	738	579	413	413
query30	283	212	185	185
query31	934	856	787	787
query32	76	62	62	62
query33	555	354	312	312
query34	820	849	496	496
query35	764	810	723	723
query36	947	979	880	880
query37	115	96	77	77
query38	4138	4159	4156	4156
query39	1455	1399	1406	1399
query40	211	127	108	108
query41	57	54	52	52
query42	120	109	105	105
query43	512	521	478	478
query44	1266	780	798	780
query45	182	173	164	164
query46	824	1012	610	610
query47	1759	1810	1709	1709
query48	371	402	299	299
query49	765	505	416	416
query50	641	680	421	421
query51	4112	4131	4074	4074
query52	107	104	93	93
query53	220	247	182	182
query54	570	587	498	498
query55	83	81	82	81
query56	299	286	298	286
query57	1119	1166	1077	1077
query58	261	253	250	250
query59	2666	2693	2699	2693
query60	333	318	303	303
query61	132	123	128	123
query62	787	716	668	668
query63	226	178	189	178
query64	4315	1034	666	666
query65	4361	4246	4269	4246
query66	1111	404	308	308
query67	15874	15392	15401	15392
query68	7773	873	519	519
query69	455	303	260	260
query70	1206	1105	1118	1105
query71	467	312	290	290
query72	5554	4624	4641	4624
query73	658	568	339	339
query74	8852	8793	9060	8793
query75	3856	3190	2694	2694
query76	3651	1171	739	739
query77	770	381	276	276
query78	9928	9867	9247	9247
query79	2605	798	559	559
query80	731	499	428	428
query81	500	246	222	222
query82	474	127	96	96
query83	254	257	237	237
query84	256	102	89	89
query85	797	357	316	316
query86	384	275	277	275
query87	4387	4408	4295	4295
query88	3770	2250	2209	2209
query89	378	316	278	278
query90	1901	211	212	211
query91	141	140	111	111
query92	81	61	55	55
query93	2102	944	584	584
query94	666	407	292	292
query95	378	291	285	285
query96	488	565	279	279
query97	3148	3205	3107	3107
query98	238	213	205	205
query99	1421	1390	1262	1262
Total cold run time: 275667 ms
Total hot run time: 186070 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.89 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 116694aff6f854bee42d4646c8ed8b1327b91265, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.11	0.11
query3	0.26	0.20	0.20
query4	1.62	0.20	0.20
query5	0.60	0.58	0.59
query6	1.17	0.71	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.53	0.54
query10	0.57	0.57	0.57
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	1.20	1.22	1.20
query15	0.87	0.86	0.88
query16	0.39	0.39	0.37
query17	1.04	1.02	1.01
query18	0.22	0.20	0.19
query19	1.90	1.77	1.82
query20	0.01	0.01	0.02
query21	15.44	0.92	0.57
query22	0.75	1.16	0.73
query23	14.90	1.42	0.65
query24	7.20	1.85	0.84
query25	0.50	0.22	0.07
query26	0.51	0.17	0.15
query27	0.04	0.06	0.05
query28	9.78	0.85	0.46
query29	12.54	4.02	3.33
query30	0.25	0.09	0.07
query31	2.82	0.59	0.37
query32	3.23	0.55	0.47
query33	3.04	3.03	3.04
query34	15.88	5.14	4.56
query35	4.56	4.53	4.52
query36	0.65	0.50	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.14	0.12
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.16 s
Total hot run time: 29.89 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 43.67% (624/1429) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.77% (14593/27139)
Line Coverage 42.57% (126525/297239)
Region Coverage 41.36% (64668/156368)
Branch Coverage 35.84% (32416/90446)

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34832 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 229e7ac4c9f43b4ef7757ef770a9153a106bd90f, data reload: false

------ Round 1 ----------------------------------
q1	25889	5019	5051	5019
q2	2068	292	181	181
q3	10382	1308	735	735
q4	10225	1019	540	540
q5	7526	2389	2397	2389
q6	189	171	136	136
q7	942	745	637	637
q8	9332	1341	1082	1082
q9	6807	5053	5198	5053
q10	6861	2303	1888	1888
q11	484	298	270	270
q12	361	365	223	223
q13	17789	3683	3078	3078
q14	229	222	207	207
q15	519	499	480	480
q16	452	445	409	409
q17	637	872	389	389
q18	7874	7076	7238	7076
q19	1423	973	564	564
q20	342	338	233	233
q21	4554	3563	3299	3299
q22	1059	1028	944	944
Total cold run time: 115944 ms
Total hot run time: 34832 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5152	5091	5075	5075
q2	236	335	232	232
q3	2129	2642	2286	2286
q4	1450	1824	1548	1548
q5	4628	4493	4441	4441
q6	224	173	129	129
q7	1994	1888	1726	1726
q8	2617	2538	2553	2538
q9	7275	7252	7022	7022
q10	2999	3153	2728	2728
q11	566	513	484	484
q12	685	763	617	617
q13	3434	3871	3329	3329
q14	289	278	260	260
q15	531	481	475	475
q16	469	521	459	459
q17	1165	1626	1427	1427
q18	7654	7467	7389	7389
q19	859	832	933	832
q20	1962	1993	1876	1876
q21	5247	4795	4570	4570
q22	1020	998	966	966
Total cold run time: 52585 ms
Total hot run time: 50409 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185283 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 229e7ac4c9f43b4ef7757ef770a9153a106bd90f, data reload: false

query1	1008	488	516	488
query2	6555	1846	1792	1792
query3	6748	221	218	218
query4	26077	23507	23226	23226
query5	4333	645	518	518
query6	322	195	187	187
query7	4615	511	273	273
query8	298	227	224	224
query9	8611	2598	2619	2598
query10	476	322	272	272
query11	15207	15382	14753	14753
query12	158	111	114	111
query13	1673	538	395	395
query14	9447	6156	6149	6149
query15	208	198	166	166
query16	7236	655	491	491
query17	1198	755	571	571
query18	2009	419	296	296
query19	197	195	163	163
query20	128	119	116	116
query21	216	128	106	106
query22	4096	4196	4027	4027
query23	34001	32575	32916	32575
query24	8526	2487	2388	2388
query25	537	453	383	383
query26	1234	283	159	159
query27	2727	511	323	323
query28	4329	2114	2101	2101
query29	778	584	451	451
query30	279	217	184	184
query31	932	877	734	734
query32	73	63	63	63
query33	571	376	305	305
query34	804	875	517	517
query35	798	812	745	745
query36	934	995	891	891
query37	116	101	75	75
query38	4181	4181	4070	4070
query39	1473	1426	1393	1393
query40	207	123	110	110
query41	56	55	57	55
query42	116	109	105	105
query43	496	484	459	459
query44	1332	799	787	787
query45	182	177	166	166
query46	878	1060	608	608
query47	1745	1780	1717	1717
query48	379	420	299	299
query49	786	536	413	413
query50	701	722	412	412
query51	4084	4167	4044	4044
query52	104	109	99	99
query53	223	269	200	200
query54	579	573	509	509
query55	85	83	80	80
query56	300	314	285	285
query57	1098	1160	1088	1088
query58	280	256	242	242
query59	2516	2653	2510	2510
query60	336	322	304	304
query61	144	126	128	126
query62	785	729	668	668
query63	250	192	191	191
query64	4380	1009	682	682
query65	4335	4227	4198	4198
query66	1133	420	317	317
query67	15941	15487	15352	15352
query68	8784	902	505	505
query69	458	309	264	264
query70	1276	1123	1079	1079
query71	522	314	304	304
query72	5167	4676	4671	4671
query73	683	592	349	349
query74	9105	9123	8916	8916
query75	4175	3237	2680	2680
query76	3651	1263	776	776
query77	804	393	288	288
query78	9957	10253	9295	9295
query79	1797	844	557	557
query80	628	536	434	434
query81	473	254	222	222
query82	420	125	95	95
query83	283	257	236	236
query84	294	108	81	81
query85	797	371	327	327
query86	333	320	278	278
query87	4371	4452	4375	4375
query88	2822	2198	2200	2198
query89	392	329	284	284
query90	1945	220	216	216
query91	137	148	179	148
query92	72	62	56	56
query93	1136	967	581	581
query94	674	435	303	303
query95	378	296	295	295
query96	484	628	273	273
query97	3173	3194	3139	3139
query98	240	218	207	207
query99	1424	1391	1328	1328
Total cold run time: 273415 ms
Total hot run time: 185283 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.68 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 229e7ac4c9f43b4ef7757ef770a9153a106bd90f, data reload: false

query1	0.03	0.04	0.03
query2	0.13	0.10	0.11
query3	0.26	0.19	0.19
query4	1.60	0.18	0.20
query5	0.58	0.59	0.59
query6	1.19	0.71	0.72
query7	0.03	0.01	0.01
query8	0.04	0.04	0.04
query9	0.56	0.52	0.51
query10	0.57	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.59	0.60
query14	1.20	1.21	1.17
query15	0.87	0.85	0.87
query16	0.39	0.38	0.38
query17	1.05	0.97	1.02
query18	0.21	0.20	0.20
query19	1.93	1.82	1.80
query20	0.02	0.01	0.01
query21	15.40	0.87	0.53
query22	0.76	1.22	0.69
query23	14.87	1.37	0.62
query24	7.09	1.34	0.92
query25	0.48	0.14	0.13
query26	0.62	0.16	0.15
query27	0.06	0.06	0.05
query28	9.29	0.91	0.43
query29	12.56	4.04	3.34
query30	0.24	0.09	0.07
query31	2.84	0.60	0.40
query32	3.22	0.54	0.46
query33	3.00	3.04	3.02
query34	15.94	5.06	4.52
query35	4.48	4.52	4.45
query36	0.68	0.50	0.48
query37	0.08	0.06	0.06
query38	0.06	0.05	0.03
query39	0.03	0.02	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 103.62 s
Total hot run time: 29.68 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 43.67% (624/1429) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.80% (14585/27112)
Line Coverage 42.59% (126512/297050)
Region Coverage 41.36% (64652/156297)
Branch Coverage 35.87% (32428/90392)

@hello-stephen
Copy link
Contributor

BE Regression P0 && UT Coverage Report

Increment line coverage 40.58% (556/1370) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.16% (13841/26536)
Line Coverage 41.49% (121979/294022)
Region Coverage 38.83% (70394/181309)
Branch Coverage 33.19% (33887/102086)

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33698 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8cf2fefe505e222a788b688ab64eeb505953a060, data reload: false

------ Round 1 ----------------------------------
q1	26177	5054	4986	4986
q2	2084	293	188	188
q3	10368	1228	676	676
q4	10229	1012	513	513
q5	7538	2366	2342	2342
q6	179	165	135	135
q7	893	769	608	608
q8	9310	1250	1076	1076
q9	6748	4987	5066	4987
q10	6806	2284	1875	1875
q11	475	278	269	269
q12	345	351	217	217
q13	17776	3714	3039	3039
q14	222	230	210	210
q15	541	480	490	480
q16	454	440	394	394
q17	590	849	374	374
q18	7742	7290	7163	7163
q19	1208	968	547	547
q20	339	355	230	230
q21	3893	3339	2430	2430
q22	1034	1034	959	959
Total cold run time: 114951 ms
Total hot run time: 33698 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5037	4997	5011	4997
q2	252	327	232	232
q3	2145	2649	2318	2318
q4	1398	1826	1383	1383
q5	4478	4442	4398	4398
q6	207	160	123	123
q7	1969	1906	1788	1788
q8	2528	2436	2424	2424
q9	7183	7197	7138	7138
q10	3015	3164	2736	2736
q11	597	513	480	480
q12	670	737	647	647
q13	3499	3850	3382	3382
q14	273	289	276	276
q15	510	471	473	471
q16	464	500	477	477
q17	1120	1501	1351	1351
q18	7671	7581	7399	7399
q19	761	761	787	761
q20	1991	2009	1841	1841
q21	5100	4684	4551	4551
q22	1032	1005	978	978
Total cold run time: 51900 ms
Total hot run time: 50151 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185174 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8cf2fefe505e222a788b688ab64eeb505953a060, data reload: false

query1	1025	484	505	484
query2	6570	1865	1804	1804
query3	6746	228	221	221
query4	26466	23364	23228	23228
query5	4337	621	463	463
query6	314	203	195	195
query7	4621	473	272	272
query8	281	240	233	233
query9	8592	2570	2589	2570
query10	481	336	260	260
query11	15546	15206	14824	14824
query12	151	109	102	102
query13	1653	517	407	407
query14	9063	6190	6113	6113
query15	200	187	165	165
query16	7167	607	487	487
query17	1185	707	546	546
query18	1953	395	295	295
query19	182	178	154	154
query20	119	116	116	116
query21	205	121	105	105
query22	3966	4198	4016	4016
query23	33752	32917	33016	32917
query24	8428	2409	2385	2385
query25	544	447	392	392
query26	1227	266	145	145
query27	2756	497	321	321
query28	4373	2100	2087	2087
query29	775	553	428	428
query30	278	210	185	185
query31	914	838	764	764
query32	71	66	66	66
query33	575	385	323	323
query34	784	862	503	503
query35	774	809	750	750
query36	955	972	913	913
query37	114	104	77	77
query38	4181	4137	4044	4044
query39	1470	1394	1400	1394
query40	220	126	113	113
query41	63	59	59	59
query42	122	107	105	105
query43	487	504	481	481
query44	1265	788	786	786
query45	212	172	166	166
query46	825	1015	609	609
query47	1744	1795	1705	1705
query48	371	397	303	303
query49	780	494	419	419
query50	613	693	386	386
query51	4081	4203	4055	4055
query52	101	107	94	94
query53	227	248	192	192
query54	566	561	492	492
query55	80	77	84	77
query56	292	274	288	274
query57	1155	1142	1120	1120
query58	264	245	245	245
query59	2586	2665	2570	2570
query60	307	336	303	303
query61	133	127	124	124
query62	774	719	689	689
query63	236	186	183	183
query64	4341	999	650	650
query65	4315	4255	4267	4255
query66	1173	419	316	316
query67	15738	15347	15310	15310
query68	6762	868	499	499
query69	487	306	272	272
query70	1198	1116	1130	1116
query71	402	319	282	282
query72	5612	4750	4745	4745
query73	662	611	351	351
query74	8905	8965	8699	8699
query75	3167	3196	2705	2705
query76	3189	1165	737	737
query77	483	374	290	290
query78	9851	10182	9180	9180
query79	1883	872	566	566
query80	699	523	448	448
query81	512	268	218	218
query82	401	125	152	125
query83	254	251	233	233
query84	249	113	96	96
query85	764	361	317	317
query86	402	312	305	305
query87	4422	4530	4194	4194
query88	2837	2208	2204	2204
query89	393	310	297	297
query90	1779	215	213	213
query91	141	155	176	155
query92	72	60	61	60
query93	1226	934	570	570
query94	653	417	316	316
query95	376	297	281	281
query96	484	562	279	279
query97	3089	3201	3096	3096
query98	222	204	206	204
query99	1384	1393	1286	1286
Total cold run time: 268825 ms
Total hot run time: 185174 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8cf2fefe505e222a788b688ab64eeb505953a060, data reload: false

query1	0.04	0.04	0.04
query2	0.12	0.10	0.12
query3	0.26	0.20	0.19
query4	1.59	0.20	0.11
query5	0.55	0.58	0.54
query6	1.19	0.71	0.72
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.57	0.51	0.50
query10	0.58	0.57	0.57
query11	0.16	0.10	0.11
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	1.15	1.17	1.19
query15	0.88	0.86	0.87
query16	0.41	0.37	0.37
query17	1.04	1.02	1.05
query18	0.20	0.20	0.20
query19	1.89	1.80	1.77
query20	0.02	0.01	0.01
query21	15.46	0.93	0.55
query22	0.75	1.18	0.64
query23	14.97	1.41	0.61
query24	7.13	0.89	1.68
query25	0.51	0.25	0.07
query26	0.45	0.17	0.13
query27	0.05	0.05	0.05
query28	9.75	0.92	0.44
query29	12.53	3.99	3.28
query30	0.25	0.09	0.06
query31	2.84	0.58	0.38
query32	3.23	0.55	0.47
query33	3.02	3.08	3.06
query34	15.82	5.11	4.46
query35	4.48	4.46	4.46
query36	0.66	0.51	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.88 s
Total hot run time: 29.37 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 43.51% (624/1434) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 54.14% (14678/27112)
Line Coverage 42.97% (127656/297055)
Region Coverage 41.81% (65349/156300)
Branch Coverage 36.35% (32856/90394)

@hello-stephen
Copy link
Contributor

BE Regression P0 && UT Coverage Report

Increment line coverage 40.44% (556/1375) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.13% (14670/26612)
Line Coverage 44.51% (131977/296519)
Region Coverage 41.57% (75948/182685)
Branch Coverage 35.62% (36663/102936)

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33924 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ddd2056967df30f9c2a0b14fcfd2c040e514325e, data reload: false

------ Round 1 ----------------------------------
q1	25480	5301	5034	5034
q2	2066	284	182	182
q3	10387	1227	688	688
q4	10221	991	518	518
q5	7548	2382	2286	2286
q6	184	163	132	132
q7	920	748	610	610
q8	9328	1229	1071	1071
q9	6832	5132	5154	5132
q10	6848	2309	1893	1893
q11	471	269	270	269
q12	353	354	214	214
q13	17761	3630	3057	3057
q14	238	221	222	221
q15	528	484	482	482
q16	440	451	403	403
q17	602	848	361	361
q18	7440	7124	7099	7099
q19	1481	943	564	564
q20	331	317	234	234
q21	4351	3439	2500	2500
q22	1085	1025	974	974
Total cold run time: 114895 ms
Total hot run time: 33924 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5196	5094	5054	5054
q2	260	341	235	235
q3	2249	2688	2402	2402
q4	1483	1850	1473	1473
q5	4465	4350	4393	4350
q6	215	173	129	129
q7	1969	1903	1752	1752
q8	2573	2556	2578	2556
q9	7229	7306	7079	7079
q10	2961	3155	2711	2711
q11	557	492	494	492
q12	704	757	633	633
q13	3500	3924	3278	3278
q14	297	292	259	259
q15	523	471	479	471
q16	477	511	458	458
q17	1148	1570	1355	1355
q18	7631	7539	7553	7539
q19	787	805	952	805
q20	2015	1992	1820	1820
q21	5233	4868	4794	4794
q22	1097	1075	1030	1030
Total cold run time: 52569 ms
Total hot run time: 50675 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192488 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ddd2056967df30f9c2a0b14fcfd2c040e514325e, data reload: false

query1	1412	1108	1062	1062
query2	6154	1839	1840	1839
query3	11115	4612	4584	4584
query4	55861	25376	23178	23178
query5	4998	482	465	465
query6	370	199	191	191
query7	4936	507	281	281
query8	336	256	234	234
query9	6148	2587	2570	2570
query10	422	312	258	258
query11	15002	15061	14847	14847
query12	157	109	99	99
query13	1058	533	368	368
query14	10239	6292	6600	6292
query15	196	203	180	180
query16	7112	677	527	527
query17	1091	755	589	589
query18	1612	413	323	323
query19	203	203	171	171
query20	136	171	121	121
query21	199	124	102	102
query22	4323	4463	4302	4302
query23	34448	33479	33431	33431
query24	6535	2478	2466	2466
query25	458	486	395	395
query26	684	263	148	148
query27	2327	506	341	341
query28	3046	2152	2144	2144
query29	567	566	452	452
query30	280	214	192	192
query31	860	866	780	780
query32	69	58	64	58
query33	460	362	317	317
query34	770	869	539	539
query35	816	835	777	777
query36	960	1021	894	894
query37	122	101	78	78
query38	4233	4316	4249	4249
query39	1510	1452	1426	1426
query40	210	124	108	108
query41	54	52	52	52
query42	134	123	104	104
query43	502	514	485	485
query44	1327	806	824	806
query45	180	177	168	168
query46	855	1029	645	645
query47	1846	1873	1765	1765
query48	364	408	310	310
query49	683	519	435	435
query50	651	714	420	420
query51	4193	4303	4171	4171
query52	120	109	97	97
query53	232	250	182	182
query54	588	579	505	505
query55	81	85	88	85
query56	321	300	292	292
query57	1171	1215	1127	1127
query58	261	254	255	254
query59	2651	2874	2674	2674
query60	338	328	318	318
query61	156	179	155	155
query62	717	775	692	692
query63	227	192	192	192
query64	1515	1037	698	698
query65	4424	4212	4209	4209
query66	703	396	299	299
query67	15811	15661	15262	15262
query68	7864	873	496	496
query69	546	296	274	274
query70	1172	1088	1087	1087
query71	492	322	296	296
query72	5930	4815	4970	4815
query73	1391	718	340	340
query74	9405	9134	8783	8783
query75	3708	3256	2698	2698
query76	4235	1187	768	768
query77	616	352	293	293
query78	10073	10125	9377	9377
query79	2389	798	572	572
query80	679	505	444	444
query81	496	253	214	214
query82	426	133	95	95
query83	360	248	231	231
query84	297	94	79	79
query85	792	343	323	323
query86	396	305	293	293
query87	4473	4343	4411	4343
query88	3424	2212	2197	2197
query89	412	315	276	276
query90	1978	213	217	213
query91	140	145	111	111
query92	78	63	58	58
query93	1150	950	597	597
query94	695	418	311	311
query95	377	310	289	289
query96	479	561	270	270
query97	3197	3224	3095	3095
query98	232	207	194	194
query99	1426	1424	1276	1276
Total cold run time: 300868 ms
Total hot run time: 192488 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.69 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ddd2056967df30f9c2a0b14fcfd2c040e514325e, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.26	0.19	0.19
query4	1.60	0.19	0.19
query5	0.57	0.56	0.56
query6	1.19	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.53	0.52
query10	0.58	0.59	0.56
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	1.16	1.21	1.19
query15	0.87	0.85	0.85
query16	0.39	0.37	0.39
query17	1.01	1.02	1.06
query18	0.21	0.20	0.20
query19	1.86	1.81	1.80
query20	0.01	0.02	0.01
query21	15.42	0.94	0.53
query22	0.75	1.18	0.65
query23	15.02	1.39	0.63
query24	7.42	1.19	0.77
query25	0.51	0.29	0.13
query26	0.61	0.15	0.15
query27	0.06	0.05	0.05
query28	9.30	0.88	0.46
query29	12.56	3.98	3.30
query30	0.26	0.09	0.07
query31	2.81	0.60	0.37
query32	3.22	0.54	0.48
query33	3.00	3.03	3.09
query34	15.85	5.17	4.56
query35	4.54	4.53	4.56
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.94 s
Total hot run time: 29.69 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yiguolei yiguolei yiguolei left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@Gabriel39 @Thearas @doris-robot @hello-stephen @yiguolei