Skip to content

[Enhancement] (nereids)implement showColumnStatsCommand in nereids #45439

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

[Enhancement] (nereids)implement showColumnStatsCommand in nereids #45439

wants to merge 4 commits into from

Conversation

msridhar78
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #42717

Related PR: #xxx

Problem Summary:
[Enhancement] (nereids)implement showColumnStatsCommand in nereids

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@msridhar78
Copy link
Contributor Author

run buildall

1 similar comment
@msridhar78
Copy link
Contributor Author

run buildall

starocean999
starocean999 reviewed Dec 16, 2024
View reviewed changes
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java Outdated
return new ShowColumnStatsCommand(new TableNameInfo(tableNameParts), colNames, partitionNames, isCached);
}

private PartitionNames parsePartitionSpec(PartitionSpecContext ctx) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is a visitPartitionSpec method already, please use it instead of creating a new one. Take bellow as example:

Pair<Boolean, List<String>> partitionSpec = visitPartitionSpec(ctx.partitions);
PartitionNamesInfo partitionNames = new PartitionNamesInfo(partitionSpec.first, partitionSpec.second);

starocean999
starocean999 reviewed Dec 16, 2024
View reviewed changes
...core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowColumnStatsCommand.java Outdated

private final TableNameInfo tableName;
private final List<String> columnNames;
private final PartitionNames partitionNames;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
private final PartitionNames partitionNames;
private final PartitionNamesInfo partitionNames;

use PartitionNamesInfo instead

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done - pls review

starocean999
starocean999 reviewed Dec 16, 2024
View reviewed changes
fe/fe-core/src/main/java/org/apache/doris/analysis/PartitionNames.java Outdated
analyze();
}

public void analyze() throws AnalysisException {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use PartitionNamesInfo, PartitionNames don't need to be changed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done - please review

@msridhar78 msridhar78 force-pushed the show_column_stats branch 2 times, most recently from c52a5c5 to 9367eb9 Compare December 20, 2024 09:38
@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39896 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9367eb9f269a4b534dba988e9fcfb639429ba3ef, data reload: false

------ Round 1 ----------------------------------
q1	17611	7464	7311	7311
q2	2041	186	178	178
q3	10616	1153	1151	1151
q4	10412	765	716	716
q5	7613	2771	2704	2704
q6	245	150	151	150
q7	985	622	633	622
q8	9248	1924	1948	1924
q9	6626	6441	6458	6441
q10	7021	2327	2349	2327
q11	484	253	257	253
q12	419	226	222	222
q13	17810	2896	2934	2896
q14	241	208	229	208
q15	549	508	507	507
q16	685	594	577	577
q17	976	537	594	537
q18	7281	6718	6589	6589
q19	1378	964	918	918
q20	475	185	180	180
q21	4065	3179	3277	3179
q22	380	306	306	306
Total cold run time: 107161 ms
Total hot run time: 39896 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7240	7218	7233	7218
q2	330	231	226	226
q3	2901	2780	3019	2780
q4	2133	1902	1801	1801
q5	5566	5696	5640	5640
q6	222	141	143	141
q7	2280	1767	1808	1767
q8	3382	3578	3502	3502
q9	9076	9099	9017	9017
q10	3610	3521	3529	3521
q11	598	497	501	497
q12	819	631	585	585
q13	12932	3101	3033	3033
q14	313	263	269	263
q15	562	508	504	504
q16	697	659	680	659
q17	1876	1592	1557	1557
q18	7888	7487	7478	7478
q19	1713	1580	1551	1551
q20	2122	1792	1784	1784
q21	5447	5269	5414	5269
q22	640	609	593	593
Total cold run time: 72347 ms
Total hot run time: 59386 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189738 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9367eb9f269a4b534dba988e9fcfb639429ba3ef, data reload: false

query1	971	387	377	377
query2	6542	2312	2415	2312
query3	6710	220	210	210
query4	33977	23421	23509	23421
query5	4327	476	451	451
query6	291	183	195	183
query7	4612	312	317	312
query8	312	239	238	238
query9	9371	2724	2719	2719
query10	478	257	257	257
query11	17973	15069	15071	15069
query12	161	104	106	104
query13	1684	438	452	438
query14	11203	7694	6983	6983
query15	319	188	188	188
query16	8258	447	453	447
query17	2207	593	577	577
query18	2182	294	298	294
query19	370	158	155	155
query20	123	128	112	112
query21	213	101	104	101
query22	4373	4362	4168	4168
query23	37476	33729	33442	33442
query24	11281	2530	2462	2462
query25	562	377	385	377
query26	1200	152	151	151
query27	2773	333	324	324
query28	7804	2404	2439	2404
query29	666	405	412	405
query30	300	145	150	145
query31	1046	806	802	802
query32	101	58	65	58
query33	765	336	290	290
query34	950	523	510	510
query35	889	739	749	739
query36	1121	962	941	941
query37	216	74	79	74
query38	4276	4149	4180	4149
query39	1517	1454	1421	1421
query40	282	109	100	100
query41	47	46	43	43
query42	111	105	102	102
query43	519	485	502	485
query44	1233	802	790	790
query45	180	165	170	165
query46	1153	675	700	675
query47	1970	1827	1804	1804
query48	418	314	326	314
query49	1278	377	392	377
query50	820	391	396	391
query51	7124	6955	6990	6955
query52	103	94	93	93
query53	264	189	183	183
query54	1224	405	421	405
query55	81	78	81	78
query56	267	253	253	253
query57	1248	1112	1144	1112
query58	243	211	232	211
query59	3254	2994	2824	2824
query60	265	246	236	236
query61	106	111	144	111
query62	879	678	666	666
query63	227	200	200	200
query64	4973	672	625	625
query65	3291	3257	3219	3219
query66	1392	316	329	316
query67	15801	15623	15540	15540
query68	5884	554	553	553
query69	413	246	260	246
query70	1139	1150	1140	1140
query71	445	264	250	250
query72	6301	4093	4094	4093
query73	790	362	362	362
query74	10396	8807	8883	8807
query75	3456	2649	2671	2649
query76	3557	1079	1174	1079
query77	553	273	288	273
query78	10219	9297	9388	9297
query79	1773	600	597	597
query80	1082	435	444	435
query81	534	237	233	233
query82	938	118	126	118
query83	243	149	145	145
query84	234	71	74	71
query85	1396	313	312	312
query86	371	300	310	300
query87	4821	4342	4428	4342
query88	3711	2225	2225	2225
query89	420	286	304	286
query90	2117	189	189	189
query91	144	104	105	104
query92	64	53	53	53
query93	1500	539	544	539
query94	1102	293	304	293
query95	365	251	255	251
query96	622	279	286	279
query97	2856	2627	2711	2627
query98	225	202	198	198
query99	1571	1309	1337	1309
Total cold run time: 307595 ms
Total hot run time: 189738 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.98 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9367eb9f269a4b534dba988e9fcfb639429ba3ef, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.11	0.11
query5	0.41	0.39	0.40
query6	1.17	0.66	0.67
query7	0.02	0.02	0.02
query8	0.04	0.02	0.03
query9	0.58	0.50	0.50
query10	0.55	0.60	0.57
query11	0.15	0.12	0.11
query12	0.13	0.11	0.11
query13	0.61	0.62	0.60
query14	2.88	2.84	2.89
query15	0.92	0.83	0.83
query16	0.38	0.38	0.38
query17	1.06	1.06	1.01
query18	0.22	0.21	0.22
query19	1.99	1.78	1.97
query20	0.01	0.01	0.02
query21	15.36	0.61	0.57
query22	2.44	2.31	1.74
query23	16.84	1.00	0.96
query24	3.00	1.05	1.20
query25	0.31	0.08	0.07
query26	0.41	0.14	0.15
query27	0.06	0.04	0.05
query28	10.50	1.12	1.07
query29	12.57	3.22	3.21
query30	0.27	0.08	0.08
query31	2.83	0.41	0.39
query32	3.23	0.46	0.46
query33	3.12	3.14	3.11
query34	17.13	4.47	4.48
query35	4.56	4.55	4.53
query36	0.67	0.48	0.48
query37	0.10	0.06	0.07
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.9 s
Total hot run time: 32.98 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39693 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

------ Round 1 ----------------------------------
q1	17632	7476	7311	7311
q2	2055	178	167	167
q3	10706	1107	1213	1107
q4	10494	742	745	742
q5	7604	2702	2776	2702
q6	245	149	145	145
q7	986	616	609	609
q8	9246	1867	1980	1867
q9	6662	6468	6496	6468
q10	7058	2303	2287	2287
q11	463	265	268	265
q12	434	222	222	222
q13	17767	2911	2947	2911
q14	248	206	209	206
q15	556	502	489	489
q16	664	583	582	582
q17	1001	501	493	493
q18	7254	6736	6672	6672
q19	1348	1047	887	887
q20	478	180	183	180
q21	3987	3177	3070	3070
q22	392	323	311	311
Total cold run time: 107280 ms
Total hot run time: 39693 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7220	7237	7190	7190
q2	327	233	237	233
q3	2914	2853	2941	2853
q4	2069	1869	1765	1765
q5	5680	5703	5649	5649
q6	227	145	144	144
q7	2213	1815	1805	1805
q8	3399	3564	3490	3490
q9	8925	8980	9061	8980
q10	3603	3556	3560	3556
q11	617	502	519	502
q12	816	606	602	602
q13	12677	3185	3038	3038
q14	325	294	269	269
q15	550	505	507	505
q16	671	641	653	641
q17	1875	1669	1652	1652
q18	8399	7728	7830	7728
q19	1768	1646	1447	1447
q20	2062	1847	1959	1847
q21	5598	5509	5364	5364
q22	669	576	583	576
Total cold run time: 72604 ms
Total hot run time: 59836 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195779 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

query1	1331	996	891	891
query2	6219	2396	2351	2351
query3	10989	4662	4780	4662
query4	32939	23470	23316	23316
query5	3740	481	465	465
query6	273	232	214	214
query7	4001	308	296	296
query8	285	236	215	215
query9	9519	2690	2687	2687
query10	456	252	239	239
query11	17739	15071	15088	15071
query12	148	102	101	101
query13	1580	430	433	430
query14	9931	6689	7226	6689
query15	281	197	198	197
query16	8217	468	472	468
query17	1707	602	583	583
query18	2173	316	303	303
query19	372	155	172	155
query20	125	118	124	118
query21	220	104	107	104
query22	4855	4698	4609	4609
query23	34652	33467	33485	33467
query24	10593	2434	2472	2434
query25	609	402	392	392
query26	1247	152	150	150
query27	2350	336	336	336
query28	7515	2506	2494	2494
query29	855	427	431	427
query30	246	149	156	149
query31	1051	831	828	828
query32	117	57	58	57
query33	764	288	289	288
query34	928	525	506	506
query35	919	769	774	769
query36	1102	950	946	946
query37	139	74	71	71
query38	4186	4069	4109	4069
query39	1491	1468	1466	1466
query40	211	105	101	101
query41	45	43	51	43
query42	124	105	106	105
query43	541	537	506	506
query44	1299	841	844	841
query45	188	167	170	167
query46	1184	710	738	710
query47	2017	1942	1962	1942
query48	417	337	336	336
query49	930	393	380	380
query50	830	402	414	402
query51	7312	7144	7166	7144
query52	105	91	92	91
query53	260	185	185	185
query54	1200	432	418	418
query55	86	83	81	81
query56	274	254	237	237
query57	1269	1172	1125	1125
query58	234	222	265	222
query59	3493	3105	3129	3105
query60	289	240	239	239
query61	106	114	106	106
query62	917	711	694	694
query63	221	197	195	195
query64	4110	658	631	631
query65	3241	3184	3184	3184
query66	829	295	306	295
query67	15884	15711	15583	15583
query68	4642	560	556	556
query69	452	254	307	254
query70	1185	1140	1108	1108
query71	405	243	254	243
query72	6405	4087	4135	4087
query73	765	373	371	371
query74	10336	8929	8929	8929
query75	3425	2643	2623	2623
query76	2701	1136	1073	1073
query77	386	269	268	268
query78	10265	9333	9501	9333
query79	1421	610	608	608
query80	1034	428	421	421
query81	543	228	239	228
query82	916	114	119	114
query83	236	146	141	141
query84	231	77	75	75
query85	1443	296	335	296
query86	398	304	297	297
query87	4531	4331	4426	4331
query88	3378	2214	2190	2190
query89	414	286	291	286
query90	1945	186	184	184
query91	148	104	109	104
query92	62	54	52	52
query93	1658	551	541	541
query94	903	281	290	281
query95	352	254	249	249
query96	626	277	279	277
query97	2871	2727	2659	2659
query98	216	199	197	197
query99	1606	1322	1327	1322
Total cold run time: 299379 ms
Total hot run time: 195779 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.17 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.43	0.43	0.41
query6	1.15	0.65	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.59	0.51	0.50
query10	0.56	0.57	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.10
query13	0.61	0.59	0.61
query14	2.82	2.73	2.69
query15	0.90	0.82	0.82
query16	0.38	0.37	0.39
query17	1.07	1.07	0.99
query18	0.23	0.20	0.20
query19	1.98	1.89	1.99
query20	0.02	0.01	0.01
query21	15.36	0.61	0.59
query22	2.60	1.88	2.38
query23	16.95	1.08	0.86
query24	2.99	1.70	1.49
query25	0.32	0.16	0.07
query26	0.57	0.15	0.13
query27	0.04	0.05	0.04
query28	9.69	1.11	1.07
query29	12.62	3.22	3.21
query30	0.25	0.07	0.07
query31	2.85	0.39	0.37
query32	3.25	0.47	0.46
query33	3.04	3.11	3.08
query34	17.00	4.45	4.46
query35	4.53	4.44	4.45
query36	0.68	0.49	0.50
query37	0.10	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.03
query40	0.17	0.12	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.04
Total cold run time: 106.31 s
Total hot run time: 33.17 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39966 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

------ Round 1 ----------------------------------
q1	17640	7456	7240	7240
q2	2043	175	173	173
q3	10644	1082	1155	1082
q4	10561	756	741	741
q5	7605	2647	2683	2647
q6	241	148	146	146
q7	984	614	604	604
q8	9476	1839	1859	1839
q9	6654	6409	6336	6336
q10	6993	2253	2301	2253
q11	469	277	273	273
q12	428	224	217	217
q13	17774	2961	2875	2875
q14	233	211	214	211
q15	567	515	509	509
q16	653	588	586	586
q17	973	517	580	517
q18	7311	6977	6985	6977
q19	1348	996	977	977
q20	459	189	184	184
q21	4015	3269	3301	3269
q22	383	316	310	310
Total cold run time: 107454 ms
Total hot run time: 39966 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7205	7189	7153	7153
q2	324	240	228	228
q3	2872	2795	2919	2795
q4	2016	1860	1766	1766
q5	5639	5620	5656	5620
q6	223	141	148	141
q7	2221	1811	1856	1811
q8	3360	3514	3497	3497
q9	8913	8983	8928	8928
q10	3597	3509	3522	3509
q11	599	515	511	511
q12	811	590	614	590
q13	13324	3169	3185	3169
q14	316	287	278	278
q15	550	511	509	509
q16	703	645	634	634
q17	1817	1639	1611	1611
q18	8199	7901	7688	7688
q19	1707	1540	1361	1361
q20	2139	1916	1927	1916
q21	5493	5330	5447	5330
q22	654	582	591	582
Total cold run time: 72682 ms
Total hot run time: 59627 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197126 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

query1	1298	947	907	907
query2	6244	2356	2414	2356
query3	10971	4571	4673	4571
query4	33485	23384	23330	23330
query5	4979	457	465	457
query6	291	208	187	187
query7	4009	313	307	307
query8	287	226	220	220
query9	9298	2727	2734	2727
query10	496	232	245	232
query11	17804	15202	15045	15045
query12	154	102	105	102
query13	1555	414	412	412
query14	9670	7555	7761	7555
query15	300	213	202	202
query16	8178	463	467	463
query17	1772	625	610	610
query18	2201	324	337	324
query19	368	170	158	158
query20	125	129	121	121
query21	211	110	108	108
query22	4938	4341	4423	4341
query23	35083	33797	34002	33797
query24	10559	2529	2491	2491
query25	630	388	391	388
query26	1193	156	164	156
query27	2554	341	347	341
query28	7870	2520	2502	2502
query29	885	416	419	416
query30	233	158	158	158
query31	1007	828	859	828
query32	100	56	56	56
query33	743	300	296	296
query34	939	536	536	536
query35	863	772	750	750
query36	1120	968	979	968
query37	140	71	77	71
query38	4212	4093	4134	4093
query39	1517	1455	1468	1455
query40	207	109	103	103
query41	45	41	45	41
query42	118	108	105	105
query43	527	504	522	504
query44	1293	845	820	820
query45	188	172	173	172
query46	1174	748	752	748
query47	2116	1924	1928	1924
query48	432	338	322	322
query49	952	403	391	391
query50	828	408	407	407
query51	7301	7181	7292	7181
query52	109	91	98	91
query53	264	194	197	194
query54	1107	420	415	415
query55	82	77	81	77
query56	263	256	247	247
query57	1295	1173	1150	1150
query58	265	225	231	225
query59	3514	3156	3189	3156
query60	270	243	251	243
query61	120	109	107	107
query62	857	685	704	685
query63	222	189	196	189
query64	3895	707	646	646
query65	3262	3253	3276	3253
query66	704	311	320	311
query67	16405	15539	15615	15539
query68	6488	560	555	555
query69	496	254	248	248
query70	1218	1130	1148	1130
query71	538	273	249	249
query72	6545	4050	4106	4050
query73	803	363	380	363
query74	9935	8839	9033	8839
query75	4550	2664	2662	2662
query76	4327	1091	1112	1091
query77	796	281	271	271
query78	10295	9418	9428	9418
query79	1975	611	612	611
query80	850	426	430	426
query81	509	225	226	225
query82	712	120	123	120
query83	178	143	147	143
query84	253	72	70	70
query85	1256	301	296	296
query86	395	308	274	274
query87	4522	4425	4551	4425
query88	3696	2250	2237	2237
query89	428	301	286	286
query90	1955	189	188	188
query91	134	140	105	105
query92	61	52	53	52
query93	1982	553	556	553
query94	699	299	289	289
query95	352	250	248	248
query96	610	285	277	277
query97	2832	2700	2652	2652
query98	214	202	198	198
query99	1634	1292	1323	1292
Total cold run time: 307335 ms
Total hot run time: 197126 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.12 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c3e07ca121250fe71eed1b6dfc4fbedf8ed71352, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.42	0.42	0.41
query6	1.15	0.66	0.65
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.49	0.54
query10	0.57	0.59	0.55
query11	0.15	0.10	0.10
query12	0.13	0.11	0.10
query13	0.61	0.61	0.60
query14	2.84	2.81	2.71
query15	0.88	0.82	0.84
query16	0.39	0.39	0.38
query17	1.05	0.96	1.04
query18	0.22	0.21	0.21
query19	1.91	1.84	2.04
query20	0.02	0.01	0.01
query21	15.36	0.58	0.59
query22	2.41	2.47	1.64
query23	17.03	0.92	0.78
query24	2.68	0.71	1.95
query25	0.26	0.17	0.10
query26	0.46	0.13	0.13
query27	0.05	0.04	0.04
query28	10.40	1.10	1.07
query29	12.57	3.30	3.26
query30	0.25	0.07	0.06
query31	2.85	0.39	0.39
query32	3.23	0.47	0.46
query33	3.06	3.11	3.12
query34	16.83	4.47	4.45
query35	4.45	4.45	4.44
query36	0.70	0.48	0.50
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.02 s
Total hot run time: 32.12 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32508 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 855f1c2397fdde32741126821a6e0243b9f9327d, data reload: false

------ Round 1 ----------------------------------
q1	17606	6109	6029	6029
q2	2036	291	162	162
q3	10455	1214	732	732
q4	10201	861	428	428
q5	7525	2171	1977	1977
q6	205	175	144	144
q7	882	748	596	596
q8	9227	1358	1161	1161
q9	5090	4988	4891	4891
q10	6754	2294	1872	1872
q11	478	281	251	251
q12	346	370	227	227
q13	17758	3609	2959	2959
q14	235	230	216	216
q15	556	507	489	489
q16	643	629	578	578
q17	569	851	323	323
q18	6901	6547	6447	6447
q19	2919	1004	563	563
q20	311	328	195	195
q21	2834	2171	1955	1955
q22	369	330	313	313
Total cold run time: 103900 ms
Total hot run time: 32508 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6341	6299	6339	6299
q2	232	336	226	226
q3	2294	2700	2339	2339
q4	1385	1825	1371	1371
q5	4356	4766	4881	4766
q6	194	184	149	149
q7	2072	1996	1833	1833
q8	2673	2808	2730	2730
q9	7328	7278	7245	7245
q10	3113	3381	2964	2964
q11	573	532	514	514
q12	683	803	725	725
q13	3596	4082	3301	3301
q14	299	338	318	318
q15	573	533	524	524
q16	675	732	665	665
q17	1265	1785	1309	1309
q18	8099	7384	7426	7384
q19	1790	1099	1148	1099
q20	1969	2040	1996	1996
q21	5788	5312	5044	5044
q22	597	605	568	568
Total cold run time: 55895 ms
Total hot run time: 53369 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196811 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 855f1c2397fdde32741126821a6e0243b9f9327d, data reload: false

query1	1311	986	907	907
query2	6497	2395	2270	2270
query3	10984	4831	4694	4694
query4	33254	23748	23359	23359
query5	4304	613	466	466
query6	294	191	188	188
query7	3989	480	306	306
query8	303	251	256	251
query9	9513	2718	2724	2718
query10	482	305	241	241
query11	17769	15384	15209	15209
query12	160	105	100	100
query13	1571	523	393	393
query14	10247	7638	7463	7463
query15	241	203	191	191
query16	8157	585	450	450
query17	1542	746	590	590
query18	2119	418	317	317
query19	205	185	158	158
query20	118	119	112	112
query21	217	123	112	112
query22	4654	4582	4338	4338
query23	34532	33899	33587	33587
query24	6519	2335	2279	2279
query25	471	461	411	411
query26	819	271	153	153
query27	2031	467	332	332
query28	5862	2484	2443	2443
query29	620	558	422	422
query30	207	184	149	149
query31	965	913	842	842
query32	72	59	54	54
query33	466	378	308	308
query34	780	878	513	513
query35	808	826	794	794
query36	1026	1090	974	974
query37	115	105	75	75
query38	4158	4220	4257	4220
query39	1517	1490	1458	1458
query40	205	120	104	104
query41	46	44	44	44
query42	116	102	98	98
query43	504	532	493	493
query44	1347	826	818	818
query45	189	179	175	175
query46	894	1073	672	672
query47	1994	2024	1951	1951
query48	406	440	323	323
query49	722	480	396	396
query50	620	685	393	393
query51	7294	7372	7350	7350
query52	102	102	92	92
query53	230	252	182	182
query54	482	496	429	429
query55	87	82	79	79
query56	296	271	255	255
query57	1240	1231	1164	1164
query58	234	223	224	223
query59	3162	3281	3088	3088
query60	273	258	257	257
query61	106	111	109	109
query62	866	823	760	760
query63	219	189	188	188
query64	3176	1055	658	658
query65	3326	3366	3237	3237
query66	777	413	305	305
query67	16464	16040	15557	15557
query68	7834	760	512	512
query69	491	315	263	263
query70	1198	1146	1154	1146
query71	448	294	261	261
query72	6084	3868	3876	3868
query73	650	759	369	369
query74	9809	9173	8865	8865
query75	4024	3159	2646	2646
query76	3558	1194	786	786
query77	761	371	272	272
query78	10153	10154	9403	9403
query79	5011	895	581	581
query80	750	512	528	512
query81	507	278	232	232
query82	643	146	116	116
query83	190	156	145	145
query84	275	90	81	81
query85	783	365	299	299
query86	381	310	318	310
query87	4638	4426	4440	4426
query88	4706	2189	2194	2189
query89	451	331	292	292
query90	1973	181	181	181
query91	129	135	114	114
query92	66	53	51	51
query93	3378	889	515	515
query94	647	396	278	278
query95	331	266	244	244
query96	481	613	285	285
query97	2740	2802	2696	2696
query98	222	204	193	193
query99	1685	1552	1433	1433
Total cold run time: 299273 ms
Total hot run time: 196811 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.28 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 855f1c2397fdde32741126821a6e0243b9f9327d, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.42	0.41	0.41
query6	1.14	0.65	0.64
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.51	0.50
query10	0.55	0.57	0.55
query11	0.15	0.10	0.10
query12	0.13	0.11	0.12
query13	0.61	0.60	0.59
query14	2.71	2.76	2.90
query15	0.88	0.81	0.82
query16	0.38	0.38	0.38
query17	1.00	1.02	1.04
query18	0.23	0.21	0.20
query19	1.86	1.82	2.04
query20	0.01	0.02	0.01
query21	15.37	0.96	0.59
query22	0.75	0.80	0.65
query23	15.32	1.41	0.56
query24	3.02	0.99	1.37
query25	0.15	0.15	0.14
query26	0.33	0.14	0.14
query27	0.06	0.06	0.04
query28	13.89	1.52	1.05
query29	12.55	4.04	3.31
query30	0.24	0.08	0.06
query31	2.84	0.59	0.39
query32	3.24	0.55	0.46
query33	3.16	3.02	3.06
query34	16.69	5.09	4.45
query35	4.50	4.48	4.46
query36	0.64	0.49	0.47
query37	0.10	0.06	0.05
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.91 s
Total hot run time: 31.28 s

@msridhar78
Copy link
Contributor Author

run buildall

@msridhar78
Copy link
Contributor Author

run buildall

@msridhar78
Copy link
Contributor Author

run buildall

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34041 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fd151f8d2d9439fbf0ccf4eeacde2e2d2fb9dac9, data reload: false

------ Round 1 ----------------------------------
q1	25523	5330	5011	5011
q2	2084	284	163	163
q3	10416	1247	672	672
q4	10230	1003	541	541
q5	7499	2420	2331	2331
q6	197	163	133	133
q7	917	742	618	618
q8	9321	1297	1144	1144
q9	6773	5070	5115	5070
q10	6807	2269	1886	1886
q11	481	269	256	256
q12	360	353	223	223
q13	17775	3699	3069	3069
q14	224	228	227	227
q15	538	485	471	471
q16	614	611	572	572
q17	596	849	348	348
q18	7534	7082	7119	7082
q19	1222	947	604	604
q20	329	343	199	199
q21	3953	3396	2458	2458
q22	1038	1045	963	963
Total cold run time: 114431 ms
Total hot run time: 34041 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5184	5105	5144	5105
q2	233	323	229	229
q3	2141	2627	2263	2263
q4	1430	1797	1415	1415
q5	4467	4406	4383	4383
q6	215	180	132	132
q7	2003	1970	1765	1765
q8	2615	2544	2521	2521
q9	7319	7183	6939	6939
q10	3037	3169	2737	2737
q11	586	496	490	490
q12	690	767	615	615
q13	3496	3913	3269	3269
q14	300	305	271	271
q15	538	504	508	504
q16	636	690	652	652
q17	1150	1531	1377	1377
q18	7757	7550	7475	7475
q19	838	857	911	857
q20	1998	1973	1834	1834
q21	5400	4929	4844	4844
q22	1132	1045	1010	1010
Total cold run time: 53165 ms
Total hot run time: 50687 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192416 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fd151f8d2d9439fbf0ccf4eeacde2e2d2fb9dac9, data reload: false

query1	1370	1040	1067	1040
query2	6055	1884	1877	1877
query3	11158	4631	4566	4566
query4	52134	24606	23370	23370
query5	5130	613	459	459
query6	330	182	178	178
query7	4886	480	266	266
query8	291	256	219	219
query9	5289	2584	2583	2583
query10	458	326	254	254
query11	15402	15143	14864	14864
query12	166	112	105	105
query13	1025	519	421	421
query14	10234	6401	6314	6314
query15	210	194	184	184
query16	7206	661	511	511
query17	1083	750	601	601
query18	1575	415	328	328
query19	200	193	178	178
query20	121	122	121	121
query21	214	130	110	110
query22	4405	4549	4283	4283
query23	33727	33495	33348	33348
query24	6634	2428	2400	2400
query25	496	455	432	432
query26	716	272	144	144
query27	2455	497	330	330
query28	3153	2435	2429	2429
query29	618	568	448	448
query30	271	215	201	201
query31	889	877	779	779
query32	76	65	60	60
query33	473	358	302	302
query34	747	855	493	493
query35	810	858	747	747
query36	967	1058	910	910
query37	125	99	77	77
query38	4170	4188	4172	4172
query39	1506	1412	1412	1412
query40	212	122	108	108
query41	66	56	59	56
query42	127	109	100	100
query43	493	504	487	487
query44	1321	812	805	805
query45	182	177	165	165
query46	845	1033	652	652
query47	1815	1887	1793	1793
query48	397	419	319	319
query49	676	519	450	450
query50	712	760	420	420
query51	4246	4341	4232	4232
query52	120	114	100	100
query53	218	263	178	178
query54	491	498	463	463
query55	84	86	82	82
query56	273	274	262	262
query57	1182	1231	1134	1134
query58	263	249	244	244
query59	2634	2915	2559	2559
query60	302	282	284	282
query61	148	128	128	128
query62	722	741	651	651
query63	227	178	184	178
query64	2037	1075	707	707
query65	4394	4336	4311	4311
query66	775	397	305	305
query67	15935	15702	15301	15301
query68	7173	876	514	514
query69	533	304	263	263
query70	1210	1081	1069	1069
query71	483	303	282	282
query72	5892	4752	4761	4752
query73	1462	623	351	351
query74	8977	9096	8730	8730
query75	4037	3229	2751	2751
query76	4220	1204	779	779
query77	744	368	279	279
query78	10068	10017	9259	9259
query79	4174	800	551	551
query80	675	560	442	442
query81	488	254	218	218
query82	495	127	98	98
query83	229	174	162	162
query84	286	94	87	87
query85	790	354	319	319
query86	361	300	282	282
query87	4549	4396	4525	4396
query88	3469	2215	2212	2212
query89	449	314	273	273
query90	1976	205	210	205
query91	145	167	114	114
query92	74	59	53	53
query93	2562	1023	582	582
query94	663	415	314	314
query95	354	276	264	264
query96	490	566	270	270
query97	3177	3200	3090	3090
query98	239	210	202	202
query99	1415	1391	1265	1265
Total cold run time: 299531 ms
Total hot run time: 192416 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.59 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fd151f8d2d9439fbf0ccf4eeacde2e2d2fb9dac9, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.24	0.20	0.20
query4	1.60	0.18	0.20
query5	0.59	0.57	0.58
query6	1.20	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.51	0.51
query10	0.58	0.60	0.57
query11	0.16	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.60
query14	2.67	2.73	2.80
query15	0.92	0.85	0.84
query16	0.39	0.38	0.37
query17	1.01	1.03	1.02
query18	0.21	0.19	0.19
query19	1.91	1.96	1.80
query20	0.01	0.02	0.02
query21	15.38	0.90	0.57
query22	0.76	1.19	0.74
query23	14.85	1.39	0.62
query24	6.95	1.80	1.00
query25	0.54	0.24	0.08
query26	0.55	0.16	0.13
query27	0.06	0.05	0.05
query28	10.00	0.90	0.43
query29	12.56	4.14	3.43
query30	0.24	0.09	0.08
query31	2.80	0.61	0.39
query32	3.23	0.55	0.47
query33	3.06	3.05	3.05
query34	15.80	5.12	4.53
query35	4.51	4.53	4.51
query36	0.66	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.46 s
Total hot run time: 31.59 s

@msridhar78
Copy link
Contributor Author

run buildall

1 similar comment
@msridhar78
Copy link
Contributor Author

run buildall

@msridhar78 msridhar78 force-pushed the show_column_stats branch from 08745ac to 6b86d32 Compare May 7, 2025 17:21
@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34464 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6b86d32062c659694a4b9a4e49a45c21a933577e, data reload: false

------ Round 1 ----------------------------------
q1	25677	5492	5076	5076
q2	2062	291	183	183
q3	10392	1211	681	681
q4	10220	1014	514	514
q5	7537	2257	2330	2257
q6	186	163	135	135
q7	906	753	599	599
q8	9554	1281	1125	1125
q9	7102	5124	5102	5102
q10	6873	2308	1873	1873
q11	484	286	266	266
q12	347	360	208	208
q13	17761	3720	3123	3123
q14	230	242	204	204
q15	528	483	490	483
q16	409	424	380	380
q17	577	856	359	359
q18	7764	7117	7016	7016
q19	1333	961	583	583
q20	340	325	226	226
q21	4073	3356	3094	3094
q22	1020	1003	977	977
Total cold run time: 115375 ms
Total hot run time: 34464 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5153	5125	5098	5098
q2	237	326	230	230
q3	2120	2612	2237	2237
q4	1356	1763	1407	1407
q5	4457	4356	4395	4356
q6	222	168	128	128
q7	1982	1932	1787	1787
q8	2601	2502	2527	2502
q9	7139	7182	6990	6990
q10	2963	3185	2758	2758
q11	564	504	488	488
q12	661	760	620	620
q13	3642	3936	3334	3334
q14	313	315	292	292
q15	517	478	467	467
q16	437	496	457	457
q17	1166	1545	1429	1429
q18	7788	7463	7459	7459
q19	820	825	845	825
q20	2033	1957	1826	1826
q21	5087	4812	4706	4706
q22	1091	1040	1002	1002
Total cold run time: 52349 ms
Total hot run time: 50398 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192203 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6b86d32062c659694a4b9a4e49a45c21a933577e, data reload: false

query1	1428	1072	1075	1072
query2	6257	1806	1755	1755
query3	11020	4442	4607	4442
query4	54090	24999	22877	22877
query5	5169	528	467	467
query6	354	218	203	203
query7	4899	510	289	289
query8	338	252	251	251
query9	5887	2532	2542	2532
query10	434	323	269	269
query11	14968	15036	14852	14852
query12	160	113	109	109
query13	1058	539	404	404
query14	10037	6543	6328	6328
query15	206	200	168	168
query16	7041	700	494	494
query17	1077	729	589	589
query18	1543	403	312	312
query19	196	201	179	179
query20	127	124	131	124
query21	213	132	110	110
query22	4336	4587	4264	4264
query23	34064	33486	33447	33447
query24	6599	2427	2447	2427
query25	463	461	421	421
query26	707	277	168	168
query27	2343	504	337	337
query28	2878	2111	2100	2100
query29	599	569	439	439
query30	270	229	193	193
query31	869	856	795	795
query32	77	67	66	66
query33	459	379	301	301
query34	783	869	539	539
query35	803	827	740	740
query36	949	991	899	899
query37	114	115	79	79
query38	4147	4339	4206	4206
query39	1493	1425	1461	1425
query40	214	131	108	108
query41	56	54	52	52
query42	130	121	105	105
query43	500	518	476	476
query44	1404	820	816	816
query45	180	188	199	188
query46	881	1028	661	661
query47	1827	1841	1812	1812
query48	407	448	313	313
query49	689	527	449	449
query50	697	717	432	432
query51	4250	4241	4328	4241
query52	102	105	104	104
query53	235	258	188	188
query54	595	581	526	526
query55	89	88	79	79
query56	319	295	282	282
query57	1135	1185	1131	1131
query58	272	279	270	270
query59	2654	2772	2764	2764
query60	338	338	328	328
query61	129	128	143	128
query62	737	761	677	677
query63	243	208	194	194
query64	1867	1103	808	808
query65	4319	4238	4211	4211
query66	792	403	304	304
query67	15577	15493	15221	15221
query68	6989	896	510	510
query69	540	297	271	271
query70	1234	1092	1099	1092
query71	520	335	308	308
query72	5532	4745	4925	4745
query73	1364	632	351	351
query74	9121	9115	8971	8971
query75	3801	3210	2709	2709
query76	4321	1349	780	780
query77	627	376	283	283
query78	9977	9952	9252	9252
query79	5664	808	539	539
query80	660	510	457	457
query81	485	255	223	223
query82	653	130	96	96
query83	349	248	238	238
query84	295	110	82	82
query85	849	357	321	321
query86	397	289	282	282
query87	4356	4422	4280	4280
query88	3526	2237	2206	2206
query89	455	313	288	288
query90	1970	219	214	214
query91	136	155	111	111
query92	81	62	60	60
query93	2737	927	570	570
query94	673	398	287	287
query95	364	291	291	291
query96	505	612	275	275
query97	3206	3213	3104	3104
query98	230	205	204	204
query99	1428	1444	1263	1263
Total cold run time: 302138 ms
Total hot run time: 192203 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.56 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6b86d32062c659694a4b9a4e49a45c21a933577e, data reload: false

query1	0.03	0.04	0.02
query2	0.12	0.11	0.11
query3	0.25	0.19	0.19
query4	1.58	0.19	0.19
query5	0.59	0.58	0.58
query6	1.17	0.72	0.72
query7	0.03	0.01	0.02
query8	0.04	0.04	0.04
query9	0.57	0.52	0.51
query10	0.56	0.57	0.57
query11	0.16	0.10	0.11
query12	0.15	0.11	0.12
query13	0.63	0.59	0.60
query14	0.78	0.79	0.80
query15	0.86	0.85	0.84
query16	0.40	0.38	0.38
query17	1.01	1.03	1.03
query18	0.20	0.20	0.19
query19	1.93	1.79	1.78
query20	0.01	0.01	0.02
query21	15.43	0.92	0.55
query22	0.75	1.11	0.62
query23	15.05	1.42	0.61
query24	7.62	0.97	0.38
query25	0.47	0.23	0.06
query26	0.63	0.16	0.14
query27	0.06	0.05	0.04
query28	8.39	0.85	0.43
query29	12.57	3.91	3.22
query30	0.25	0.10	0.07
query31	2.83	0.61	0.38
query32	3.22	0.54	0.46
query33	3.03	3.07	3.16
query34	15.77	5.10	4.49
query35	4.51	4.52	4.47
query36	0.67	0.49	0.48
query37	0.09	0.07	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.14
query41	0.09	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 102.8 s
Total hot run time: 28.56 s

@msridhar78 msridhar78 force-pushed the show_column_stats branch from 6b86d32 to 6dc07ae Compare May 19, 2025 07:18
@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34014 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6dc07ae1dc8293d32b217a1bf2d9dad1bb883780, data reload: false

------ Round 1 ----------------------------------
q1	26028	5121	5062	5062
q2	2077	276	190	190
q3	10390	1258	713	713
q4	10238	1007	525	525
q5	7539	2365	2410	2365
q6	193	169	136	136
q7	911	744	599	599
q8	9343	1305	1150	1150
q9	6742	5127	5152	5127
q10	6832	2298	1919	1919
q11	482	287	272	272
q12	350	357	213	213
q13	17755	3681	3079	3079
q14	231	216	222	216
q15	527	476	479	476
q16	422	430	366	366
q17	592	877	373	373
q18	7652	7338	7108	7108
q19	1213	954	567	567
q20	357	352	224	224
q21	4020	2570	2345	2345
q22	1064	1023	989	989
Total cold run time: 114958 ms
Total hot run time: 34014 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5154	5100	5100	5100
q2	239	323	235	235
q3	2151	2708	2308	2308
q4	1384	1820	1376	1376
q5	4464	4396	4456	4396
q6	223	173	130	130
q7	2001	1937	1743	1743
q8	2601	2612	2523	2523
q9	7266	7253	6994	6994
q10	3073	3198	2754	2754
q11	589	516	487	487
q12	659	760	594	594
q13	3560	3887	3246	3246
q14	288	320	300	300
q15	564	509	491	491
q16	443	479	446	446
q17	1151	1648	1391	1391
q18	7723	7552	7468	7468
q19	866	867	950	867
q20	2028	2017	1860	1860
q21	4915	4414	4430	4414
q22	1142	1090	1015	1015
Total cold run time: 52484 ms
Total hot run time: 50138 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193793 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6dc07ae1dc8293d32b217a1bf2d9dad1bb883780, data reload: false

query1	1393	1103	1040	1040
query2	6285	1962	1928	1928
query3	11075	4622	4489	4489
query4	25881	23673	23484	23484
query5	4359	623	456	456
query6	301	221	199	199
query7	3996	521	295	295
query8	305	256	249	249
query9	8466	2651	2655	2651
query10	470	334	276	276
query11	15530	15108	14942	14942
query12	163	115	108	108
query13	1561	579	436	436
query14	9310	6182	6164	6164
query15	199	199	172	172
query16	7596	645	425	425
query17	1225	782	602	602
query18	2056	408	324	324
query19	201	195	177	177
query20	128	127	121	121
query21	206	128	112	112
query22	4601	4611	4379	4379
query23	34717	33884	33556	33556
query24	8668	2440	2440	2440
query25	526	495	411	411
query26	1232	275	157	157
query27	2974	533	346	346
query28	4543	2189	2190	2189
query29	729	574	451	451
query30	283	223	195	195
query31	914	868	788	788
query32	74	67	65	65
query33	553	385	317	317
query34	839	865	541	541
query35	779	854	749	749
query36	982	988	934	934
query37	117	100	79	79
query38	4282	4382	4263	4263
query39	1546	1443	1496	1443
query40	219	121	107	107
query41	61	56	53	53
query42	127	121	114	114
query43	533	535	487	487
query44	1355	867	888	867
query45	186	174	171	171
query46	875	1042	656	656
query47	1812	1871	1824	1824
query48	406	443	338	338
query49	749	521	462	462
query50	676	691	420	420
query51	4270	4286	4216	4216
query52	116	112	106	106
query53	245	272	190	190
query54	610	578	529	529
query55	96	91	85	85
query56	309	330	308	308
query57	1168	1198	1148	1148
query58	270	269	257	257
query59	2829	2949	2707	2707
query60	332	339	324	324
query61	150	148	151	148
query62	777	762	678	678
query63	234	190	204	190
query64	4188	1087	698	698
query65	4512	4332	4259	4259
query66	936	394	309	309
query67	15856	15660	15582	15582
query68	7862	890	536	536
query69	452	313	273	273
query70	1222	1127	1113	1113
query71	453	331	296	296
query72	5603	4832	4959	4832
query73	613	680	378	378
query74	8869	9254	8735	8735
query75	4112	3216	2660	2660
query76	3722	1185	747	747
query77	899	357	286	286
query78	10088	10216	9373	9373
query79	2001	825	597	597
query80	591	517	467	467
query81	497	251	229	229
query82	482	132	100	100
query83	249	248	247	247
query84	254	103	92	92
query85	886	360	310	310
query86	367	314	282	282
query87	4346	4510	4367	4367
query88	3835	2393	2361	2361
query89	382	320	299	299
query90	1860	208	211	208
query91	147	156	115	115
query92	81	59	60	59
query93	1549	974	589	589
query94	663	423	310	310
query95	370	294	290	290
query96	511	574	290	290
query97	2673	2768	2690	2690
query98	229	213	207	207
query99	1433	1372	1269	1269
Total cold run time: 280263 ms
Total hot run time: 193793 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.72 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6dc07ae1dc8293d32b217a1bf2d9dad1bb883780, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.11	0.11
query3	0.25	0.20	0.20
query4	1.59	0.20	0.20
query5	0.44	0.44	0.44
query6	1.54	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.52	0.52
query10	0.57	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.59	0.60
query14	0.79	0.83	0.80
query15	0.87	0.86	0.86
query16	0.40	0.39	0.38
query17	1.07	0.99	1.04
query18	0.23	0.21	0.22
query19	1.91	1.86	1.79
query20	0.02	0.02	0.01
query21	15.42	0.92	0.56
query22	0.77	1.15	0.67
query23	14.94	1.38	0.65
query24	7.73	0.62	0.36
query25	0.27	0.08	0.08
query26	0.66	0.17	0.13
query27	0.05	0.05	0.05
query28	9.64	0.97	0.46
query29	12.52	4.11	3.34
query30	0.24	0.09	0.07
query31	2.82	0.62	0.39
query32	3.23	0.57	0.47
query33	3.11	3.01	3.12
query34	15.85	5.16	4.56
query35	4.58	4.58	4.52
query36	0.66	0.49	0.48
query37	0.08	0.07	0.06
query38	0.06	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.14	0.12
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.37 s
Total hot run time: 28.72 s

@msridhar78
Copy link
Contributor Author

run buildall

@msridhar78
Copy link
Contributor Author

run buildall

1 similar comment
@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33097 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d1ed20b0cea6af232a6db92dd0dc7c608115414d, data reload: false

------ Round 1 ----------------------------------
q1	17557	5201	5039	5039
q2	1918	278	189	189
q3	10302	1267	720	720
q4	10236	1008	526	526
q5	7513	2361	2276	2276
q6	180	160	130	130
q7	908	743	590	590
q8	9299	1268	1040	1040
q9	6682	5086	5120	5086
q10	6879	2362	1984	1984
q11	464	297	269	269
q12	344	350	204	204
q13	17757	3715	3116	3116
q14	229	230	221	221
q15	564	485	481	481
q16	413	417	379	379
q17	588	848	385	385
q18	7625	7257	7094	7094
q19	1371	941	581	581
q20	334	346	223	223
q21	3832	2507	2271	2271
q22	346	314	293	293
Total cold run time: 105341 ms
Total hot run time: 33097 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5088	5087	5075	5075
q2	237	323	217	217
q3	2149	2660	2300	2300
q4	1365	1758	1321	1321
q5	4202	4107	4465	4107
q6	214	169	128	128
q7	2081	1842	1846	1842
q8	2668	2582	2516	2516
q9	7229	7207	7180	7180
q10	3114	3286	2929	2929
q11	563	503	496	496
q12	664	790	650	650
q13	3541	3952	3412	3412
q14	272	310	285	285
q15	524	484	468	468
q16	456	499	455	455
q17	1222	1603	1436	1436
q18	8124	7986	7871	7871
q19	824	863	967	863
q20	1968	2150	1897	1897
q21	4789	4301	4378	4301
q22	611	598	522	522
Total cold run time: 51905 ms
Total hot run time: 50271 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187192 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d1ed20b0cea6af232a6db92dd0dc7c608115414d, data reload: false

query1	987	385	402	385
query2	6496	1779	1730	1730
query3	6738	209	213	209
query4	25999	23495	23564	23495
query5	4357	582	423	423
query6	287	206	198	198
query7	4622	516	287	287
query8	262	214	219	214
query9	8649	2650	2630	2630
query10	464	325	260	260
query11	15585	15414	14769	14769
query12	161	110	105	105
query13	1657	511	389	389
query14	9198	5953	6066	5953
query15	209	207	171	171
query16	7704	437	263	263
query17	1318	748	595	595
query18	2038	399	307	307
query19	196	194	171	171
query20	121	113	115	113
query21	212	127	108	108
query22	4174	4087	3938	3938
query23	33922	33154	33013	33013
query24	8453	2363	2330	2330
query25	531	468	387	387
query26	1229	262	153	153
query27	2745	497	339	339
query28	4313	2117	2071	2071
query29	706	550	428	428
query30	282	218	192	192
query31	908	868	712	712
query32	71	67	64	64
query33	554	326	299	299
query34	781	835	521	521
query35	612	642	560	560
query36	921	967	860	860
query37	107	98	79	79
query38	4127	4120	4088	4088
query39	1536	1428	1445	1428
query40	208	115	104	104
query41	55	56	52	52
query42	124	111	109	109
query43	515	508	477	477
query44	1300	816	814	814
query45	171	171	183	171
query46	831	1021	632	632
query47	1763	1809	1754	1754
query48	375	401	300	300
query49	735	465	381	381
query50	623	681	412	412
query51	5379	5435	5351	5351
query52	105	114	101	101
query53	223	248	184	184
query54	572	555	496	496
query55	86	81	81	81
query56	311	311	285	285
query57	1165	1197	1115	1115
query58	257	252	249	249
query59	2642	2761	2690	2690
query60	320	318	305	305
query61	128	115	119	115
query62	807	716	664	664
query63	222	185	194	185
query64	4366	1183	822	822
query65	4244	4195	4169	4169
query66	1067	403	319	319
query67	15680	15525	15489	15489
query68	8567	883	526	526
query69	504	302	258	258
query70	1132	1098	1067	1067
query71	462	321	297	297
query72	5382	4711	4799	4711
query73	723	633	352	352
query74	9148	9130	8844	8844
query75	3839	3156	2683	2683
query76	3617	1174	733	733
query77	789	377	286	286
query78	10899	11141	10235	10235
query79	2132	889	602	602
query80	576	507	440	440
query81	488	261	224	224
query82	454	131	99	99
query83	252	261	234	234
query84	248	112	81	81
query85	806	357	314	314
query86	390	288	281	281
query87	4509	4426	4422	4422
query88	3396	2256	2251	2251
query89	392	321	286	286
query90	1842	205	201	201
query91	133	138	111	111
query92	76	63	54	54
query93	1629	940	663	663
query94	671	317	199	199
query95	377	291	275	275
query96	487	570	278	278
query97	2703	2712	2658	2658
query98	228	199	196	196
query99	1432	1422	1268	1268
Total cold run time: 275789 ms
Total hot run time: 187192 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d1ed20b0cea6af232a6db92dd0dc7c608115414d, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.24	0.07	0.07
query4	1.63	0.12	0.11
query5	0.42	0.42	0.42
query6	1.17	0.68	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.61	0.52	0.53
query10	0.57	0.58	0.57
query11	0.16	0.11	0.10
query12	0.15	0.12	0.12
query13	0.62	0.61	0.61
query14	0.78	0.81	0.82
query15	0.90	0.87	0.87
query16	0.38	0.39	0.38
query17	1.06	1.04	1.03
query18	0.23	0.21	0.21
query19	1.94	1.81	1.91
query20	0.01	0.01	0.02
query21	15.40	0.93	0.53
query22	0.75	1.30	0.72
query23	14.82	1.37	0.66
query24	9.58	0.70	0.38
query25	0.28	0.09	0.09
query26	0.53	0.16	0.13
query27	0.07	0.05	0.05
query28	8.12	0.84	0.46
query29	12.56	3.98	3.30
query30	0.25	0.09	0.06
query31	2.84	0.59	0.39
query32	3.24	0.56	0.47
query33	3.06	3.06	3.15
query34	16.04	5.37	4.77
query35	4.87	4.82	4.92
query36	0.68	0.51	0.49
query37	0.08	0.06	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.02	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 104.64 s
Total hot run time: 29.13 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 0.39% (1/257) 🎉
Increment coverage report
Complete coverage report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@starocean999 starocean999 starocean999 left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement showColumnStatsCommand in nereids
4 participants
@msridhar78 @hello-stephen @doris-robot @starocean999