0001 ================================================================================================
0002 Hive UDAF vs Spark AF
0003 ================================================================================================
0004
0005 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0006 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0007 hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
0008 ------------------------------------------------------------------------------------------------------------------------
0009 hive udaf w/o group by 7014 7206 120 0.0 107031.0 1.0X
0010 spark af w/o group by 47 59 11 1.4 716.9 149.3X
0011 hive udaf w/ group by 4811 4831 28 0.0 73409.1 1.5X
0012 spark af w/ group by w/o fallback 50 56 7 1.3 762.9 140.3X
0013 spark af w/ group by w/ fallback 126 130 8 0.5 1916.6 55.8X
0014
0015
0016 ================================================================================================
0017 ObjectHashAggregateExec vs SortAggregateExec - typed_count
0018 ================================================================================================
0019
0020 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0021 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0022 object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
0023 ------------------------------------------------------------------------------------------------------------------------
0024 sort agg w/ group by 42969 43306 476 2.4 409.8 1.0X
0025 object agg w/ group by w/o fallback 9744 9844 145 10.8 92.9 4.4X
0026 object agg w/ group by w/ fallback 26814 26960 206 3.9 255.7 1.6X
0027 sort agg w/o group by 6278 6330 57 16.7 59.9 6.8X
0028 object agg w/o group by w/o fallback 5433 5478 60 19.3 51.8 7.9X
0029
0030
0031 ================================================================================================
0032 ObjectHashAggregateExec vs SortAggregateExec - percentile_approx
0033 ================================================================================================
0034
0035 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0036 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0037 object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
0038 ------------------------------------------------------------------------------------------------------------------------
0039 sort agg w/ group by 756 773 9 2.8 360.3 1.0X
0040 object agg w/ group by w/o fallback 548 560 7 3.8 261.3 1.4X
0041 object agg w/ group by w/ fallback 759 773 7 2.8 362.0 1.0X
0042 sort agg w/o group by 471 483 13 4.4 224.8 1.6X
0043 object agg w/o group by w/o fallback 471 482 12 4.5 224.7 1.6X
0044
0045