Back to home page

OSCL-LXR

 
 

    


0001 ================================================================================================
0002 Hive UDAF vs Spark AF
0003 ================================================================================================
0004 
0005 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0006 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0007 hive udaf vs spark af:                    Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
0008 ------------------------------------------------------------------------------------------------------------------------
0009 hive udaf w/o group by                             7014           7206         120          0.0      107031.0       1.0X
0010 spark af w/o group by                                47             59          11          1.4         716.9     149.3X
0011 hive udaf w/ group by                              4811           4831          28          0.0       73409.1       1.5X
0012 spark af w/ group by w/o fallback                    50             56           7          1.3         762.9     140.3X
0013 spark af w/ group by w/ fallback                    126            130           8          0.5        1916.6      55.8X
0014 
0015 
0016 ================================================================================================
0017 ObjectHashAggregateExec vs SortAggregateExec - typed_count
0018 ================================================================================================
0019 
0020 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0021 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0022 object agg v.s. sort agg:                 Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
0023 ------------------------------------------------------------------------------------------------------------------------
0024 sort agg w/ group by                              42969          43306         476          2.4         409.8       1.0X
0025 object agg w/ group by w/o fallback                9744           9844         145         10.8          92.9       4.4X
0026 object agg w/ group by w/ fallback                26814          26960         206          3.9         255.7       1.6X
0027 sort agg w/o group by                              6278           6330          57         16.7          59.9       6.8X
0028 object agg w/o group by w/o fallback               5433           5478          60         19.3          51.8       7.9X
0029 
0030 
0031 ================================================================================================
0032 ObjectHashAggregateExec vs SortAggregateExec - percentile_approx
0033 ================================================================================================
0034 
0035 OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
0036 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
0037 object agg v.s. sort agg:                 Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
0038 ------------------------------------------------------------------------------------------------------------------------
0039 sort agg w/ group by                                756            773           9          2.8         360.3       1.0X
0040 object agg w/ group by w/o fallback                 548            560           7          3.8         261.3       1.4X
0041 object agg w/ group by w/ fallback                  759            773           7          2.8         362.0       1.0X
0042 sort agg w/o group by                               471            483          13          4.4         224.8       1.6X
0043 object agg w/o group by w/o fallback                471            482          12          4.5         224.7       1.6X
0044 
0045