rvm + Rubinius Tiered Benchmarks

This is a run summary of the tiered Benchmark suite found in Rubinius (rbx). This suite was run using rvm and the charts are done using google charts.

System

To view the benchmarks for each tier follow the links below:

Rubies benchmarked were:

---

Overall Aggregate Summary

---

Aggregate median of medians of all tiers

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-head	1444	7417	809	2956.297	2314.073	139	235	76	147.08	35.878
macruby-nightly	1978	5295	153	2292.189	1184.385	15	75	14	18.24	12.273
maglev-22804	1116	7220	334	1479.973	1327.386	75	141	73	79.24	17.343
rbx-head	950	2523	421	1049.514	399.256	35	106	33	39.92	18.511
ree-1.8.7-2010.01	3811	21055	2036	7981.622	6285.49	2	30	1	3.43	5.764
ruby-1.8.6-p383	3791	26941	2075	9414.135	8116.582	2	38	1	3.68	6.998
ruby-1.8.7-p248	4216	27853	2353	10000.703	8472.67	2	34	1	3.49	6.211
ruby-head	1539	4427	682	2250.459	1289.252	3	51	3	5.54	9.417

Aggregate Median Time (s) Graph



Aggregate Median Memory (MB) Graph



---

Tier 0 Summary

---

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-head	4944	10207	1191	5479.615	2557.633	148	222	57	142.46	51.205
macruby-nightly	3603	20677	469	4776.462	5234.955	14	16	14	14.31	0.606
maglev-22804	1306	21738	459	4437.769	6464.991	73	75	73	73.46	0.843
rbx-head	950	3964	111	1518.846	1177.795	33	35	33	33.46	0.843
ree-1.8.7-2010.01	15948	35159	3798	15400.077	8255.222	1	2	1	1.08	0.266
ruby-1.8.6-p383	17615	39493	4333	18350.615	9663.987	1	2	1	1.08	0.266
ruby-1.8.7-p248	20546	44244	4630	20059.692	10622.309	1	2	1	1.08	0.266
ruby-head	4080	7723	558	3971.385	1844.952	3	4	3	3.08	0.266

Aggregate Median Time (s) Graph



Aggregate Median Memory (MB) Graph



Tier 0 Benchmarks (Details)

---

Tier 1 Summary

---

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-head	1275	4271	217	1663.524	1167.531	128	254	53	136.71	53.145
macruby-nightly	1696	17313	153	2620.0	3710.657	15	347	14	42.86	84.19
maglev-22804	690	15900	39	1554.143	3256.333	75	120	73	77.67	10.302
rbx-head	726	3736	61	1148.333	1031.274	35	72	33	37.52	7.956
ree-1.8.7-2010.01	2964	16345	474	4349.381	3944.656	2	30	1	4.81	6.737
ruby-1.8.6-p383	3308	18361	421	4476.857	4575.045	2	32	1	4.71	7.212
ruby-1.8.7-p248	3467	21228	443	4958.238	5300.384	2	32	1	4.38	6.565
ruby-head	1282	3238	139	1585.667	954.86	3	31	3	5.62	6.153

Aggregate Median Time (s) Graph



Aggregate Median Memory (MB) Graph



Tier 1 Benchmarks (Details)

---

Tier 2 Summary

---

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-head	975	24251	644	8623.333	11051.255	195	235	141	190.33	38.517
macruby-nightly	3127	38740	2964	14943.667	16826.68	75	147	39	87.0	44.9
maglev-22804	1116	1675	557	1116.0	559.0	141	152	130	141.0	11.0
rbx-head	1693	39770	1027	14163.333	18108.689	98	106	74	92.67	13.597
ree-1.8.7-2010.01	2957	20985	1116	8352.667	8963.972	30	33	12	25.0	9.274
ruby-1.8.6-p383	3167	22377	983	8842.333	9611.898	22	60	16	32.67	19.482
ruby-1.8.7-p248	3691	22263	1016	8990.0	9448.75	22	59	10	30.33	20.854
ruby-head	757	14297	608	5220.667	6418.225	51	65	10	42.0	23.338

Aggregate Median Time (s) Graph



Aggregate Median Memory (MB) Graph



Tier 2 Benchmarks (Details)