rvm + Rubinius Tiered Benchmarks

This is a run summary of the tiered Benchmark suite found in Rubinius (rbx). This suite was run using rvm and the charts are done using google charts.

System

uname -v	Darwin Kernel Version 10.2.0: Tue Nov 3 23:08:29 PST 2009; root:xnu-1486.2.11~3/RELEASE_I386
rvm version	0.0.99

To view the benchmarks for each tier follow the links below:

Rubies benchmarked were:

Ruby String	ruby -v
jruby-1.4.0	jruby 1.4.0 (ruby 1.8.7 patchlevel 174) (2009-11-02 69fbfa3) (Java HotSpot(TM) 64-Bit Server VM 1.6.0_17) [x86_64-java]
jruby-head	jruby 1.5.0.dev (ruby 1.8.7 patchlevel 174) (2010-01-05 58ad349) (Java HotSpot(TM) 64-Bit Server VM 1.6.0_17) [x86_64-java]
rbx-head	rubinius 1.0.0-rc2 (1.8.7 155e42c4 2010-01-04 JI) [x86_64-apple-darwin10.2.0]
ree-1.8.7-2009.10	ruby 1.8.7 (2009-06-12 patchlevel 174) [i686-darwin10.2.0], MBARI 0x6770, Ruby Enterprise Edition 2009.10
ruby-1.8.6-p383	ruby 1.8.6 (2009-08-04 patchlevel 383) [i686-darwin10.2.0]
ruby-1.8.7-p248	ruby 1.8.7 (2009-12-24 patchlevel 248) [i686-darwin10.2.0]
ruby-1.9.1-p376	ruby 1.9.1p376 (2009-12-07 revision 26041) [i386-darwin10.2.0]

Overall Aggregate Summary

Aggregate median of medians of all tiers

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-1.4.0	1440	7168	665	2904.895	2349.962	142	234	80	149.87	37.772
jruby-head	1510	7789	736	2975.395	2358.147	72	162	66	79.24	23.413
rbx-head	919	2596	384	1048.842	392.465	35	120	33	41.79	22.013
ree-1.8.7-2009.10	3436	21077	1042	7545.947	6222.107	2	22	1	3.34	4.911
ruby-1.8.6-p383	3519	25780	968	8805.947	7719.872	2	35	1	3.45	5.977
ruby-1.8.7-p248	3929	27450	990	9381.447	8173.264	2	34	1	3.42	5.838
ruby-1.9.1-p376	1649	4297	748	2196.211	1129.194	3	30	3	4.87	5.606

Aggregate Median Time (s) Graph

Aggregate Median Memory (MB) Graph

Tier 0 Summary

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-1.4.0	5487	8657	1119	5557.385	2494.914	151	225	65	148.77	49.087
jruby-head	5387	9019	1191	5496.077	2431.777	68	77	66	68.46	3.104
rbx-head	911	4231	109	1527.077	1227.482	33	35	33	33.46	0.843
ree-1.8.7-2009.10	15307	34951	3838	15286.385	8240.02	1	2	1	1.08	0.266
ruby-1.8.6-p383	17275	39013	4057	17931.538	9541.03	1	2	1	1.08	0.266
ruby-1.8.7-p248	18359	41505	4368	19297.692	10122.284	1	2	1	1.08	0.266
ruby-1.9.1-p376	3770	7419	564	3744.077	1875.163	3	3	3	3.0	0.0

Aggregate Median Time (s) Graph

Aggregate Median Memory (MB) Graph

Tier 0 Benchmarks (Details)

Tier 1 Summary

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-1.4.0	1262	4336	197	1675.857	1177.178	133	259	64	144.86	56.59
jruby-head	1317	4522	199	1703.857	1203.868	73	136	68	78.9	15.065
rbx-head	822	3635	79	1110.429	1001.468	35	74	33	37.43	8.358
ree-1.8.7-2009.10	2926	15536	441	4118.143	3773.84	2	30	1	4.57	6.807
ruby-1.8.6-p383	3259	18134	417	4430.952	4518.468	2	32	1	4.71	7.212
ruby-1.8.7-p248	3431	20701	428	4803.286	5096.09	2	32	1	4.29	6.606
ruby-1.9.1-p376	1299	5507	143	1837.143	1300.779	3	31	3	5.9	6.225

Aggregate Median Time (s) Graph

Aggregate Median Memory (MB) Graph

Tier 1 Benchmarks (Details)

Tier 2 Summary

Aggregate median of medians

Data Table

	Time (s)						Memory (MB)
Interpreter	median	max	min	mean	σ	median	max	min	mean	σ
jruby-1.4.0	797	24017	269	6470.25	10133.351	191	234	99	179.0	55.682
jruby-head	894	24900	200	6722.0	10499.491	116	162	80	118.5	36.431
rbx-head	1524	40444	243	10934.0	17048.995	82	132	53	87.5	33.619
ree-1.8.7-2009.10	1946	21105	162	6290.0	8608.206	21	33	5	20.0	11.811
ruby-1.8.6-p383	2050	21798	159	6514.25	8890.764	16	60	5	24.25	21.545
ruby-1.8.7-p248	2240	21971	160	6653.0	8928.438	16	59	5	24.0	21.131
ruby-1.9.1-p376	847	28807	250	7688.0	12195.703	25	51	5	26.75	19.652

Aggregate Median Time (s) Graph

Aggregate Median Memory (MB) Graph

Tier 2 Benchmarks (Details)