Matlab benchmark


My own Matlab benchmark suite jmbench.m because timings from Matlab "bench" command cannot be used to compare Matlab versions

The tables contain time in seconds, smaller is better. Only comparisons within the same column are meaningful. The comparisons may not be 100% fair to the machines because there are no special versions of Matlab compiled for specific flavors of the CPUs, but they do show what you get when running the application. The script runs each benchmark thrice and I record in the table the best time for each category. If you send me the output of jmbench.m on other machines I'll be happy to include it here.

The benchmark compares the following:

Large LU: mostly floating point speed (starting R12, memory bound before)
Small LU: floating + integer speed on in-cache data
Sparse: cpu + random memory access, largely memory bound

Matlab R2013b
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel i7-4960HQ Haswell 2.6GHz Apple Retina MBP 15in late 2013 OSX 10.9 Mavericks 0.016 0.153 0.040

Matlab R2013a
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel XEON X5670 2.93GHz Gross frontend Centos 6.0 0.029 0.333 0.083

Matlab R2011b
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel XEON X5670 2.93GHz Gross frontend Centos 6.0 0.027 0.261 0.066
Intel I7 2.8GHz 17" Apple MacBook Pro Mid 2010 OSX 10.7.3 Lion 0.098 0.285 0.079
Intel I7 2.66GHz 15" Apple MacBook Pro Mid 2010 OSX 10.7.3 Lion 0.083 0.249 0.082

Matlab R2011a
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel Core I7 2.8GHz 17" Apple MacBook PRO Mid-2010 OSX Snow Leopard 0.074 0.234 0.071
Intel Pentinum T4300 2.1GHz HP d6v laptop Win 7 64bit Matlab 32bit 0.155 0.690 0.145

Matlab R2010b
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel Core I7 2.8GHz 17" Apple MacBook PRO Mid-2010 OSX Snow Leopard 0.085 0.450 0.091

Matlab R2010a
 
CPU/OS MHz Name Large LU  Small LU Sparse
*Intel Core I7 2.66GHz 15" Apple MacBook PRO Mid-2010 OSX Snow Leopard 0.096 0.463 0.078
AMD Athlon TF-20 1.6GHz Acer Aspire 5517 Win 7 0.596 1.163 0.243

* run by Bedrich Sousedik

Matlab R2008a
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel Core 2 Duo 2.5GHz Macbook Pro 15" OS X Leopard 0.191 0.812 0.229

Matlab R2007b
 
CPU/OS MHz Name Large LU  Small LU Sparse
Intel Core 2 X9650 (4 cores) /Fedora 7 3GHz ASUS P5K3 Deluxe WiFi 8GB DDR3 1333MHz 7-7-7-20 0.136 0.375 0.123
#2x dual core AMD Opteron 2200 /Win XP 2.8GHz HP xw9400 hyperthreading off 0.374 0.660 0.166
#Intel Core2 Duo T7300 /Win XP 2GHz HP 6910P (Laptop) 0.304 0.695 0.172
*AMD Turion 64 X2 TL-66/Fedora 8 x64, Matlab 32bit 2.3GHz HP Pavilion tx1420us Tablet PC 3GB 0.403 0.840 0.232
*AMD Turion 64 X2 TL-66/Vista Home Premium 2.3GHz HP Pavilion tx1420us Tablet PC 3GB 0.540 0.870 0.227

# run by Mattias Villani
* run by Bedrich Sousedik

Matlab R2007a
 
CPU/OS MHz Name Large LU  Small LU Sparse
2xIntel Xeon E5310 (4 cores)/Fedora 6 1.6GHz Western Scientific Velocity 16GB/wf 0.278 0.776 0.202
*Core 2 Duo/Mac OS 10.5.1 2.4GHz MacBookPro3,1 0.309 1.135 0.309

* run by James Sumners

Matlab R14 a.k.a 7
 
CPU/OS MHz Name Large LU  Small LU Sparse
2x Dual Core Opteron 275/Fedora Core 3 AMD64 2.2GHz IWILL DK8AEW 16GB DDR-400/opt4 0.417 0.747 0.299
Dual Opteron 248/Fedora Core 1 AMD64 2.2GHz Tyan K8W S2885 4GB PC2700/pogo01 0.576 1.303 0.330
Athlon 64 3400+/Fedora Core2 64bit 2.2GHz MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat 0.588 1.315 0.330
Pentium 4/Linux RH 7.3/333MHz DDR 3.06GHz Asus P4G8X dlx mobo 533FSB / Godzilla 0.612 1.099 0.444
#GB Dual Pentium 4 Xeon HT/Linux RH 9.0 3.06GHz Dell PowerEdge 1750 0.619 1.136 0.439
Pentium 4/Win XP Home 2.8GHz Toshiba A45-S250 512MB / Beda's laptop 0.703 1.312 0.375
UltraSPARC-III+/Solaris 91.2GHzSun Fire 880/mathsun 0.800 2.478 0.575
*JS Pentium M/WinXP Pro Optimized Intel MKL Library 1.6GHz Dell Latitude D800 0.851 1.182 0.410
Dual Opteron 240/Win XP SP1a 1.4GHz Tyan S2885 mobo PC2700DDR 128bit mode 0.844 2.625 0.453
*JK Athlon XP 2200+/Win XP ProSP1 2200+ Asus A7V333 mobo DDR 333MHz 0.922 2.203 0.469
*JS Pentium M/WinXP Pro 1.6GHz Dell Latitude D800 1.032 1.802 0.420
Pentium M 745/WinXP Pro 1.8GHz Dell Inspiron 600m / Jan's laptop 1.042 1.572 0.351
Pentium 3M/WinXP Pro 877MHz Dell Latitude C400 / Jan's laptop 3.304 6.079 1.642

*JK = run by Jan Karlsson, Sweden
*JS = run by Janne simonen, Japan

Matlab R14 AMD/Intel 64 bit beta
 
CPU/OS MHz Name Large LU  Small LU Sparse
Athlon 64 3400+/Fedora Core2 64bit 2.2GHz MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat 0.438 0.715 0.290
#HD Dual Opteron 246/Suse 9.0 64bit 2.0GHz Tyan K8S 4GB 333MHz DDR 0.508 0.802 0.292

#HD = run by Huseyin Demir, Georgia Tech Savannah

Matlab R14 a.k.a 7
 
CPU/OS MHz Name Large LU  Small LU Sparse
2x Dual Core Opteron 275/Fedora Core 3 AMD64 2.2GHz IWILL DK8AEW 16GB DDR-400/opt4 0.417 0.747 0.299
Dual Opteron 248/Fedora Core 1 AMD64 2.2GHz Tyan K8W S2885 4GB PC2700/pogo01 0.576 1.303 0.330
Athlon 64 3400+/Fedora Core2 64bit 2.2GHz MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat 0.588 1.315 0.330
Pentium 4/Linux RH 7.3/333MHz DDR 3.06GHz Asus P4G8X dlx mobo 533FSB / Godzilla 0.612 1.099 0.444
#GB Dual Pentium 4 Xeon HT/Linux RH 9.0 3.06GHz Dell PowerEdge 1750 0.619 1.136 0.439
Pentium 4/Win XP Home 2.8GHz Toshiba A45-S250 512MB / Beda's laptop 0.703 1.312 0.375
UltraSPARC-III+/Solaris 91.2GHzSun Fire 880/mathsun 0.800 2.478 0.575
*JS Pentium M/WinXP Pro Optimized Intel MKL Library 1.6GHz Dell Latitude D800 0.851 1.182 0.410
Dual Opteron 240/Win XP SP1a 1.4GHz Tyan S2885 mobo PC2700DDR 128bit mode 0.844 2.625 0.453
*JK Athlon XP 2200+/Win XP ProSP1 2200+ Asus A7V333 mobo DDR 333MHz 0.922 2.203 0.469
*JS Pentium M/WinXP Pro 1.6GHz Dell Latitude D800 1.032 1.802 0.420
Pentium M 745/WinXP Pro 1.8GHz Dell Inspiron 600m / Jan's laptop 1.042 1.572 0.351
Pentium 3M/WinXP Pro 877MHz Dell Latitude C400 / Jan's laptop 3.304 6.079 1.642

*JK = run by Jan Karlsson, Sweden
*JS = run by Janne simonen, Japan

Matlab R14 AMD/Intel 64 bit beta
 
CPU/OS MHz Name Large LU  Small LU Sparse
Athlon 64 3400+/Fedora Core2 64bit 2.2GHz MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat 0.438 0.715 0.290
#HD Dual Opteron 246/Suse 9.0 64bit 2.0GHz Tyan K8S 4GB 333MHz DDR 0.508 0.802 0.292

#HD = run by Huseyin Demir, Georgia Tech Savannah

Matlab R13 a.k.a 6.5
 
CPU/OS MHz Name Large LU  Small LU Sparse
#GB$M Power 4 /AIX 5.1 1.3GHz IBM p690 LPAR 32GB 0.467 1.576 0.907
#CC Pentium 4 HT disabled/WinXP Pro 3.2GHz Siemens SCENIC W 1.5GB DDR2-4200 no ECC CL 4-4-4 0.591 1.109 0.314
$$dual Opteron 248/Linux RHELAS 3 2.2GHz Sun V20z 8GB pc2700 0.597 1.329 0.969
Pentium 4/Linux RH 7.3/333MHz DDR 3.06GHz Asus P4G8X dlx mobo 533FSB / Godzilla 0.627 1.152 1.275
#HD Dual Opteron 246/Suse 9.0 64bit 2.0GHz Tyan K8S 4GB 333MHz DDR 0.644 1.573 0.955
**Dual Opteron 246/Fedora Core 1 AMD64 2GHz Tyan K8W S2885 4GB PC2100 0.669 1.454 0.985
#HD Dual Opteron 246/WinXP 2.0GHz Tyan K8S 4GB 333MHz DDR 0.703 1.640 0.734
$$dual Opteron 244/Linux RHELAS 3 1.8GHz Sun V20z 4GB pc3200 0.716 1.622 1.029
#$Xeon/p4/Linux RH 7.3 2.4HGzSupermicro x5dae 533MHz FSB 0.757 1.571 1.424
Pentium 4/Linux RH 7.3/PC800RDRAM 2.2GHz Western Scientific / Skylla 0.803 1.875 1.579
#*Pentium 4-B/Win XP PRO SP1 3.06GHz ASUS P4B533 533MHz FSB mobo PC2700 2*512MB 0.828 2.219 1.954
*Alpha 21364/EV7 OSF5.1 1.15GHz Compaq ES40 0.874 2.520 0.748
#Athlon XP/Win2k SP2 2400+ EPOX 8KHA+ mobo 266FSB 0.922 2.103 1.762
##Athlon XP1800+/Win2k SP2 1575ASUS A7N7X dlx 274FSB PC2100 0.953 2.578 1.562
Pentium M 745/WinXP Pro 1.8GHz Dell Inspiron 600m / Jan's laptop 0.982 1.582 1.382
Dual Opteron 240/Win XP SP1a 1.4GHz Tyan S2885 mobo PC2700DDR 128bit mode 1.016 2.250 1.250
Dual Opteron 240/Win XP SP1a 1.4GHz Tyan S2885 mobo PC2700DDR 64bit mode 1.016 2.250 1.328
Celeron/WinXP 2.4GHz Dell Inspiron 1100 / Alan's laptop 1.0312.6131.863
Pentium 4/Linux RH 7.3/PC800RDRAM 1.7GHz Western Scientific / p4 1.044 2.474 1.816
*PA8500/hpux11.11 440 HPJ5000 1.194 5.638 2.608
*athlonXP/RH7.2 1800+ na 1.343 2.881 2.665
Pentium M/WinXP 1.2GHz Dell Latitude X300 / Leo's laptop 1.412 2.383 1.733
*athlon/mdk8.0 1000 na 1.590 3.260 3.070
Pentium M / Win XP 1GHz Panasonic Toughbook CF-W2/dept loaner 1.602 3.255 1.822
*ES40/EV6 OSF5.1 600 Compaq ES40 2.089 6.031 2.201
Pentium 3M/WinXP 1GHz Dell Latitude C400 / Jan's laptop 2.203 3.375 4.096
Pentium 3/RH 7.3 933MHz Tyan S2567 mobo/beowulf master 2.205 4.772 3.312
Alpha DS20/OSF 5 500MHz Vader 2.053 6.006 1.829
+Power PC G4/OS X 10.2.2 800 Apple TiBook 2.292 6.542 3.994
+$ Power PC G4/OS 10.3.3 867MHz Apple Powerbook 12" 3.184 8.535 3.747
Pentium 3/Win2k SP1 700MHz Dell Latitude L400 3.974 5.999 6.269
+$ Power PC G3/OS 10.3.3 800MHz Apple iBook4.226 8.990 6.460
*R10000/irix64 195 SGI octane 5.976 16.360 8.062
*PII/mdk7.2 266 galerkin 8.188 17.344 10.590
#CC = run by Carlos Climent
+$ = run by Wee Jin Goh, Oxford Brookes
#$ = run by Jonas August, CMU
$$ = run by Zach Johnson, UC Davis
#* = run by Matt Kelly, U Arkansas
** = run by Alexander Berg, Berkeley
## = run by Lars Ulveland, memory timings 2.5-3-3-7, spread spectrum disabled
#GB = run by Gregory Bauer, UIUC
$M = multi-user machine with sustained load of 8 on 16
* = run by Olivier Dessombz, Ecole Centrale de Lyon
+ = run by Ian Goh, John Hopkins University
# = run by Andrew Diamond; 2400+ is "speed unoficially meant to give about the same performance as 2.4GHz P4"

Matlab R13 pre-release
 
CPU/OS MHz Name Large LU  Small LU Sparse
Pentium 4/Linux RH7.2 1.5GHz Dell Precision 330 1.161 2.760 2.013

Matlab R12.1
 
CPU/OS MHz Name Large LU  Small LU Sparse
#Athlon XP/Win2k SP2 2400+ EPOX 8KHA+ mobo 266FSB 0.821 2.183 1.652
Pentium 4/PC800Rambus/RH72 2.2GHz Western Scientific/Skylla 0.912 1.738 1.500
#CC Asus M6Ne PentiumM/Windows XP Home SP2 1.6GHz 512MB 1.001 1.763 1.282
*Pentium 4/? 2GHz HP X2000 1.071 2.390 1.603
Pentium 3/Win 2k 700 Dell Latitude L400 3.845 8.112 6.840
*HP C3700 750 na 1.445 3.627 2.014
*Sun Blade 100 500 na 29.652 20.924 6.960
*HP B2600 500 na 2.099 5.439 2.419
*Sun Fire V880 750 na 1.683 4.270 1.996
Pentium 3/RedHat 7.1 1 GHz Dell Poweredge 2400/math 1.955 4.482 3.568
Pentium 3/RedHat 7.0 933 Supermicro 370DER mobo/beowulf 2.007 4.558 3.269
Pentium 3/RedHat 7.0 933 Tyan S2567 mobo/beowulf master 1.974 4.591 3.352
Pentium 4/Win2000 1.4GHz Compaq 1.299 3.365 1.832
Pentium 4/Win2000 SP1 1.5GHz Dell Precision 330 1.642 3.585 1.753
Pentium 4/Redhat 7.1 1.5GHz Dell Precision 330 1.299 2.906 1.782
Pentium 4/Redhat 7.1 1.7GHz Western Scientific - p4 1.174 2.659 1.725
* = run by Tomas Lovato

Matlab R12
 
CPU/OS MHz Name Large LU  Small LU Sparse
Pentium 4/SUSE Linux 7.3 1.6GHz SONY VAIO PCG-GRX150/wall power 1.297 2.523 2.637
Pentium 4/SUSE Linux 7.3 1.6GHz SONY VAIO PCG-GRX150/battery 1.699 3.495 2.996
*Pentium 3/Win XP Pro 1.2GHz Dell Latitude 610 1.763 2.964 3.225
Pentium 4/Win2000 SP1 1.5GHz Dell Precision 330 1.402 3.885 1.732
Pentium 4/Redhat 7.1 1.5GHz Dell Precision 330 1.302 2.904 1.781
Alpha EV6/Unix 4.0f 500 AlphaServer DS20 - vader 1.980 6.611 2.307
Pentium III/Win2k 700  Toshiba Tecra 8100 - lapcat 7.691 20.169 11.096
Pentium III/RH6.2 vmware on win2k 700  Toshiba Tecra 8100 - lapcat 8.999 20.617 17.994
SUN UltraSparc IIi/Solaris 7 440 SUN AXi - puzin 2.506 7.525 5.052
Pentium III/RedHat6.2 500 linus 3.613 8.566 5.059
Pentium Pro/NT4Sp6 500 no name 3.938 9.437 5.547
* = run by Alexander Karapetyan
# = run by Andrew Diamond


Matlab R11
 
CPU/OS MHz Name Large LU  Small LU Sparse
Alpha EV6/Unix 4.0f 500 AlphaServer DS20 - vader  6.316   7.532   2.775
Pentium III/Win2K 700  Toshiba Tecra 8100 - lapcat  9.604   8.552   8.042
SUN UltraSparc IIi/Solaris 7 440 SUN AXi - puzin 23.187 18.107   6.591
Pentium III/RedHat6.2 500 linus 28.201 14.307   9.664



Timings from Matlab R11 bench command:

LU measures primarily floating point speed
Sparse has a strong integer component
From the Matlab command "bench", smaller  is better

CPU MHz Name Sparse LU
Alpha EV6 500 AlphaSever DS20 - vader 0.15 0.25
Pentium III 700  Toshiba Tecra 8100 - lapcat 0.19 0.33
SUN UltraSparc IIi 440 SUN AXi - puzin 0.49 0.41
Pentium III 500 linus 0.43 0.44
Pentium MMX 233 Gateway Solo 9100 1.50 1.16


Maintained by Jan Mandel
Last updated 11/18/13