JENA Loader Benchmarks

From lotico
Jump to navigation Jump to search

tdbloader

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input notes
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,214.35s 81,516.25 37m6.921s 37m43.594s 0m53.788s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,361.31s 76,443.19 39m31.724s 40m53.732s 0m48.914s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 6,893.81s 26,183.74 168m59.657s 76m50.081s 3m48.615s 28G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 3,406.35 52,990.90 56m49.589s 57m14.923s 2m57.746s 28G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdbloader2

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,320.45s 136,700.08 33m38.361s 43m25.897s 1m19.987s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 4451s(2,637.89s) 68,428.11 74m11.262s 81m6.853s 3m53.422s 17G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1999s(1,309.61s) 137,831.80 33m18.694s 43m0.869s 1m23.055s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 2921s(2,132.71s) 84,636.64 48m40.710s 63m6.416s 3m1.636s 17G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdb2.tdbloader

# Jena OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec / indexer real user sys size on disk compressed/uncompressed notes
1 3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 26m55.268s 45m29.688s 2m53.078s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
2 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,497.453s 120,542 24m58.791s 44m8.768s 2m42.672s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 126m9.826s 98m45.230s 6m43.824s 28G ttl.gz (1.16G)
4 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,446.839s 124,759 24m8.094 49m33.557s 2m57.582s 28G ttl.gz (1.16G) --loader=parallel SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
5 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 1,571.540 114,859 26m12.842s 65m18.011s 5m15.307s 28G ttl.gz (1.16G) --loader=parallel;Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
6 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 741.577s 243,408 12m22.734s 35m52.742s 1m40.389s 28G ttl.gz (1.16G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2
7a 3.13 Ubuntu 20.04*
(5.4.0-37-generic)
Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 1552.857s 116,241 25m59.561s 47m1.060s 3m48.757s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7b 3.15 Ubuntu 20.04*
(5.4.0-39-generic)
Open JDK 12.01 180,505,759 1,519.713 118,776 25m21.039s 46m40.163s 3m33.435s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7c 3.15 Ubuntu 20.04*
(5.4.0-40-generic)
Open JDK 12.01 180,505,759 1,482.566s 121,752 24m43.948s 45m54.528s 3m27.487s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7d 3.15 Ubuntu 20.04*
(5.4.0-37-generic)
Open JDK 13.02 180,505,758 1,855.803s 97,266 30m57.179s 54m13.804s 3m44.125s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
8 3.13 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12874.74s 77,671 215m3.603s 328m43.471s 43m33.704s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
9 3.15 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12993.75s 76,799 217m2.838s 333m58.845s 43m51.748s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
10 3.15 Ubuntu 20.04 LTS Open JDK 12.0.1 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 11,467.457 87,203 191m9.179s 301m50.424s 42m50.488s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
11 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,524,233 1,303.463 219,154/138,496 21m45.282s 39m13.822s 2m29.940s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=128GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
12 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 767.214 sec 354,735/235,298 12m48.258s 25m14.011s 1m52.646s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
13 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 526.929 sec 342,597 8m48.018 25m0.701s 2m5.309s 28G ttl.gz/.ttl (1.2G/20G ) --loader=parallel;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
* performance regression might be related to a bug with ZFS in Ubuntu 20.04 LTS which can be fixed with a v5.6.18 Mainline kernel patch  https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.6.18/ (not yet tested)