Skip to content

Benchmark compilation times

Shaurya Arora edited this page May 10, 2024 · 25 revisions

Why

We collect the results to better judge the DX, possibly detect glaring regressions and inconsistencies, but also out of curiosity, and to compare different hardware.

How

In the dev shell, checkout out latest master branch and run:

just bench-compilation

Notes

  • Results between different commits might differ due to code & dependency changes, toolchain versions etc.
  • Results between different OS might differ as e.g. we use mold only on Linux
  • We do disable sccache and possibly other tools like it

Results

Feel free to append your results, along with information about your OS, hardware & setup.

@dpc's recent desktop build with Ryzen 9

dpc@ren
-------
OS: NixOS 23.11.20240129.f4a8d6d (Tapir) x86_64
Host: ASUSTeK COMPUTER INC. ROG STRIX B650E-I GAMING WIFI
Kernel: 6.7.2
Uptime: 10 days, 21 hours, 4 mins
CPU: AMD Ryzen 9 7950X3D (32) @ 5.759GHz
Memory: 22384MiB / 63510MiB

Date: 2024-03-14
Commit: 7a36cafa29
OS: Linux
Dev full:

real    1m2.855s
user    21m24.474s
sys     1m29.384s

Dev incremental:

real    0m9.108s
user    0m17.348s
sys     0m8.610s

Release full:

real    1m28.623s
user    30m6.054s
sys     1m20.572s

Release incremental:

real    0m47.992s
user    17m25.358s
sys     0m27.354s

@maan2003's ryzen 9 laptop

user@new-plastic
----------------
OS: NixOS 24.05.20240217.6e2f00c (Uakari) x86_64
Host: ASUSTeK COMPUTER INC. FA617XS
Kernel: 6.6.16
Uptime: 38 mins
Packages: 640 (nix-system)
Shell: bash 5.2.26
Resolution: 1920x1200
Terminal: /dev/pts/0
CPU: AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (16) @ 5.583GHz
GPU: AMD ATI Phoenix1
GPU: AMD ATI Radeon RX 7700S/7600/7600S/7600M XT/PRO W7600
Memory: 3066MiB / 15216MiB

Date: 2024-03-06
Commit: f55311601e
Dev full:

real    2m25.172s
user    29m44.601s
sys     1m30.798s

Dev incremental:

real    0m15.478s
user    0m24.371s
sys     0m7.953s

Release full:

real    3m8.436s
user    42m25.119s
sys     1m23.139s

Release incremental:

real    1m42.200s
user    24m1.040s
sys     0m29.182s

@bradleystachurski's proxmox vm with Ryzen 5

OS: Ubuntu 20.04.6 LTS x86_64
Host: KVM/QEMU (Standard PC (i440FX + PIIX, 1996) pc-i440fx-8.1)
Kernel: 5.15.0-97-generic
Uptime: 5 hours, 4 mins
CPU: QEMU Virtual version 2.5+ (12) @ 3.423GHz
Memory: 1285MiB / 32091MiB

Date: 2024-03-05
Commit: f55311601e
Dev full:

real    4m42.770s
user    41m4.775s
sys     2m33.114s

Dev incremental:

real    0m24.362s
user    0m38.671s
sys     0m10.583s

Release full:

real    6m14.947s
user    60m56.548s
sys     2m3.622s

Release incremental:

real    3m21.251s
user    34m4.107s
sys     0m56.908s

@dpc's Framework laptop

dpc@mutex
---------
OS: NixOS 23.11.20240129.f4a8d6d (Tapir) x86_64
Host: Framework FRANMACP08
Kernel: 6.7.2
CPU: 12th Gen Intel i7-1280P (20) @ 4.700GHz
Memory: 9220MiB / 64023MiB

Date: 2024-03-05
Commit: 054d10ab40
Dev full:

real    4m41.045s
user    76m53.704s
sys     3m9.785s

Dev incremental:

real    0m17.881s
user    0m34.290s
sys     0m9.498s

Release full:

real    6m29.313s
user    103m30.603s
sys     2m35.451s

Release incremental:

real    3m50.983s
user    67m44.646s
sys     1m3.924s

@LeNei's Macbook Air M2

OS: macOS 14.2.1 23C71 arm64
Host: Mac14,2
Kernel: 23.2.0
Uptime: 22 days, 12 mins
Packages: 208 (brew)
Shell: bash 5.2.26
Resolution: 3840x2160 @ UHDHz, 2560x1664
DE: Aqua
WM: Quartz Compositor
WM Theme: Blue (Dark)
Terminal: WezTerm
CPU: Apple M2
GPU: Apple M2
Memory: 7802MiB / 24576MiB

Date: 2024-03-06
Commit: 348c4d3a7a
Dev full:

real    7m34.237s
user    35m33.406s
sys     1m12.030s

realincr5m11.271s
user    1m48.973s
sys     0m35.601s

Release full:

real    6m52.641s
user    49m52.853s
sys     0m55.819s

Release incremental:

real    4m26.639s
user    33m24.373s
sys     0m20.623s

@elsirion's P14s Gen 4

OS: NixOS 24.05pre
Host: LENOVO 21K5000JGE 
Kernel: 6.7.4 
Uptime: 3 days, 10 hours, 48 mins 
Packages: 1428 (nix-system), 7373 (nix-user), 88 (nix-default) 
Shell: bash 5.2.26 
Resolution: 2880x1800 
DE: Xfce 4.18 
WM: i3 
Theme: Xfce-4.6 [GTK2], Adwaita [GTK3] 
Icons: Tango [GTK2], Rodent [GTK3] 
Terminal: just 
CPU: AMD Ryzen 7 PRO 7840U w/ Radeon 780M Graphics (16) @ 5.132GHz 
GPU: AMD ATI Phoenix1 
Memory: 16326MiB / 59975MiB 

Date: 2024-03-06
Commit: 96ad434808
Dev full:

real	3m9.083s
user	37m53.347s
sys	2m5.348s

Dev incremental:

real	0m18.468s
user	0m32.099s
sys	0m10.763s

Release full:

real	4m22.878s
user	58m32.987s
sys	1m57.165s

Release incremental:

real	2m23.608s
user	33m56.817s
sys	0m43.506s

@elsirion's AMD EPYC build server

OS: NixOS 23.11 
Host: ASRockRack EPYCD8 
Kernel: 6.1.68 
Uptime: 75 days, 9 hours, 35 mins
Packages: 423 (nix-system) 
Shell: bash 5.2.26 
Resolution: 1280x1024 
Terminal: /dev/pts/0 
CPU: AMD EPYC 7542 (64) @ 2.900GHz 
GPU: ASPEED Technology, Inc. ASPEED Graphics Family 
Memory: 5998MiB / 128682MiB 

Date: 2024-03-06
Commit: 348c4d3a7a
Dev full:

real	1m23.765s
user	35m40.398s
sys	1m51.891s

Dev incremental:

real	0m11.760s
user	0m26.651s
sys	0m9.277s

Release full:

real	2m2.462s
user	47m32.776s
sys	1m38.923s

Release incremental:

real	1m4.803s
user	26m18.556s
sys	0m29.847s

@m1sterc001guy's XEON desktop

jumoell@pop-os 
-------------- 
OS: Pop!_OS 22.04 LTS x86_64 
Host: Hewlett-Packard 212A 
Kernel: 6.2.6-76060206-generic 
Uptime: 47 days, 13 hours, 35 mins 
Packages: 2055 (dpkg), 52 (nix-default), 30 (flatpak) 
Shell: bash 5.2.26 
Resolution: 3840x2160 
DE: GNOME 42.5 
WM: Mutter 
WM Theme: Pop 
Theme: Pop-dark [GTK2/3] 
Icons: Pop [GTK2/3] 
Terminal: just 
CPU: Intel Xeon E5-2630 v3 (16) @ 2.400GHz 
GPU: NVIDIA Quadro K2200 
Memory: 43104MiB / 128713MiB 

Date: 2024-03-11
Commit: e08dd655ce
                       total    user     sys
Full  check   debug:  165.88 1577.36   83.77
Incr  check   debug:    8.26   13.18    4.41
Full  build   debug:  409.42 4219.54  183.74
Incr  build   debug:   44.58   55.40   17.39
Full  check release:  139.37  882.66   68.83
Incr  check release:   31.06   51.17    4.75
Full  build release:  513.49 6187.96  179.39
Incr  build release:  273.73 3470.64   68.70

dpc testing new output format

dpc@ren
-------
OS: NixOS 24.05.20240303.b8697e5 (Uakari) x86_64
Host: ASUSTeK COMPUTER INC. ROG STRIX B650E-I GAMING WIFI
Kernel: 6.7.7
Uptime: 1 day, 6 hours, 9 mins
CPU: AMD Ryzen 9 7950X3D (32) @ 5.759GHz
Memory: 20297MiB / 63510MiB

Date: 2024-03-11
Commit: 4b26cd23a3
                       total    user     sys
Full  check   debug:   33.83  438.50   38.83
Incr  check   debug:    2.93    3.76    2.37
Full  build   debug:   61.84 1114.34   83.12
Incr  build   debug:   10.18   18.33   10.36
Full  check release:   25.77  228.78   34.02
Incr  check release:    9.54   14.69    2.43
Full  build release:   76.84 1732.95   76.50
Incr  build release:   48.54 1042.74   27.82

@shaurya947 testing MSI Codex R2 B14NUD7-096US dual-boot w/ Fedora

OS: Fedora Linux 40 (Workstation Edition) x86_64 
Host: Micro-Star International Co., Ltd. PRO B760-VC WIFI 7 BULK (MS-7D98) 
Kernel: 6.8.9-300.fc40.x86_64 
Uptime: 1 hour, 16 mins 
Packages: 2029 (dnf), 50 (nix-user) 
Shell: bash 5.2.26 
Resolution: 1920x1080 
DE: GNOME 46.1 (Wayland) 
WM: Mutter 
WM Theme: Adwaita 
Theme: Adwaita [GTK2/3] 
Icons: Adwaita [GTK2/3] 
Terminal: just 
CPU: Intel i7-14700F (28) @ 5.300GHz 
GPU: NVIDIA GeForce RTX 4060 Ti 
Memory: 2945MiB / 31914MiB 

Date: 2024-05-10
Commit: 0cc73cc61
                       total    user     sys
Full  check   debug:   40.89  527.94   29.20
Incr  check   debug:    2.65    4.68    2.06
Full  build   debug:   91.22 1679.70   73.32
Incr  build   debug:   12.48   21.88    7.96
Full  check release:   29.54  284.59   27.28
Incr  check release:    9.77   17.58    2.26
Full  build release:  128.30 3120.37   72.43
Incr  build release:   86.66 2054.20   32.10
Clone this wiki locally