Table of contents

Logs

extra-stock-gcc

extra-stock-clang

extra-stock-gcc-speed

extra-stock-clang-speed

extra-megane-gcc

extra-megane-clang

extra-megane-gcc-speed

extra-megane-clang-speed

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-gcc: 2.34s extra-stock-clang: 2.22s extra-stock-gcc-speed: 2.33s extra-stock-clang-speed: 2.23s extra-megane-gcc: 2.29s extra-megane-clang: 2.24s extra-megane-gcc-speed: 2.38s extra-megane-clang-speed: 2.22s

cpu-time

extra-stock-gcc: 755.5s extra-stock-clang: 619.08s extra-stock-gcc-speed: 656.84s extra-stock-clang-speed: 609.55s extra-megane-gcc: 685.88s extra-megane-clang: 578.33s extra-megane-gcc-speed: 612.3s extra-megane-clang-speed: 576.08s

major-gcs-time

extra-stock-gcc: 34.58s extra-stock-clang: 15.87s extra-stock-gcc-speed: 23.16s extra-stock-clang-speed: 14.06s extra-megane-gcc: 15.27s extra-megane-clang: 8.9s extra-megane-gcc-speed: 11.31s extra-megane-clang-speed: 8.98s

major-gcs

extra-stock-gcc: 1344 extra-stock-clang: 1280 extra-stock-gcc-speed: 1410 extra-stock-clang-speed: 1210 extra-megane-gcc: 382 extra-megane-clang: 370 extra-megane-gcc-speed: 372 extra-megane-clang-speed: 380

minor-gcs

extra-stock-gcc: 1119956 extra-stock-clang: 1003170 extra-stock-gcc-speed: 1137700 extra-stock-clang-speed: 1004850 extra-megane-gcc: 1120918 extra-megane-clang: 1004080 extra-megane-gcc-speed: 1138738 extra-megane-clang-speed: 1005680

mutations

extra-stock-gcc: 49217458 extra-stock-clang: 49217440 extra-stock-gcc-speed: 49217476 extra-stock-clang-speed: 49217380 extra-megane-gcc: 49217229 extra-megane-clang: 49217230 extra-megane-gcc-speed: 49217228 extra-megane-clang-speed: 49217230

mutations-tracked

extra-stock-gcc: 1891848 extra-stock-clang: 1714470 extra-stock-gcc-speed: 1956606 extra-stock-clang-speed: 1716330 extra-megane-gcc: 1891619 extra-megane-clang: 1714260 extra-megane-gcc-speed: 1956358 extra-megane-clang-speed: 1716180

major-gcs

extra-stock-gcc: 1344 extra-stock-clang: 1280 extra-stock-gcc-speed: 1410 extra-stock-clang-speed: 1210 extra-megane-gcc: 382 extra-megane-clang: 370 extra-megane-gcc-speed: 372 extra-megane-clang-speed: 380

max-live-heap

extra-stock-gcc: 4.23 GiB extra-stock-clang: 4.1 GiB extra-stock-gcc-speed: 4.17 GiB extra-stock-clang-speed: 4.09 GiB extra-megane-gcc: 4.07 GiB extra-megane-clang: 4.07 GiB extra-megane-gcc-speed: 4.06 GiB extra-megane-clang-speed: 4.06 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1 2 3 4 5 6 7
awful 1.01 1.05 1.0 1.06 1.09 1.02 1.08 1.07
base64 1.0 1.08 1.02 1.08 1.05 1.11 1.05 1.08
chicken-distfiles 1.15 1.26 1.24 1.28 1.21 1.29 1.0 1.27
jsmin 1.09 1.06 1.02 1.05 1.0 1.04 1.05 1.04
json 1.02 1.02 1.02 1.01 1.0 1.03 1.09 1.0
manual-labor 1.05 1.12 1.03 1.11 1.03 1.0 1.02 1.1
salmonella-diff 1.03 1.05 1.0 1.04 1.0 1.06 1.0 1.04
salmonella-html-report 1.08 1.17 1.1 1.16 1.14 1.21 1.0 1.2
xml 1.0 1.12 1.06 1.07 1.1 1.1 1.03 1.1

cpu-time

Program 0 1 2 3 4 5 6 7
awful 1.0 1.12 1.09 1.12 1.02 1.15 1.1 1.12
base64 1.0 1.13 1.03 1.11 1.0 1.09 1.06 1.16
chicken-distfiles 1.0 1.19 1.11 1.19 1.13 1.31 1.23 1.31
jsmin 1.0 1.52 1.29 1.6 1.0 1.53 1.29 1.62
json 1.0 1.59 1.28 1.62 1.34 1.92 1.65 1.94
manual-labor 1.0 1.57 1.3 1.66 1.03 1.63 1.34 1.72
salmonella-diff 1.0 1.24 1.24 1.23 1.09 1.32 1.31 1.31
salmonella-html-report 1.0 1.11 1.14 1.18 1.01 1.17 1.13 1.16
xml 1.0 1.48 1.32 1.58 1.14 1.58 1.45 1.61

major-gcs-time

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.0 1.24 1.12 1.27 1.12 1.33 1.26 1.33
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 3.14 1.0 1.24 1.34 3.3 3.66 3.88 3.66
json 1.0 2.13 1.42 2.28 2.08 3.86 2.91 3.94
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 2.76 1.83 3.93 3.87 6.57 5.17 5.82

major-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.06 1.1 1.0 1.1 1.6 1.65 1.54 1.54
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 5.83 1.0 1.55 1.0 11.05 10.5 11.66 10.5
json 1.01 1.24 1.0 1.03 3.55 3.84 3.99 3.84
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.29 1.08 1.76 6.78 6.72 6.85 6.72

minor-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.0 1.13 1.0 1.13 1.0 1.13 1.0 1.13
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.03 1.12 1.0 1.12 1.03 1.11 1.0 1.11
json 1.04 1.15 1.0 1.14 1.04 1.15 1.0 1.14
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.01 1.12 1.0 1.12 1.0 1.12 1.0 1.12

mutations

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
json 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0

mutations-tracked

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.0 1.01 1.0 1.01 1.0 1.01 1.0 1.01
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.07 1.0 1.07 1.0 1.07 1.0 1.07 1.0
json 1.03 1.14 1.0 1.14 1.03 1.14 1.0 1.14
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.06 1.07 1.0 1.05 1.34 1.32 1.27 1.21

major-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.06 1.1 1.0 1.1 1.6 1.65 1.54 1.54
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 5.83 1.0 1.55 1.0 11.05 10.5 11.66 10.5
json 1.01 1.24 1.0 1.03 3.55 3.84 3.99 3.84
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.29 1.08 1.76 6.78 6.72 6.85 6.72

max-live-heap

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 1.0 1.0 1.01 1.0 1.0 1.0 1.0 1.0
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.0 1.0 1.0 1.08 1.08 1.08 1.08
json 1.0 1.06 1.01 1.06 1.08 1.08 1.08 1.08
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0

Results by program

awful

build-time

extra-stock-gcc: 0.33s extra-stock-clang: 0.32s extra-stock-gcc-speed: 0.33s extra-stock-clang-speed: 0.31s extra-megane-gcc: 0.31s extra-megane-clang: 0.32s extra-megane-gcc-speed: 0.31s extra-megane-clang-speed: 0.31s

cpu-time

extra-stock-gcc: 4.89s extra-stock-clang: 4.34s extra-stock-gcc-speed: 4.48s extra-stock-clang-speed: 4.35s extra-megane-gcc: 4.79s extra-megane-clang: 4.25s extra-megane-gcc-speed: 4.43s extra-megane-clang-speed: 4.33s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

base64

build-time

extra-stock-gcc: 0.3s extra-stock-clang: 0.28s extra-stock-gcc-speed: 0.29s extra-stock-clang-speed: 0.28s extra-megane-gcc: 0.28s extra-megane-clang: 0.27s extra-megane-gcc-speed: 0.28s extra-megane-clang-speed: 0.28s

cpu-time

extra-stock-gcc: 5.32s extra-stock-clang: 4.67s extra-stock-gcc-speed: 5.14s extra-stock-clang-speed: 4.76s extra-megane-gcc: 5.28s extra-megane-clang: 4.84s extra-megane-gcc-speed: 4.98s extra-megane-clang-speed: 4.58s

major-gcs-time

extra-stock-gcc: 0.2s extra-stock-clang: 0.16s extra-stock-gcc-speed: 0.18s extra-stock-clang-speed: 0.16s extra-megane-gcc: 0.18s extra-megane-clang: 0.15s extra-megane-gcc-speed: 0.16s extra-megane-clang-speed: 0.15s

major-gcs

extra-stock-gcc: 21.8 extra-stock-clang: 21 extra-stock-gcc-speed: 23.2 extra-stock-clang-speed: 21 extra-megane-gcc: 14.5 extra-megane-clang: 14 extra-megane-gcc-speed: 15 extra-megane-clang-speed: 15

minor-gcs

extra-stock-gcc: 31930.2 extra-stock-clang: 28260 extra-stock-gcc-speed: 31939.8 extra-stock-clang-speed: 28264 extra-megane-gcc: 31937.5 extra-megane-clang: 28267 extra-megane-gcc-speed: 31948 extra-megane-clang-speed: 28270

mutations

extra-stock-gcc: 3808 extra-stock-clang: 3808 extra-stock-gcc-speed: 3808 extra-stock-clang-speed: 3808 extra-megane-gcc: 3808 extra-megane-clang: 3808 extra-megane-gcc-speed: 3808 extra-megane-clang-speed: 3808

mutations-tracked

extra-stock-gcc: 404 extra-stock-clang: 399 extra-stock-gcc-speed: 403 extra-stock-clang-speed: 399 extra-megane-gcc: 404 extra-megane-clang: 399 extra-megane-gcc-speed: 403 extra-megane-clang-speed: 399

major-gcs

extra-stock-gcc: 21.8 extra-stock-clang: 21 extra-stock-gcc-speed: 23.2 extra-stock-clang-speed: 21 extra-megane-gcc: 14.5 extra-megane-clang: 14 extra-megane-gcc-speed: 15 extra-megane-clang-speed: 15

max-live-heap

extra-stock-gcc: 175.67 MiB extra-stock-clang: 175.1 MiB extra-stock-gcc-speed: 172.95 MiB extra-stock-clang-speed: 174.43 MiB extra-megane-gcc: 175.75 MiB extra-megane-clang: 175.1 MiB extra-megane-gcc-speed: 174.35 MiB extra-megane-clang-speed: 174.43 MiB

chicken-distfiles

build-time

extra-stock-gcc: 0.28s extra-stock-clang: 0.26s extra-stock-gcc-speed: 0.26s extra-stock-clang-speed: 0.26s extra-megane-gcc: 0.27s extra-megane-clang: 0.25s extra-megane-gcc-speed: 0.33s extra-megane-clang-speed: 0.26s

cpu-time

extra-stock-gcc: 32.29s extra-stock-clang: 26.99s extra-stock-gcc-speed: 28.93s extra-stock-clang-speed: 27.07s extra-megane-gcc: 28.44s extra-megane-clang: 24.61s extra-megane-gcc-speed: 26.24s extra-megane-clang-speed: 24.56s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

jsmin

build-time

extra-stock-gcc: 0.18s extra-stock-clang: 0.19s extra-stock-gcc-speed: 0.19s extra-stock-clang-speed: 0.19s extra-megane-gcc: 0.2s extra-megane-clang: 0.19s extra-megane-gcc-speed: 0.19s extra-megane-clang-speed: 0.19s

cpu-time

extra-stock-gcc: 0.5s extra-stock-clang: 0.33s extra-stock-gcc-speed: 0.39s extra-stock-clang-speed: 0.31s extra-megane-gcc: 0.5s extra-megane-clang: 0.33s extra-megane-gcc-speed: 0.39s extra-megane-clang-speed: 0.31s

major-gcs-time

extra-stock-gcc: 0.0s extra-stock-clang: 0.0s extra-stock-gcc-speed: 0.0s extra-stock-clang-speed: 0.0s extra-megane-gcc: 0.0s extra-megane-clang: 0.0s extra-megane-gcc-speed: 0.0s extra-megane-clang-speed: 0.0s

major-gcs

extra-stock-gcc: 3.6 extra-stock-clang: 21 extra-stock-gcc-speed: 13.5 extra-stock-clang-speed: 21 extra-megane-gcc: 1.9 extra-megane-clang: 2 extra-megane-gcc-speed: 1.8 extra-megane-clang-speed: 2

minor-gcs

extra-stock-gcc: 4622.39 extra-stock-clang: 4258 extra-stock-gcc-speed: 4759.5 extra-stock-clang-speed: 4258 extra-megane-gcc: 4624.1 extra-megane-clang: 4277 extra-megane-gcc-speed: 4771.2 extra-megane-clang-speed: 4277

mutations

extra-stock-gcc: 30 extra-stock-clang: 30 extra-stock-gcc-speed: 30 extra-stock-clang-speed: 30 extra-megane-gcc: 30 extra-megane-clang: 30 extra-megane-gcc-speed: 30 extra-megane-clang-speed: 30

mutations-tracked

extra-stock-gcc: 14 extra-stock-clang: 15 extra-stock-gcc-speed: 14 extra-stock-clang-speed: 15 extra-megane-gcc: 14 extra-megane-clang: 15 extra-megane-gcc-speed: 14 extra-megane-clang-speed: 15

major-gcs

extra-stock-gcc: 3.6 extra-stock-clang: 21 extra-stock-gcc-speed: 13.5 extra-stock-clang-speed: 21 extra-megane-gcc: 1.9 extra-megane-clang: 2 extra-megane-gcc-speed: 1.8 extra-megane-clang-speed: 2

max-live-heap

extra-stock-gcc: 1.25 MiB extra-stock-clang: 1.25 MiB extra-stock-gcc-speed: 1.25 MiB extra-stock-clang-speed: 1.25 MiB extra-megane-gcc: 1.14 MiB extra-megane-clang: 1.14 MiB extra-megane-gcc-speed: 1.14 MiB extra-megane-clang-speed: 1.14 MiB

json

build-time

extra-stock-gcc: 0.19s extra-stock-clang: 0.19s extra-stock-gcc-speed: 0.19s extra-stock-clang-speed: 0.19s extra-megane-gcc: 0.2s extra-megane-clang: 0.19s extra-megane-gcc-speed: 0.18s extra-megane-clang-speed: 0.2s

cpu-time

extra-stock-gcc: 5.92s extra-stock-clang: 3.72s extra-stock-gcc-speed: 4.59s extra-stock-clang-speed: 3.63s extra-megane-gcc: 4.38s extra-megane-clang: 3.07s extra-megane-gcc-speed: 3.56s extra-megane-clang-speed: 3.04s

major-gcs-time

extra-stock-gcc: 2.25s extra-stock-clang: 1.05s extra-stock-gcc-speed: 1.58s extra-stock-clang-speed: 0.98s extra-megane-gcc: 1.08s extra-megane-clang: 0.58s extra-megane-gcc-speed: 0.77s extra-megane-clang-speed: 0.57s

major-gcs

extra-stock-gcc: 41.8 extra-stock-clang: 34 extra-stock-gcc-speed: 42.3 extra-stock-clang-speed: 41 extra-megane-gcc: 11.9 extra-megane-clang: 11 extra-megane-gcc-speed: 10.6 extra-megane-clang-speed: 11

minor-gcs

extra-stock-gcc: 29331.2 extra-stock-clang: 26518 extra-stock-gcc-speed: 30525.7 extra-stock-clang-speed: 26709 extra-megane-gcc: 29361.1 extra-megane-clang: 26541 extra-megane-gcc-speed: 30557.4 extra-megane-clang-speed: 26739

mutations

extra-stock-gcc: 4890085 extra-stock-clang: 4890085 extra-stock-gcc-speed: 4890085 extra-stock-clang-speed: 4890085 extra-megane-gcc: 4890085 extra-megane-clang: 4890085 extra-megane-gcc-speed: 4890085 extra-megane-clang-speed: 4890085

mutations-tracked

extra-stock-gcc: 188658 extra-stock-clang: 170925 extra-stock-gcc-speed: 195128 extra-stock-clang-speed: 171109 extra-megane-gcc: 188658 extra-megane-clang: 170925 extra-megane-gcc-speed: 195128 extra-megane-clang-speed: 171109

major-gcs

extra-stock-gcc: 41.8 extra-stock-clang: 34 extra-stock-gcc-speed: 42.3 extra-stock-clang-speed: 41 extra-megane-gcc: 11.9 extra-megane-clang: 11 extra-megane-gcc-speed: 10.6 extra-megane-clang-speed: 11

max-live-heap

extra-stock-gcc: 204.79 MiB extra-stock-clang: 191.97 MiB extra-stock-gcc-speed: 201.59 MiB extra-stock-clang-speed: 192 MiB extra-megane-gcc: 189.01 MiB extra-megane-clang: 189.32 MiB extra-megane-gcc-speed: 188.89 MiB extra-megane-clang-speed: 189.36 MiB

manual-labor

build-time

extra-stock-gcc: 0.27s extra-stock-clang: 0.25s extra-stock-gcc-speed: 0.27s extra-stock-clang-speed: 0.25s extra-megane-gcc: 0.27s extra-megane-clang: 0.28s extra-megane-gcc-speed: 0.28s extra-megane-clang-speed: 0.26s

cpu-time

extra-stock-gcc: 0.95s extra-stock-clang: 0.6s extra-stock-gcc-speed: 0.72s extra-stock-clang-speed: 0.57s extra-megane-gcc: 0.91s extra-megane-clang: 0.58s extra-megane-gcc-speed: 0.7s extra-megane-clang-speed: 0.55s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-diff

build-time

extra-stock-gcc: 0.26s extra-stock-clang: 0.25s extra-stock-gcc-speed: 0.27s extra-stock-clang-speed: 0.25s extra-megane-gcc: 0.27s extra-megane-clang: 0.25s extra-megane-gcc-speed: 0.27s extra-megane-clang-speed: 0.26s

cpu-time

extra-stock-gcc: 3.72s extra-stock-clang: 2.99s extra-stock-gcc-speed: 2.98s extra-stock-clang-speed: 3.01s extra-megane-gcc: 3.39s extra-megane-clang: 2.8s extra-megane-gcc-speed: 2.83s extra-megane-clang-speed: 2.82s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-html-report

build-time

extra-stock-gcc: 0.28s extra-stock-clang: 0.25s extra-stock-gcc-speed: 0.27s extra-stock-clang-speed: 0.26s extra-megane-gcc: 0.26s extra-megane-clang: 0.25s extra-megane-gcc-speed: 0.3s extra-megane-clang-speed: 0.25s

cpu-time

extra-stock-gcc: 15.65s extra-stock-clang: 14.02s extra-stock-gcc-speed: 13.69s extra-stock-clang-speed: 13.25s extra-megane-gcc: 15.36s extra-megane-clang: 13.35s extra-megane-gcc-speed: 13.74s extra-megane-clang-speed: 13.49s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

xml

build-time

extra-stock-gcc: 0.22s extra-stock-clang: 0.19s extra-stock-gcc-speed: 0.21s extra-stock-clang-speed: 0.2s extra-megane-gcc: 0.2s extra-megane-clang: 0.2s extra-megane-gcc-speed: 0.21s extra-megane-clang-speed: 0.2s

cpu-time

extra-stock-gcc: 6.27s extra-stock-clang: 4.21s extra-stock-gcc-speed: 4.73s extra-stock-clang-speed: 3.97s extra-megane-gcc: 5.48s extra-megane-clang: 3.97s extra-megane-gcc-speed: 4.32s extra-megane-clang-speed: 3.89s

major-gcs-time

extra-stock-gcc: 0.99s extra-stock-clang: 0.35s extra-stock-gcc-speed: 0.54s extra-stock-clang-speed: 0.25s extra-megane-gcc: 0.25s extra-megane-clang: 0.15s extra-megane-gcc-speed: 0.19s extra-megane-clang-speed: 0.17s

major-gcs

extra-stock-gcc: 67.2 extra-stock-clang: 52 extra-stock-gcc-speed: 62 extra-stock-clang-speed: 38 extra-megane-gcc: 9.9 extra-megane-clang: 10 extra-megane-gcc-speed: 9.8 extra-megane-clang-speed: 10

minor-gcs

extra-stock-gcc: 46111.8 extra-stock-clang: 41281 extra-stock-gcc-speed: 46545 extra-stock-clang-speed: 41254 extra-megane-gcc: 46169.1 extra-megane-clang: 41323 extra-megane-gcc-speed: 46597.2 extra-megane-clang-speed: 41282

mutations

extra-stock-gcc: 27822.8 extra-stock-clang: 27821 extra-stock-gcc-speed: 27824.6 extra-stock-clang-speed: 27815 extra-megane-gcc: 27799.9 extra-megane-clang: 27800 extra-megane-gcc-speed: 27799.8 extra-megane-clang-speed: 27800

mutations-tracked

extra-stock-gcc: 108.8 extra-stock-clang: 108 extra-stock-gcc-speed: 115.6 extra-stock-clang-speed: 110 extra-megane-gcc: 85.9 extra-megane-clang: 87 extra-megane-gcc-speed: 90.8 extra-megane-clang-speed: 95

major-gcs

extra-stock-gcc: 67.2 extra-stock-clang: 52 extra-stock-gcc-speed: 62 extra-stock-clang-speed: 38 extra-megane-gcc: 9.9 extra-megane-clang: 10 extra-megane-gcc-speed: 9.8 extra-megane-clang-speed: 10

max-live-heap

extra-stock-gcc: 51.56 MiB extra-stock-clang: 51.56 MiB extra-stock-gcc-speed: 51.56 MiB extra-stock-clang-speed: 51.56 MiB extra-megane-gcc: 51.56 MiB extra-megane-clang: 51.56 MiB extra-megane-gcc-speed: 51.56 MiB extra-megane-clang-speed: 51.56 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1 2 3 4 5 6 7
awful 1.11 2.66 1.06 0.41 1.12 1.23 1.23 3.54
base64 0.07 0.11 0.48 0.05 0.1 0.05 0.04 0.16
chicken-distfiles 0.45 0.36 0.46 0.31 0.29 0.31 0.36 0.3
jsmin 1.69 0.32 0.49 1.43 1.4 0.6 0.28 0.9
json 3.24 0.71 3.16 0.12 0.38 0.28 0.61 0.5
manual-labor 1.14 2.21 0.46 0.61 1.55 2.17 0.73 1.7
salmonella-diff 0.24 0.29 0.9 0.26 0.21 0.62 0.63 0.78
salmonella-html-report 0.37 0.54 0.41 0.24 0.29 0.44 0.65 0.34
xml 1.74 0.29 2.51 1.26 1.12 0.3 0.92 1.94

major-gcs-time

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 4.13 1.12 18.38 1.51 5.04 1.14 0.83 2.11
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 39.55 32.63 46.25 26.53 22.36 22.22 37.66 22.22
json 7.29 0.21 8.48 0.34 0.28 1.34 0.48 0.23
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 13.64 1.29 14.71 0.79 0.9 1.22 1.02 1.02

major-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 1.83 0 1.72 0 3.44 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 13.6 0 70.37 0 15.78 0 22.22 0
json 2.34 0 1.08 0 2.52 0 4.62 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 2.38 0 3.22 0 3.03 0 4.08 0

minor-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 0.0 0 0.0 0 0.0 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0.01 0 0.19 0 0.0 0 0.0 0
json 0.0 0 0.0 0 0.0 0 0.0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0.0 0 0.0 0 0.0 0 0.0 0

mutations

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 0 0 0 0 0 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0 0 0 0 0 0 0 0
json 0 0 0 0 0 0 0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0.0 0 0.0 0 0.0 0 0.0 0

mutations-tracked

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 0 0 0 0 0 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0 0 0 0 0 0 0 0
json 0 0 0 0 0 0 0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 1.47 0 1.03 0 0.34 0 0.44 0

major-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 1.83 0 1.72 0 3.44 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 13.6 0 70.37 0 15.78 0 22.22 0
json 2.34 0 1.08 0 2.52 0 4.62 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 2.38 0 3.22 0 3.03 0 4.08 0

max-live-heap

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 0.07 0 1.62 0 0.07 0 0 0
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0 0 0 0 0 0 0 0
json 7.65 0 7.27 0 0 0 0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 0 0 0 0 0 0 0