Table of contents

Logs

extra-stock-gcc

extra-stock-clang

extra-stock-gcc-speed

extra-stock-clang-speed

extra-megane-gcc

extra-megane-clang

extra-megane-gcc-speed

extra-megane-clang-speed

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-gcc: 3.29s extra-stock-clang: 3.35s extra-stock-gcc-speed: 3.42s extra-stock-clang-speed: 3.39s extra-megane-gcc: 3.19s extra-megane-clang: 3.33s extra-megane-gcc-speed: 3.7s extra-megane-clang-speed: 3.7s

cpu-time

extra-stock-gcc: 1194.73s extra-stock-clang: 935.9s extra-stock-gcc-speed: 1063.89s extra-stock-clang-speed: 924.96s extra-megane-gcc: 1055.51s extra-megane-clang: 855.57s extra-megane-gcc-speed: 939.44s extra-megane-clang-speed: 859.07s

major-gcs-time

extra-stock-gcc: 51.13s extra-stock-clang: 25.96s extra-stock-gcc-speed: 54.41s extra-stock-clang-speed: 26.18s extra-megane-gcc: 22.34s extra-megane-clang: 11.08s extra-megane-gcc-speed: 20.21s extra-megane-clang-speed: 12.12s

major-gcs

extra-stock-gcc: 1428 extra-stock-clang: 1204 extra-stock-gcc-speed: 1546 extra-stock-clang-speed: 1218 extra-megane-gcc: 278 extra-megane-clang: 271 extra-megane-gcc-speed: 280 extra-megane-clang-speed: 273

minor-gcs

extra-stock-gcc: 3064962 extra-stock-clang: 2352246 extra-stock-gcc-speed: 3035144 extra-stock-clang-speed: 2351272 extra-megane-gcc: 3066152 extra-megane-clang: 2353259 extra-megane-gcc-speed: 3036450 extra-megane-clang-speed: 2352257

mutations

extra-stock-gcc: 49381630 extra-stock-clang: 49381580 extra-stock-gcc-speed: 49381675 extra-stock-clang-speed: 49381594 extra-megane-gcc: 49381200 extra-megane-clang: 49381204 extra-megane-gcc-speed: 49381200 extra-megane-clang-speed: 49381202

mutations-tracked

extra-stock-gcc: 7210690 extra-stock-clang: 5338430 extra-stock-gcc-speed: 6839955 extra-stock-clang-speed: 5337034 extra-megane-gcc: 7026330 extra-megane-clang: 5339684 extra-megane-gcc-speed: 6854180 extra-megane-clang-speed: 5344182

major-gcs

extra-stock-gcc: 1428 extra-stock-clang: 1204 extra-stock-gcc-speed: 1546 extra-stock-clang-speed: 1218 extra-megane-gcc: 278 extra-megane-clang: 271 extra-megane-gcc-speed: 280 extra-megane-clang-speed: 273

max-live-heap

extra-stock-gcc: 1.33 GiB extra-stock-clang: 1.29 GiB extra-stock-gcc-speed: 1.29 GiB extra-stock-clang-speed: 1.31 GiB extra-megane-gcc: 1.22 GiB extra-megane-clang: 1.31 GiB extra-megane-gcc-speed: 1.22 GiB extra-megane-clang-speed: 1.24 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1 2 3 4 5 6 7
awful 1.08 1.1 1.04 1.06 1.12 1.11 1.0 1.0
base64 1.16 1.14 1.12 1.14 1.18 1.14 1.0 1.04
chicken-distfiles 1.13 1.09 1.09 1.1 1.14 1.11 1.01 1.0
jsmin 1.25 1.15 1.25 1.11 1.28 1.17 1.05 1.0
json 1.25 1.16 1.24 1.15 1.25 1.16 1.07 1.0
manual-labor 1.01 1.08 1.07 1.06 1.11 1.08 1.0 1.0
salmonella-diff 1.1 1.09 1.0 1.08 1.12 1.09 1.01 1.0
salmonella-html-report 1.09 1.09 1.09 1.09 1.14 1.09 1.0 1.0
xml 1.3 1.21 1.08 1.21 1.32 1.21 1.0 1.1

cpu-time

Program 0 1 2 3 4 5 6 7
awful 1.0 1.19 1.04 1.17 1.12 1.3 1.14 1.21
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.27 1.09 1.27 1.18 1.44 1.27 1.42
jsmin 1.0 1.48 1.29 1.58 1.0 1.5 1.3 1.57
json 1.0 1.42 1.05 1.5 1.26 1.71 1.43 1.76
manual-labor 1.0 1.53 1.17 1.54 1.13 1.71 1.41 1.74
salmonella-diff 1.0 1.31 1.15 1.32 1.05 1.39 1.22 1.38
salmonella-html-report 1.0 1.18 1.18 1.2 1.01 1.19 1.2 1.2
xml 1.0 1.4 1.22 1.46 1.13 1.52 1.42 1.59

major-gcs-time

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.96 1.61 1.96 1.53 1.49 1.28 1.61
json 1.11 2.24 1.0 2.23 2.13 4.78 2.36 4.2
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.85 1.04 1.82 4.08 5.57 4.44 5.75

major-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.11 1.18 1.21 2.78 2.29 2.6 2.43
json 1.17 1.44 1.0 1.47 4.8 5.53 4.8 5.25
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.04 1.22 1.0 1.17 7.12 6.89 7.12 7.0

minor-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.29 1.02 1.3 1.0 1.29 1.02 1.3
json 1.0 1.31 1.01 1.31 1.0 1.31 1.01 1.31
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.29 1.0 1.29 1.0 1.29 1.0 1.29

mutations

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
json 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0

mutations-tracked

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.09 1.0 1.0 1.0 1.09 1.0 1.0 1.0
json 1.0 1.35 1.05 1.35 1.02 1.35 1.05 1.34
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.14 1.01 1.13 1.28 1.44 1.39 1.47

major-gcs

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.0 1.11 1.18 1.21 2.78 2.29 2.6 2.43
json 1.17 1.44 1.0 1.47 4.8 5.53 4.8 5.25
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.04 1.22 1.0 1.17 7.12 6.89 7.12 7.0

max-live-heap

Program 0 1 2 3 4 5 6 7
awful 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
jsmin 1.06 1.0 1.0 1.0 1.01 1.0 1.0 1.0
json 1.0 1.03 1.04 1.01 1.12 1.01 1.11 1.09
manual-labor 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-diff 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
salmonella-html-report 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
xml 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0

Results by program

awful

build-time

extra-stock-gcc: 0.48s extra-stock-clang: 0.47s extra-stock-gcc-speed: 0.5s extra-stock-clang-speed: 0.49s extra-megane-gcc: 0.46s extra-megane-clang: 0.47s extra-megane-gcc-speed: 0.52s extra-megane-clang-speed: 0.52s

cpu-time

extra-stock-gcc: 9.74s extra-stock-clang: 8.16s extra-stock-gcc-speed: 9.35s extra-stock-clang-speed: 8.32s extra-megane-gcc: 8.65s extra-megane-clang: 7.44s extra-megane-gcc-speed: 8.49s extra-megane-clang-speed: 7.99s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

base64

build-time

extra-stock-gcc: 0.42s extra-stock-clang: 0.42s extra-stock-gcc-speed: 0.43s extra-stock-clang-speed: 0.42s extra-megane-gcc: 0.41s extra-megane-clang: 0.42s extra-megane-gcc-speed: 0.48s extra-megane-clang-speed: 0.46s

cpu-time

FAIL

major-gcs-time

FAIL

major-gcs

FAIL

minor-gcs

FAIL

mutations

FAIL

mutations-tracked

FAIL

major-gcs

FAIL

max-live-heap

FAIL

chicken-distfiles

build-time

extra-stock-gcc: 0.38s extra-stock-clang: 0.39s extra-stock-gcc-speed: 0.4s extra-stock-clang-speed: 0.39s extra-megane-gcc: 0.38s extra-megane-clang: 0.39s extra-megane-gcc-speed: 0.43s extra-megane-clang-speed: 0.43s

cpu-time

extra-stock-gcc: 52.98s extra-stock-clang: 41.6s extra-stock-gcc-speed: 48.28s extra-stock-clang-speed: 41.49s extra-megane-gcc: 44.67s extra-megane-clang: 36.73s extra-megane-gcc-speed: 41.59s extra-megane-clang-speed: 37.25s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

jsmin

build-time

extra-stock-gcc: 0.26s extra-stock-clang: 0.28s extra-stock-gcc-speed: 0.26s extra-stock-clang-speed: 0.29s extra-megane-gcc: 0.25s extra-megane-clang: 0.28s extra-megane-gcc-speed: 0.31s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-gcc: 0.8s extra-stock-clang: 0.54s extra-stock-gcc-speed: 0.62s extra-stock-clang-speed: 0.5s extra-megane-gcc: 0.8s extra-megane-clang: 0.53s extra-megane-gcc-speed: 0.61s extra-megane-clang-speed: 0.51s

major-gcs-time

extra-stock-gcc: 0.0s extra-stock-clang: 0.0s extra-stock-gcc-speed: 0.0s extra-stock-clang-speed: 0.0s extra-megane-gcc: 0.0s extra-megane-clang: 0.0s extra-megane-gcc-speed: 0.0s extra-megane-clang-speed: 0.0s

major-gcs

extra-stock-gcc: 7.8 extra-stock-clang: 7 extra-stock-gcc-speed: 6.6 extra-stock-clang-speed: 6.4 extra-megane-gcc: 2.8 extra-megane-clang: 3.4 extra-megane-gcc-speed: 3 extra-megane-clang-speed: 3.2

minor-gcs

extra-stock-gcc: 17345.2 extra-stock-clang: 13430 extra-stock-gcc-speed: 16939.4 extra-stock-clang-speed: 13325.6 extra-megane-gcc: 17350.2 extra-megane-clang: 13433.6 extra-megane-gcc-speed: 16943 extra-megane-clang-speed: 13328.8

mutations

extra-stock-gcc: 30 extra-stock-clang: 30 extra-stock-gcc-speed: 30 extra-stock-clang-speed: 30 extra-megane-gcc: 30 extra-megane-clang: 30 extra-megane-gcc-speed: 30 extra-megane-clang-speed: 30

mutations-tracked

extra-stock-gcc: 11 extra-stock-clang: 12 extra-stock-gcc-speed: 12 extra-stock-clang-speed: 12 extra-megane-gcc: 11 extra-megane-clang: 12 extra-megane-gcc-speed: 12 extra-megane-clang-speed: 12

major-gcs

extra-stock-gcc: 7.8 extra-stock-clang: 7 extra-stock-gcc-speed: 6.6 extra-stock-clang-speed: 6.4 extra-megane-gcc: 2.8 extra-megane-clang: 3.4 extra-megane-gcc-speed: 3 extra-megane-clang-speed: 3.2

max-live-heap

extra-stock-gcc: 1.04 MiB extra-stock-clang: 1.11 MiB extra-stock-gcc-speed: 1.11 MiB extra-stock-clang-speed: 1.11 MiB extra-megane-gcc: 1.1 MiB extra-megane-clang: 1.11 MiB extra-megane-gcc-speed: 1.11 MiB extra-megane-clang-speed: 1.11 MiB

json

build-time

extra-stock-gcc: 0.26s extra-stock-clang: 0.28s extra-stock-gcc-speed: 0.26s extra-stock-clang-speed: 0.28s extra-megane-gcc: 0.26s extra-megane-clang: 0.28s extra-megane-gcc-speed: 0.31s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-gcc: 10.61s extra-stock-clang: 7.43s extra-stock-gcc-speed: 10.07s extra-stock-clang-speed: 7.06s extra-megane-gcc: 8.41s extra-megane-clang: 6.18s extra-megane-gcc-speed: 7.4s extra-megane-clang-speed: 6.01s

major-gcs-time

extra-stock-gcc: 3.55s extra-stock-clang: 1.75s extra-stock-gcc-speed: 3.95s extra-stock-clang-speed: 1.76s extra-megane-gcc: 1.85s extra-megane-clang: 0.82s extra-megane-gcc-speed: 1.66s extra-megane-clang-speed: 0.93s

major-gcs

extra-stock-gcc: 53 extra-stock-clang: 43.4 extra-stock-gcc-speed: 62.5 extra-stock-clang-speed: 42.4 extra-megane-gcc: 13 extra-megane-clang: 11.3 extra-megane-gcc-speed: 13 extra-megane-clang-speed: 11.9

minor-gcs

extra-stock-gcc: 110384 extra-stock-clang: 84008.6 extra-stock-gcc-speed: 108646.5 extra-stock-clang-speed: 84016.6 extra-megane-gcc: 110426 extra-megane-clang: 84044.7 extra-megane-gcc-speed: 108698 extra-megane-clang-speed: 84049.1

mutations

extra-stock-gcc: 4910288 extra-stock-clang: 4910288 extra-stock-gcc-speed: 4910288 extra-stock-clang-speed: 4910288 extra-megane-gcc: 4910288 extra-megane-clang: 4910288 extra-megane-gcc-speed: 4910288 extra-megane-clang-speed: 4910288

mutations-tracked

extra-stock-gcc: 720888 extra-stock-clang: 533683 extra-stock-gcc-speed: 683816 extra-stock-clang-speed: 533541 extra-megane-gcc: 702490 extra-megane-clang: 533839 extra-megane-gcc-speed: 685284 extra-megane-clang-speed: 534291

major-gcs

extra-stock-gcc: 53 extra-stock-clang: 43.4 extra-stock-gcc-speed: 62.5 extra-stock-clang-speed: 42.4 extra-megane-gcc: 13 extra-megane-clang: 11.3 extra-megane-gcc-speed: 13 extra-megane-clang-speed: 11.9

max-live-heap

extra-stock-gcc: 103.92 MiB extra-stock-clang: 100.15 MiB extra-stock-gcc-speed: 99.89 MiB extra-stock-clang-speed: 102.28 MiB extra-megane-gcc: 92.77 MiB extra-megane-clang: 102.44 MiB extra-megane-gcc-speed: 93.14 MiB extra-megane-clang-speed: 94.87 MiB

manual-labor

build-time

extra-stock-gcc: 0.41s extra-stock-clang: 0.39s extra-stock-gcc-speed: 0.39s extra-stock-clang-speed: 0.39s extra-megane-gcc: 0.38s extra-megane-clang: 0.39s extra-megane-gcc-speed: 0.42s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-gcc: 1.7s extra-stock-clang: 1.1s extra-stock-gcc-speed: 1.45s extra-stock-clang-speed: 1.1s extra-megane-gcc: 1.5s extra-megane-clang: 0.99s extra-megane-gcc-speed: 1.2s extra-megane-clang-speed: 0.97s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-diff

build-time

extra-stock-gcc: 0.38s extra-stock-clang: 0.39s extra-stock-gcc-speed: 0.42s extra-stock-clang-speed: 0.39s extra-megane-gcc: 0.37s extra-megane-clang: 0.39s extra-megane-gcc-speed: 0.41s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-gcc: 5.95s extra-stock-clang: 4.54s extra-stock-gcc-speed: 5.17s extra-stock-clang-speed: 4.49s extra-megane-gcc: 5.62s extra-megane-clang: 4.27s extra-megane-gcc-speed: 4.87s extra-megane-clang-speed: 4.28s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-html-report

build-time

extra-stock-gcc: 0.39s extra-stock-clang: 0.39s extra-stock-gcc-speed: 0.39s extra-stock-clang-speed: 0.39s extra-megane-gcc: 0.37s extra-megane-clang: 0.39s extra-megane-gcc-speed: 0.42s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-gcc: 26.25s extra-stock-clang: 22.09s extra-stock-gcc-speed: 22.14s extra-stock-clang-speed: 21.74s extra-megane-gcc: 25.84s extra-megane-clang: 21.91s extra-megane-gcc-speed: 21.78s extra-megane-clang-speed: 21.71s

major-gcs-time

extra-stock-gcc: 0s extra-stock-clang: 0s extra-stock-gcc-speed: 0s extra-stock-clang-speed: 0s extra-megane-gcc: 0s extra-megane-clang: 0s extra-megane-gcc-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-gcc: 0 extra-stock-clang: 0 extra-stock-gcc-speed: 0 extra-stock-clang-speed: 0 extra-megane-gcc: 0 extra-megane-clang: 0 extra-megane-gcc-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-stock-clang: 0 bytes extra-stock-gcc-speed: 0 bytes extra-stock-clang-speed: 0 bytes extra-megane-gcc: 0 bytes extra-megane-clang: 0 bytes extra-megane-gcc-speed: 0 bytes extra-megane-clang-speed: 0 bytes

xml

build-time

extra-stock-gcc: 0.28s extra-stock-clang: 0.3s extra-stock-gcc-speed: 0.33s extra-stock-clang-speed: 0.3s extra-megane-gcc: 0.27s extra-megane-clang: 0.3s extra-megane-gcc-speed: 0.36s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-gcc: 11.39s extra-stock-clang: 8.09s extra-stock-gcc-speed: 9.27s extra-stock-clang-speed: 7.76s extra-megane-gcc: 10.02s extra-megane-clang: 7.47s extra-megane-gcc-speed: 7.97s extra-megane-clang-speed: 7.14s

major-gcs-time

extra-stock-gcc: 1.55s extra-stock-clang: 0.83s extra-stock-gcc-speed: 1.48s extra-stock-clang-speed: 0.84s extra-megane-gcc: 0.37s extra-megane-clang: 0.27s extra-megane-gcc-speed: 0.34s extra-megane-clang-speed: 0.26s

major-gcs

extra-stock-gcc: 82 extra-stock-clang: 70 extra-stock-gcc-speed: 85.5 extra-stock-clang-speed: 73 extra-megane-gcc: 12 extra-megane-clang: 12.4 extra-megane-gcc-speed: 12 extra-megane-clang-speed: 12.2

minor-gcs

extra-stock-gcc: 178767 extra-stock-clang: 137786 extra-stock-gcc-speed: 177928.5 extra-stock-clang-speed: 137785 extra-megane-gcc: 178839 extra-megane-clang: 137847.6 extra-megane-gcc-speed: 178004 extra-megane-clang-speed: 137847.79

mutations

extra-stock-gcc: 27845 extra-stock-clang: 27840 extra-stock-gcc-speed: 27849.5 extra-stock-clang-speed: 27841.4 extra-megane-gcc: 27802 extra-megane-clang: 27802.4 extra-megane-gcc-speed: 27802 extra-megane-clang-speed: 27802.2

mutations-tracked

extra-stock-gcc: 170 extra-stock-clang: 148 extra-stock-gcc-speed: 167.5 extra-stock-clang-speed: 150.4 extra-megane-gcc: 132 extra-megane-clang: 117.4 extra-megane-gcc-speed: 122 extra-megane-clang-speed: 115.2

major-gcs

extra-stock-gcc: 82 extra-stock-clang: 70 extra-stock-gcc-speed: 85.5 extra-stock-clang-speed: 73 extra-megane-gcc: 12 extra-megane-clang: 12.4 extra-megane-gcc-speed: 12 extra-megane-clang-speed: 12.2

max-live-heap

extra-stock-gcc: 31.52 MiB extra-stock-clang: 31.52 MiB extra-stock-gcc-speed: 31.52 MiB extra-stock-clang-speed: 31.52 MiB extra-megane-gcc: 31.52 MiB extra-megane-clang: 31.52 MiB extra-megane-gcc-speed: 31.52 MiB extra-megane-clang-speed: 31.52 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1 2 3 4 5 6 7
awful 1.31 1.5 3.3 2.83 1.37 0.31 4.03 1.6
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0.99 0.56 0.65 0.61 0.16 0.28 0.25 0.21
jsmin 0.21 0.89 0.16 0.23 0.8 0.25 0.51 0.68
json 0.18 4.94 11.05 5.6 0.24 1.42 0.29 0.84
manual-labor 5.08 0.18 0.11 0.17 0.26 0.2 2.9 0.32
salmonella-diff 1.7 1.22 0.3 1.08 0.22 0.68 0.51 0.68
salmonella-html-report 0.17 0.87 0.23 0.91 0.17 0.99 0.23 0.89
xml 0.14 0.82 1.79 0.35 0.1 0.22 0.08 0.42

major-gcs-time

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 20.14 33.65 51.85 51.91 20.26 9.52 10.99 21.29
json 0.13 15.85 24.26 20.29 0.15 9.2 0.18 5.32
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0.22 1.05 10.77 0.94 0.32 14.87 0.29 12.55

major-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 5.12 14.28 13.88 12.5 14.28 14.4 0 12.5
json 0 1.12 5.6 6.93 0 4.05 0 2.52
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 3.49 7.6 0 0 3.95 0 3.27

minor-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0.0 0.0 0.0 0.0 0.0 0.0 0 0.0
json 0 0.0 0.0 0.0 0 0.0 0 0.0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 0.0 0.0 0 0 0.0 0 0.0

mutations

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0 0 0 0 0 0 0 0
json 0 0 0 0 0 0 0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 0 0.01 0.0 0 0.0 0 0.0

mutations-tracked

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 0 0 0 0 0 0 0 0
json 0 0 0 0 0 0 0 0
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 0 3.28 0.79 0 0.41 0 0.34

major-gcs

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 5.12 14.28 13.88 12.5 14.28 14.4 0 12.5
json 0 1.12 5.6 6.93 0 4.05 0 2.52
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 3.49 7.6 0 0 3.95 0 3.27

max-live-heap

Program 0 1 2 3 4 5 6 7
awful 0 0 0 0 0 0 0 0
base64 FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
chicken-distfiles 0 0 0 0 0 0 0 0
jsmin 3.43 0 0 0 3.26 0 0 0
json 0 5.26 4.11 5.2 0 5.59 0 3.91
manual-labor 0 0 0 0 0 0 0 0
salmonella-diff 0 0 0 0 0 0 0 0
salmonella-html-report 0 0 0 0 0 0 0 0
xml 0 0 0 0 0 0 0 0