Table of contents

Logs

extra-stock-clang

extra-megane-clang

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-clang: 2.22s extra-megane-clang: 2.24s

cpu-time

extra-stock-clang: 619.08s extra-megane-clang: 578.33s

major-gcs-time

extra-stock-clang: 15.87s extra-megane-clang: 8.9s

major-gcs

extra-stock-clang: 1280 extra-megane-clang: 370

minor-gcs

extra-stock-clang: 1003170 extra-megane-clang: 1004080

mutations

extra-stock-clang: 49217440 extra-megane-clang: 49217230

mutations-tracked

extra-stock-clang: 1714470 extra-megane-clang: 1714260

major-gcs

extra-stock-clang: 1280 extra-megane-clang: 370

max-live-heap

extra-stock-clang: 4.1 GiB extra-megane-clang: 4.07 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.02 1.0
base64 1.0 1.02
chicken-distfiles 1.0 1.01
jsmin 1.01 1.0
json 1.0 1.01
manual-labor 1.12 1.0
salmonella-diff 1.0 1.01
salmonella-html-report 1.0 1.02
xml 1.02 1.0

cpu-time

Program 0 1
awful 1.0 1.02
base64 1.03 1.0
chicken-distfiles 1.0 1.09
jsmin 1.0 1.01
json 1.0 1.21
manual-labor 1.0 1.03
salmonella-diff 1.0 1.06
salmonella-html-report 1.0 1.05
xml 1.0 1.06

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 1.0 1.07
chicken-distfiles 1.0 1.0
jsmin 1.0 3.66
json 1.0 1.8
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 2.38

major-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.5
chicken-distfiles 1.0 1.0
jsmin 1.0 10.5
json 1.0 3.09
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.2

minor-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.24

major-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.5
chicken-distfiles 1.0 1.0
jsmin 1.0 10.5
json 1.0 3.09
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.2

max-live-heap

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.08
json 1.0 1.01
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-clang: 0.32s extra-megane-clang: 0.32s

cpu-time

extra-stock-clang: 4.34s extra-megane-clang: 4.25s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

base64

build-time

extra-stock-clang: 0.28s extra-megane-clang: 0.27s

cpu-time

extra-stock-clang: 4.67s extra-megane-clang: 4.84s

major-gcs-time

extra-stock-clang: 0.16s extra-megane-clang: 0.15s

major-gcs

extra-stock-clang: 21 extra-megane-clang: 14

minor-gcs

extra-stock-clang: 28260 extra-megane-clang: 28267

mutations

extra-stock-clang: 3808 extra-megane-clang: 3808

mutations-tracked

extra-stock-clang: 399 extra-megane-clang: 399

major-gcs

extra-stock-clang: 21 extra-megane-clang: 14

max-live-heap

extra-stock-clang: 175.1 MiB extra-megane-clang: 175.1 MiB

chicken-distfiles

build-time

extra-stock-clang: 0.26s extra-megane-clang: 0.25s

cpu-time

extra-stock-clang: 26.99s extra-megane-clang: 24.61s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

jsmin

build-time

extra-stock-clang: 0.19s extra-megane-clang: 0.19s

cpu-time

extra-stock-clang: 0.33s extra-megane-clang: 0.33s

major-gcs-time

extra-stock-clang: 0.0s extra-megane-clang: 0.0s

major-gcs

extra-stock-clang: 21 extra-megane-clang: 2

minor-gcs

extra-stock-clang: 4258 extra-megane-clang: 4277

mutations

extra-stock-clang: 30 extra-megane-clang: 30

mutations-tracked

extra-stock-clang: 15 extra-megane-clang: 15

major-gcs

extra-stock-clang: 21 extra-megane-clang: 2

max-live-heap

extra-stock-clang: 1.25 MiB extra-megane-clang: 1.14 MiB

json

build-time

extra-stock-clang: 0.19s extra-megane-clang: 0.19s

cpu-time

extra-stock-clang: 3.72s extra-megane-clang: 3.07s

major-gcs-time

extra-stock-clang: 1.05s extra-megane-clang: 0.58s

major-gcs

extra-stock-clang: 34 extra-megane-clang: 11

minor-gcs

extra-stock-clang: 26518 extra-megane-clang: 26541

mutations

extra-stock-clang: 4890085 extra-megane-clang: 4890085

mutations-tracked

extra-stock-clang: 170925 extra-megane-clang: 170925

major-gcs

extra-stock-clang: 34 extra-megane-clang: 11

max-live-heap

extra-stock-clang: 191.97 MiB extra-megane-clang: 189.32 MiB

manual-labor

build-time

extra-stock-clang: 0.25s extra-megane-clang: 0.28s

cpu-time

extra-stock-clang: 0.6s extra-megane-clang: 0.58s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

salmonella-diff

build-time

extra-stock-clang: 0.25s extra-megane-clang: 0.25s

cpu-time

extra-stock-clang: 2.99s extra-megane-clang: 2.8s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

salmonella-html-report

build-time

extra-stock-clang: 0.25s extra-megane-clang: 0.25s

cpu-time

extra-stock-clang: 14.02s extra-megane-clang: 13.35s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

xml

build-time

extra-stock-clang: 0.19s extra-megane-clang: 0.2s

cpu-time

extra-stock-clang: 4.21s extra-megane-clang: 3.97s

major-gcs-time

extra-stock-clang: 0.35s extra-megane-clang: 0.15s

major-gcs

extra-stock-clang: 52 extra-megane-clang: 10

minor-gcs

extra-stock-clang: 41281 extra-megane-clang: 41323

mutations

extra-stock-clang: 27821 extra-megane-clang: 27800

mutations-tracked

extra-stock-clang: 108 extra-megane-clang: 87

major-gcs

extra-stock-clang: 52 extra-megane-clang: 10

max-live-heap

extra-stock-clang: 51.56 MiB extra-megane-clang: 51.56 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 2.66 1.23
base64 0.11 0.05
chicken-distfiles 0.36 0.31
jsmin 0.32 0.6
json 0.71 0.28
manual-labor 2.21 2.17
salmonella-diff 0.29 0.62
salmonella-html-report 0.54 0.44
xml 0.29 0.3

major-gcs-time

Program 0 1
awful 0 0
base64 1.12 1.14
chicken-distfiles 0 0
jsmin 32.63 22.22
json 0.21 1.34
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 1.29 1.22

major-gcs

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

minor-gcs

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

mutations

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

mutations-tracked

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

major-gcs

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

max-live-heap

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0