Table of contents

Logs

extra-stock-clang

extra-megane-clang

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-clang: 3.35s extra-megane-clang: 3.33s

cpu-time

extra-stock-clang: 935.9s extra-megane-clang: 855.57s

major-gcs-time

extra-stock-clang: 25.96s extra-megane-clang: 11.08s

major-gcs

extra-stock-clang: 1204 extra-megane-clang: 271

minor-gcs

extra-stock-clang: 2352246 extra-megane-clang: 2353259

mutations

extra-stock-clang: 49381580 extra-megane-clang: 49381204

mutations-tracked

extra-stock-clang: 5338430 extra-megane-clang: 5339684

major-gcs

extra-stock-clang: 1204 extra-megane-clang: 271

max-live-heap

extra-stock-clang: 1.29 GiB extra-megane-clang: 1.31 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.01
jsmin 1.0 1.02
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

cpu-time

Program 0 1
awful 1.0 1.09
base64 FAIL FAIL
chicken-distfiles 1.0 1.13
jsmin 1.0 1.01
json 1.0 1.2
manual-labor 1.0 1.11
salmonella-diff 1.0 1.06
salmonella-html-report 1.0 1.0
xml 1.0 1.08

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.31 1.0
json 1.0 2.12
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 3.0

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.05
json 1.0 3.84
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.64

minor-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.26

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.05
json 1.0 3.84
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.64

max-live-heap

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.02 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-clang: 0.47s extra-megane-clang: 0.47s

cpu-time

extra-stock-clang: 8.16s extra-megane-clang: 7.44s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

base64

build-time

extra-stock-clang: 0.42s extra-megane-clang: 0.42s

cpu-time

FAIL

major-gcs-time

FAIL

major-gcs

FAIL

minor-gcs

FAIL

mutations

FAIL

mutations-tracked

FAIL

major-gcs

FAIL

max-live-heap

FAIL

chicken-distfiles

build-time

extra-stock-clang: 0.39s extra-megane-clang: 0.39s

cpu-time

extra-stock-clang: 41.6s extra-megane-clang: 36.73s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

jsmin

build-time

extra-stock-clang: 0.28s extra-megane-clang: 0.28s

cpu-time

extra-stock-clang: 0.54s extra-megane-clang: 0.53s

major-gcs-time

extra-stock-clang: 0.0s extra-megane-clang: 0.0s

major-gcs

extra-stock-clang: 7 extra-megane-clang: 3.4

minor-gcs

extra-stock-clang: 13430 extra-megane-clang: 13433.6

mutations

extra-stock-clang: 30 extra-megane-clang: 30

mutations-tracked

extra-stock-clang: 12 extra-megane-clang: 12

major-gcs

extra-stock-clang: 7 extra-megane-clang: 3.4

max-live-heap

extra-stock-clang: 1.11 MiB extra-megane-clang: 1.11 MiB

json

build-time

extra-stock-clang: 0.28s extra-megane-clang: 0.28s

cpu-time

extra-stock-clang: 7.43s extra-megane-clang: 6.18s

major-gcs-time

extra-stock-clang: 1.75s extra-megane-clang: 0.82s

major-gcs

extra-stock-clang: 43.4 extra-megane-clang: 11.3

minor-gcs

extra-stock-clang: 84008.6 extra-megane-clang: 84044.7

mutations

extra-stock-clang: 4910288 extra-megane-clang: 4910288

mutations-tracked

extra-stock-clang: 533683 extra-megane-clang: 533839

major-gcs

extra-stock-clang: 43.4 extra-megane-clang: 11.3

max-live-heap

extra-stock-clang: 100.15 MiB extra-megane-clang: 102.44 MiB

manual-labor

build-time

extra-stock-clang: 0.39s extra-megane-clang: 0.39s

cpu-time

extra-stock-clang: 1.1s extra-megane-clang: 0.99s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

salmonella-diff

build-time

extra-stock-clang: 0.39s extra-megane-clang: 0.39s

cpu-time

extra-stock-clang: 4.54s extra-megane-clang: 4.27s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

salmonella-html-report

build-time

extra-stock-clang: 0.39s extra-megane-clang: 0.39s

cpu-time

extra-stock-clang: 22.09s extra-megane-clang: 21.91s

major-gcs-time

extra-stock-clang: 0s extra-megane-clang: 0s

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

minor-gcs

extra-stock-clang: 0 extra-megane-clang: 0

mutations

extra-stock-clang: 0 extra-megane-clang: 0

mutations-tracked

extra-stock-clang: 0 extra-megane-clang: 0

major-gcs

extra-stock-clang: 0 extra-megane-clang: 0

max-live-heap

extra-stock-clang: 0 bytes extra-megane-clang: 0 bytes

xml

build-time

extra-stock-clang: 0.3s extra-megane-clang: 0.3s

cpu-time

extra-stock-clang: 8.09s extra-megane-clang: 7.47s

major-gcs-time

extra-stock-clang: 0.83s extra-megane-clang: 0.27s

major-gcs

extra-stock-clang: 70 extra-megane-clang: 12.4

minor-gcs

extra-stock-clang: 137786 extra-megane-clang: 137847.6

mutations

extra-stock-clang: 27840 extra-megane-clang: 27802.4

mutations-tracked

extra-stock-clang: 148 extra-megane-clang: 117.4

major-gcs

extra-stock-clang: 70 extra-megane-clang: 12.4

max-live-heap

extra-stock-clang: 31.52 MiB extra-megane-clang: 31.52 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 1.5 0.31
base64 FAIL FAIL
chicken-distfiles 0.56 0.28
jsmin 0.89 0.25
json 4.94 1.42
manual-labor 0.18 0.2
salmonella-diff 1.22 0.68
salmonella-html-report 0.87 0.99
xml 0.82 0.22

major-gcs-time

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 33.65 9.52
json 15.85 9.2
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 1.05 14.87

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 14.28 14.4
json 1.12 4.05
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 3.49 3.95

minor-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0.0 0.0
json 0.0 0.0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.0 0.0

mutations

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0.0

mutations-tracked

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0.41

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 14.28 14.4
json 1.12 4.05
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 3.49 3.95

max-live-heap

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 5.26 5.59
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0