Table of contents

Logs

extra-stock-clang-speed

extra-megane-clang-speed

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-clang-speed: 3.39s extra-megane-clang-speed: 3.7s

cpu-time

extra-stock-clang-speed: 924.96s extra-megane-clang-speed: 859.07s

major-gcs-time

extra-stock-clang-speed: 26.18s extra-megane-clang-speed: 12.12s

major-gcs

extra-stock-clang-speed: 1218 extra-megane-clang-speed: 273

minor-gcs

extra-stock-clang-speed: 2351272 extra-megane-clang-speed: 2352257

mutations

extra-stock-clang-speed: 49381594 extra-megane-clang-speed: 49381202

mutations-tracked

extra-stock-clang-speed: 5337034 extra-megane-clang-speed: 5344182

major-gcs

extra-stock-clang-speed: 1218 extra-megane-clang-speed: 273

max-live-heap

extra-stock-clang-speed: 1.31 GiB extra-megane-clang-speed: 1.24 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.05 1.0
base64 1.09 1.0
chicken-distfiles 1.1 1.0
jsmin 1.11 1.0
json 1.15 1.0
manual-labor 1.06 1.0
salmonella-diff 1.08 1.0
salmonella-html-report 1.09 1.0
xml 1.09 1.0

cpu-time

Program 0 1
awful 1.0 1.04
base64 FAIL FAIL
chicken-distfiles 1.0 1.11
jsmin 1.0 1.0
json 1.0 1.17
manual-labor 1.0 1.12
salmonella-diff 1.0 1.04
salmonella-html-report 1.0 1.0
xml 1.0 1.08

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.21 1.0
json 1.0 1.88
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 3.15

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.0
json 1.0 3.56
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.98

minor-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.3

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.0
json 1.0 3.56
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 5.98

max-live-heap

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.07
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-clang-speed: 0.49s extra-megane-clang-speed: 0.52s

cpu-time

extra-stock-clang-speed: 8.32s extra-megane-clang-speed: 7.99s

major-gcs-time

extra-stock-clang-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-clang-speed: 0 bytes extra-megane-clang-speed: 0 bytes

base64

build-time

extra-stock-clang-speed: 0.42s extra-megane-clang-speed: 0.46s

cpu-time

FAIL

major-gcs-time

FAIL

major-gcs

FAIL

minor-gcs

FAIL

mutations

FAIL

mutations-tracked

FAIL

major-gcs

FAIL

max-live-heap

FAIL

chicken-distfiles

build-time

extra-stock-clang-speed: 0.39s extra-megane-clang-speed: 0.43s

cpu-time

extra-stock-clang-speed: 41.49s extra-megane-clang-speed: 37.25s

major-gcs-time

extra-stock-clang-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-clang-speed: 0 bytes extra-megane-clang-speed: 0 bytes

jsmin

build-time

extra-stock-clang-speed: 0.29s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-clang-speed: 0.5s extra-megane-clang-speed: 0.51s

major-gcs-time

extra-stock-clang-speed: 0.0s extra-megane-clang-speed: 0.0s

major-gcs

extra-stock-clang-speed: 6.4 extra-megane-clang-speed: 3.2

minor-gcs

extra-stock-clang-speed: 13325.6 extra-megane-clang-speed: 13328.8

mutations

extra-stock-clang-speed: 30 extra-megane-clang-speed: 30

mutations-tracked

extra-stock-clang-speed: 12 extra-megane-clang-speed: 12

major-gcs

extra-stock-clang-speed: 6.4 extra-megane-clang-speed: 3.2

max-live-heap

extra-stock-clang-speed: 1.11 MiB extra-megane-clang-speed: 1.11 MiB

json

build-time

extra-stock-clang-speed: 0.28s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-clang-speed: 7.06s extra-megane-clang-speed: 6.01s

major-gcs-time

extra-stock-clang-speed: 1.76s extra-megane-clang-speed: 0.93s

major-gcs

extra-stock-clang-speed: 42.4 extra-megane-clang-speed: 11.9

minor-gcs

extra-stock-clang-speed: 84016.6 extra-megane-clang-speed: 84049.1

mutations

extra-stock-clang-speed: 4910288 extra-megane-clang-speed: 4910288

mutations-tracked

extra-stock-clang-speed: 533541 extra-megane-clang-speed: 534291

major-gcs

extra-stock-clang-speed: 42.4 extra-megane-clang-speed: 11.9

max-live-heap

extra-stock-clang-speed: 102.28 MiB extra-megane-clang-speed: 94.87 MiB

manual-labor

build-time

extra-stock-clang-speed: 0.39s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-clang-speed: 1.1s extra-megane-clang-speed: 0.97s

major-gcs-time

extra-stock-clang-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-clang-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-diff

build-time

extra-stock-clang-speed: 0.39s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-clang-speed: 4.49s extra-megane-clang-speed: 4.28s

major-gcs-time

extra-stock-clang-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-clang-speed: 0 bytes extra-megane-clang-speed: 0 bytes

salmonella-html-report

build-time

extra-stock-clang-speed: 0.39s extra-megane-clang-speed: 0.42s

cpu-time

extra-stock-clang-speed: 21.74s extra-megane-clang-speed: 21.71s

major-gcs-time

extra-stock-clang-speed: 0s extra-megane-clang-speed: 0s

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

minor-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

mutations-tracked

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

major-gcs

extra-stock-clang-speed: 0 extra-megane-clang-speed: 0

max-live-heap

extra-stock-clang-speed: 0 bytes extra-megane-clang-speed: 0 bytes

xml

build-time

extra-stock-clang-speed: 0.3s extra-megane-clang-speed: 0.33s

cpu-time

extra-stock-clang-speed: 7.76s extra-megane-clang-speed: 7.14s

major-gcs-time

extra-stock-clang-speed: 0.84s extra-megane-clang-speed: 0.26s

major-gcs

extra-stock-clang-speed: 73 extra-megane-clang-speed: 12.2

minor-gcs

extra-stock-clang-speed: 137785 extra-megane-clang-speed: 137847.79

mutations

extra-stock-clang-speed: 27841.4 extra-megane-clang-speed: 27802.2

mutations-tracked

extra-stock-clang-speed: 150.4 extra-megane-clang-speed: 115.2

major-gcs

extra-stock-clang-speed: 73 extra-megane-clang-speed: 12.2

max-live-heap

extra-stock-clang-speed: 31.52 MiB extra-megane-clang-speed: 31.52 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 2.83 1.6
base64 FAIL FAIL
chicken-distfiles 0.61 0.21
jsmin 0.23 0.68
json 5.6 0.84
manual-labor 0.17 0.32
salmonella-diff 1.08 0.68
salmonella-html-report 0.91 0.89
xml 0.35 0.42

major-gcs-time

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 51.91 21.29
json 20.29 5.32
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.94 12.55

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 12.5 12.5
json 6.93 2.52
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 3.27

minor-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0.0 0.0
json 0.0 0.0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0.0

mutations

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.0 0.0

mutations-tracked

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.79 0.34

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 12.5 12.5
json 6.93 2.52
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 3.27

max-live-heap

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 5.2 3.91
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0