Table of contents

Logs

extra-stock-gcc-speed

extra-megane-gcc-speed

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-gcc-speed: 3.42s extra-megane-gcc-speed: 3.7s

cpu-time

extra-stock-gcc-speed: 1063.89s extra-megane-gcc-speed: 939.44s

major-gcs-time

extra-stock-gcc-speed: 54.41s extra-megane-gcc-speed: 20.21s

major-gcs

extra-stock-gcc-speed: 1546 extra-megane-gcc-speed: 280

minor-gcs

extra-stock-gcc-speed: 3035144 extra-megane-gcc-speed: 3036450

mutations

extra-stock-gcc-speed: 49381675 extra-megane-gcc-speed: 49381200

mutations-tracked

extra-stock-gcc-speed: 6839955 extra-megane-gcc-speed: 6854180

major-gcs

extra-stock-gcc-speed: 1546 extra-megane-gcc-speed: 280

max-live-heap

extra-stock-gcc-speed: 1.29 GiB extra-megane-gcc-speed: 1.22 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.04 1.0
base64 1.12 1.0
chicken-distfiles 1.07 1.0
jsmin 1.19 1.0
json 1.16 1.0
manual-labor 1.07 1.0
salmonella-diff 1.0 1.01
salmonella-html-report 1.08 1.0
xml 1.08 1.0

cpu-time

Program 0 1
awful 1.0 1.1
base64 FAIL FAIL
chicken-distfiles 1.0 1.16
jsmin 1.0 1.0
json 1.0 1.36
manual-labor 1.0 1.2
salmonella-diff 1.0 1.06
salmonella-html-report 1.0 1.01
xml 1.0 1.16

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.25 1.0
json 1.0 2.36
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 4.26

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.2
json 1.0 4.8
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 7.12

minor-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.37

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.2
json 1.0 4.8
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 7.12

max-live-heap

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.07
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-gcc-speed: 0.5s extra-megane-gcc-speed: 0.52s

cpu-time

extra-stock-gcc-speed: 9.35s extra-megane-gcc-speed: 8.49s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

base64

build-time

extra-stock-gcc-speed: 0.43s extra-megane-gcc-speed: 0.48s

cpu-time

FAIL

major-gcs-time

FAIL

major-gcs

FAIL

minor-gcs

FAIL

mutations

FAIL

mutations-tracked

FAIL

major-gcs

FAIL

max-live-heap

FAIL

chicken-distfiles

build-time

extra-stock-gcc-speed: 0.4s extra-megane-gcc-speed: 0.43s

cpu-time

extra-stock-gcc-speed: 48.28s extra-megane-gcc-speed: 41.59s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

jsmin

build-time

extra-stock-gcc-speed: 0.26s extra-megane-gcc-speed: 0.31s

cpu-time

extra-stock-gcc-speed: 0.62s extra-megane-gcc-speed: 0.61s

major-gcs-time

extra-stock-gcc-speed: 0.0s extra-megane-gcc-speed: 0.0s

major-gcs

extra-stock-gcc-speed: 6.6 extra-megane-gcc-speed: 3

minor-gcs

extra-stock-gcc-speed: 16939.4 extra-megane-gcc-speed: 16943

mutations

extra-stock-gcc-speed: 30 extra-megane-gcc-speed: 30

mutations-tracked

extra-stock-gcc-speed: 12 extra-megane-gcc-speed: 12

major-gcs

extra-stock-gcc-speed: 6.6 extra-megane-gcc-speed: 3

max-live-heap

extra-stock-gcc-speed: 1.11 MiB extra-megane-gcc-speed: 1.11 MiB

json

build-time

extra-stock-gcc-speed: 0.26s extra-megane-gcc-speed: 0.31s

cpu-time

extra-stock-gcc-speed: 10.07s extra-megane-gcc-speed: 7.4s

major-gcs-time

extra-stock-gcc-speed: 3.95s extra-megane-gcc-speed: 1.66s

major-gcs

extra-stock-gcc-speed: 62.5 extra-megane-gcc-speed: 13

minor-gcs

extra-stock-gcc-speed: 108646.5 extra-megane-gcc-speed: 108698

mutations

extra-stock-gcc-speed: 4910288 extra-megane-gcc-speed: 4910288

mutations-tracked

extra-stock-gcc-speed: 683816 extra-megane-gcc-speed: 685284

major-gcs

extra-stock-gcc-speed: 62.5 extra-megane-gcc-speed: 13

max-live-heap

extra-stock-gcc-speed: 99.89 MiB extra-megane-gcc-speed: 93.14 MiB

manual-labor

build-time

extra-stock-gcc-speed: 0.39s extra-megane-gcc-speed: 0.42s

cpu-time

extra-stock-gcc-speed: 1.45s extra-megane-gcc-speed: 1.2s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

salmonella-diff

build-time

extra-stock-gcc-speed: 0.42s extra-megane-gcc-speed: 0.41s

cpu-time

extra-stock-gcc-speed: 5.17s extra-megane-gcc-speed: 4.87s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

salmonella-html-report

build-time

extra-stock-gcc-speed: 0.39s extra-megane-gcc-speed: 0.42s

cpu-time

extra-stock-gcc-speed: 22.14s extra-megane-gcc-speed: 21.78s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

xml

build-time

extra-stock-gcc-speed: 0.33s extra-megane-gcc-speed: 0.36s

cpu-time

extra-stock-gcc-speed: 9.27s extra-megane-gcc-speed: 7.97s

major-gcs-time

extra-stock-gcc-speed: 1.48s extra-megane-gcc-speed: 0.34s

major-gcs

extra-stock-gcc-speed: 85.5 extra-megane-gcc-speed: 12

minor-gcs

extra-stock-gcc-speed: 177928.5 extra-megane-gcc-speed: 178004

mutations

extra-stock-gcc-speed: 27849.5 extra-megane-gcc-speed: 27802

mutations-tracked

extra-stock-gcc-speed: 167.5 extra-megane-gcc-speed: 122

major-gcs

extra-stock-gcc-speed: 85.5 extra-megane-gcc-speed: 12

max-live-heap

extra-stock-gcc-speed: 31.52 MiB extra-megane-gcc-speed: 31.52 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 3.3 4.03
base64 FAIL FAIL
chicken-distfiles 0.65 0.25
jsmin 0.16 0.51
json 11.05 0.29
manual-labor 0.11 2.9
salmonella-diff 0.3 0.51
salmonella-html-report 0.23 0.23
xml 1.79 0.08

major-gcs-time

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 51.85 10.99
json 24.26 0.18
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 10.77 0.29

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 13.88 0
json 5.6 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 7.6 0

minor-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0.0 0
json 0.0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.0 0

mutations

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.01 0

mutations-tracked

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 3.28 0

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 13.88 0
json 5.6 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 7.6 0

max-live-heap

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 4.11 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0