Table of contents

Logs

extra-stock-gcc

extra-megane-gcc

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-gcc: 3.29s extra-megane-gcc: 3.19s

cpu-time

extra-stock-gcc: 1194.73s extra-megane-gcc: 1055.51s

major-gcs-time

extra-stock-gcc: 51.13s extra-megane-gcc: 22.34s

major-gcs

extra-stock-gcc: 1428 extra-megane-gcc: 278

minor-gcs

extra-stock-gcc: 3064962 extra-megane-gcc: 3066152

mutations

extra-stock-gcc: 49381630 extra-megane-gcc: 49381200

mutations-tracked

extra-stock-gcc: 7210690 extra-megane-gcc: 7026330

major-gcs

extra-stock-gcc: 1428 extra-megane-gcc: 278

max-live-heap

extra-stock-gcc: 1.33 GiB extra-megane-gcc: 1.22 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.0 1.03
base64 1.0 1.01
chicken-distfiles 1.0 1.0
jsmin 1.0 1.02
json 1.0 1.0
manual-labor 1.0 1.09
salmonella-diff 1.0 1.02
salmonella-html-report 1.0 1.05
xml 1.0 1.01

cpu-time

Program 0 1
awful 1.0 1.12
base64 FAIL FAIL
chicken-distfiles 1.0 1.18
jsmin 1.0 1.0
json 1.0 1.26
manual-labor 1.0 1.13
salmonella-diff 1.0 1.05
salmonella-html-report 1.0 1.01
xml 1.0 1.13

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.53
json 1.0 1.92
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 4.08

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.78
json 1.0 4.07
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 6.83

minor-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.02
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.28

major-gcs

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.0 2.78
json 1.0 4.07
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 6.83

max-live-heap

Program 0 1
awful 1.0 1.0
base64 FAIL FAIL
chicken-distfiles 1.0 1.0
jsmin 1.05 1.0
json 1.0 1.12
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-gcc: 0.48s extra-megane-gcc: 0.46s

cpu-time

extra-stock-gcc: 9.74s extra-megane-gcc: 8.65s

major-gcs-time

extra-stock-gcc: 0s extra-megane-gcc: 0s

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

minor-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations-tracked

extra-stock-gcc: 0 extra-megane-gcc: 0

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-megane-gcc: 0 bytes

base64

build-time

extra-stock-gcc: 0.42s extra-megane-gcc: 0.41s

cpu-time

FAIL

major-gcs-time

FAIL

major-gcs

FAIL

minor-gcs

FAIL

mutations

FAIL

mutations-tracked

FAIL

major-gcs

FAIL

max-live-heap

FAIL

chicken-distfiles

build-time

extra-stock-gcc: 0.38s extra-megane-gcc: 0.38s

cpu-time

extra-stock-gcc: 52.98s extra-megane-gcc: 44.67s

major-gcs-time

extra-stock-gcc: 0s extra-megane-gcc: 0s

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

minor-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations-tracked

extra-stock-gcc: 0 extra-megane-gcc: 0

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-megane-gcc: 0 bytes

jsmin

build-time

extra-stock-gcc: 0.26s extra-megane-gcc: 0.25s

cpu-time

extra-stock-gcc: 0.8s extra-megane-gcc: 0.8s

major-gcs-time

extra-stock-gcc: 0.0s extra-megane-gcc: 0.0s

major-gcs

extra-stock-gcc: 7.8 extra-megane-gcc: 2.8

minor-gcs

extra-stock-gcc: 17345.2 extra-megane-gcc: 17350.2

mutations

extra-stock-gcc: 30 extra-megane-gcc: 30

mutations-tracked

extra-stock-gcc: 11 extra-megane-gcc: 11

major-gcs

extra-stock-gcc: 7.8 extra-megane-gcc: 2.8

max-live-heap

extra-stock-gcc: 1.04 MiB extra-megane-gcc: 1.1 MiB

json

build-time

extra-stock-gcc: 0.26s extra-megane-gcc: 0.26s

cpu-time

extra-stock-gcc: 10.61s extra-megane-gcc: 8.41s

major-gcs-time

extra-stock-gcc: 3.55s extra-megane-gcc: 1.85s

major-gcs

extra-stock-gcc: 53 extra-megane-gcc: 13

minor-gcs

extra-stock-gcc: 110384 extra-megane-gcc: 110426

mutations

extra-stock-gcc: 4910288 extra-megane-gcc: 4910288

mutations-tracked

extra-stock-gcc: 720888 extra-megane-gcc: 702490

major-gcs

extra-stock-gcc: 53 extra-megane-gcc: 13

max-live-heap

extra-stock-gcc: 103.92 MiB extra-megane-gcc: 92.77 MiB

manual-labor

build-time

extra-stock-gcc: 0.41s extra-megane-gcc: 0.38s

cpu-time

extra-stock-gcc: 1.7s extra-megane-gcc: 1.5s

major-gcs-time

extra-stock-gcc: 0s extra-megane-gcc: 0s

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

minor-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations-tracked

extra-stock-gcc: 0 extra-megane-gcc: 0

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-megane-gcc: 0 bytes

salmonella-diff

build-time

extra-stock-gcc: 0.38s extra-megane-gcc: 0.37s

cpu-time

extra-stock-gcc: 5.95s extra-megane-gcc: 5.62s

major-gcs-time

extra-stock-gcc: 0s extra-megane-gcc: 0s

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

minor-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations-tracked

extra-stock-gcc: 0 extra-megane-gcc: 0

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-megane-gcc: 0 bytes

salmonella-html-report

build-time

extra-stock-gcc: 0.39s extra-megane-gcc: 0.37s

cpu-time

extra-stock-gcc: 26.25s extra-megane-gcc: 25.84s

major-gcs-time

extra-stock-gcc: 0s extra-megane-gcc: 0s

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

minor-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations

extra-stock-gcc: 0 extra-megane-gcc: 0

mutations-tracked

extra-stock-gcc: 0 extra-megane-gcc: 0

major-gcs

extra-stock-gcc: 0 extra-megane-gcc: 0

max-live-heap

extra-stock-gcc: 0 bytes extra-megane-gcc: 0 bytes

xml

build-time

extra-stock-gcc: 0.28s extra-megane-gcc: 0.27s

cpu-time

extra-stock-gcc: 11.39s extra-megane-gcc: 10.02s

major-gcs-time

extra-stock-gcc: 1.55s extra-megane-gcc: 0.37s

major-gcs

extra-stock-gcc: 82 extra-megane-gcc: 12

minor-gcs

extra-stock-gcc: 178767 extra-megane-gcc: 178839

mutations

extra-stock-gcc: 27845 extra-megane-gcc: 27802

mutations-tracked

extra-stock-gcc: 170 extra-megane-gcc: 132

major-gcs

extra-stock-gcc: 82 extra-megane-gcc: 12

max-live-heap

extra-stock-gcc: 31.52 MiB extra-megane-gcc: 31.52 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 1.31 1.37
base64 FAIL FAIL
chicken-distfiles 0.99 0.16
jsmin 0.21 0.8
json 0.18 0.24
manual-labor 5.08 0.26
salmonella-diff 1.7 0.22
salmonella-html-report 0.17 0.17
xml 0.14 0.1

major-gcs-time

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 20.14 20.26
json 0.13 0.15
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.22 0.32

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 5.12 14.28
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

minor-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0.0 0.0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

mutations

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

mutations-tracked

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

major-gcs

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 5.12 14.28
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0

max-live-heap

Program 0 1
awful 0 0
base64 FAIL FAIL
chicken-distfiles 0 0
jsmin 3.43 3.26
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0