Table of contents

Logs

extra-stock-gcc-speed

extra-megane-gcc-speed

Overall benchmark results

This is the sum of all results of all programs, classified by metric.

build-time

extra-stock-gcc-speed: 2.33s extra-megane-gcc-speed: 2.38s

cpu-time

extra-stock-gcc-speed: 656.84s extra-megane-gcc-speed: 612.3s

major-gcs-time

extra-stock-gcc-speed: 23.16s extra-megane-gcc-speed: 11.31s

major-gcs

extra-stock-gcc-speed: 1410 extra-megane-gcc-speed: 372

minor-gcs

extra-stock-gcc-speed: 1137700 extra-megane-gcc-speed: 1138738

mutations

extra-stock-gcc-speed: 49217476 extra-megane-gcc-speed: 49217228

mutations-tracked

extra-stock-gcc-speed: 1956606 extra-megane-gcc-speed: 1956358

major-gcs

extra-stock-gcc-speed: 1410 extra-megane-gcc-speed: 372

max-live-heap

extra-stock-gcc-speed: 4.17 GiB extra-megane-gcc-speed: 4.06 GiB

Results by metric

In the tables below results are normalized (larger numbers indicate better results).

build-time

Program 0 1
awful 1.0 1.08
base64 1.0 1.03
chicken-distfiles 1.24 1.0
jsmin 1.0 1.03
json 1.0 1.07
manual-labor 1.01 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.1 1.0
xml 1.02 1.0

cpu-time

Program 0 1
awful 1.0 1.01
base64 1.0 1.03
chicken-distfiles 1.0 1.1
jsmin 1.0 1.0
json 1.0 1.28
manual-labor 1.0 1.02
salmonella-diff 1.0 1.05
salmonella-html-report 1.0 1.0
xml 1.0 1.09

major-gcs-time

Program 0 1
awful 1.0 1.0
base64 1.0 1.12
chicken-distfiles 1.0 1.0
jsmin 1.0 3.11
json 1.0 2.04
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 2.82

major-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.54
chicken-distfiles 1.0 1.0
jsmin 1.0 7.5
json 1.0 3.99
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 6.32

minor-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

mutations-tracked

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.0
json 1.0 1.0
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.27

major-gcs

Program 0 1
awful 1.0 1.0
base64 1.0 1.54
chicken-distfiles 1.0 1.0
jsmin 1.0 7.5
json 1.0 3.99
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 6.32

max-live-heap

Program 0 1
awful 1.0 1.0
base64 1.0 1.0
chicken-distfiles 1.0 1.0
jsmin 1.0 1.08
json 1.0 1.06
manual-labor 1.0 1.0
salmonella-diff 1.0 1.0
salmonella-html-report 1.0 1.0
xml 1.0 1.0

Results by program

awful

build-time

extra-stock-gcc-speed: 0.33s extra-megane-gcc-speed: 0.31s

cpu-time

extra-stock-gcc-speed: 4.48s extra-megane-gcc-speed: 4.43s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

base64

build-time

extra-stock-gcc-speed: 0.29s extra-megane-gcc-speed: 0.28s

cpu-time

extra-stock-gcc-speed: 5.14s extra-megane-gcc-speed: 4.98s

major-gcs-time

extra-stock-gcc-speed: 0.18s extra-megane-gcc-speed: 0.16s

major-gcs

extra-stock-gcc-speed: 23.2 extra-megane-gcc-speed: 15

minor-gcs

extra-stock-gcc-speed: 31939.8 extra-megane-gcc-speed: 31948

mutations

extra-stock-gcc-speed: 3808 extra-megane-gcc-speed: 3808

mutations-tracked

extra-stock-gcc-speed: 403 extra-megane-gcc-speed: 403

major-gcs

extra-stock-gcc-speed: 23.2 extra-megane-gcc-speed: 15

max-live-heap

extra-stock-gcc-speed: 172.95 MiB extra-megane-gcc-speed: 174.35 MiB

chicken-distfiles

build-time

extra-stock-gcc-speed: 0.26s extra-megane-gcc-speed: 0.33s

cpu-time

extra-stock-gcc-speed: 28.93s extra-megane-gcc-speed: 26.24s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

jsmin

build-time

extra-stock-gcc-speed: 0.19s extra-megane-gcc-speed: 0.19s

cpu-time

extra-stock-gcc-speed: 0.39s extra-megane-gcc-speed: 0.39s

major-gcs-time

extra-stock-gcc-speed: 0.0s extra-megane-gcc-speed: 0.0s

major-gcs

extra-stock-gcc-speed: 13.5 extra-megane-gcc-speed: 1.8

minor-gcs

extra-stock-gcc-speed: 4759.5 extra-megane-gcc-speed: 4771.2

mutations

extra-stock-gcc-speed: 30 extra-megane-gcc-speed: 30

mutations-tracked

extra-stock-gcc-speed: 14 extra-megane-gcc-speed: 14

major-gcs

extra-stock-gcc-speed: 13.5 extra-megane-gcc-speed: 1.8

max-live-heap

extra-stock-gcc-speed: 1.25 MiB extra-megane-gcc-speed: 1.14 MiB

json

build-time

extra-stock-gcc-speed: 0.19s extra-megane-gcc-speed: 0.18s

cpu-time

extra-stock-gcc-speed: 4.59s extra-megane-gcc-speed: 3.56s

major-gcs-time

extra-stock-gcc-speed: 1.58s extra-megane-gcc-speed: 0.77s

major-gcs

extra-stock-gcc-speed: 42.3 extra-megane-gcc-speed: 10.6

minor-gcs

extra-stock-gcc-speed: 30525.7 extra-megane-gcc-speed: 30557.4

mutations

extra-stock-gcc-speed: 4890085 extra-megane-gcc-speed: 4890085

mutations-tracked

extra-stock-gcc-speed: 195128 extra-megane-gcc-speed: 195128

major-gcs

extra-stock-gcc-speed: 42.3 extra-megane-gcc-speed: 10.6

max-live-heap

extra-stock-gcc-speed: 201.59 MiB extra-megane-gcc-speed: 188.89 MiB

manual-labor

build-time

extra-stock-gcc-speed: 0.27s extra-megane-gcc-speed: 0.28s

cpu-time

extra-stock-gcc-speed: 0.72s extra-megane-gcc-speed: 0.7s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

salmonella-diff

build-time

extra-stock-gcc-speed: 0.27s extra-megane-gcc-speed: 0.27s

cpu-time

extra-stock-gcc-speed: 2.98s extra-megane-gcc-speed: 2.83s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

salmonella-html-report

build-time

extra-stock-gcc-speed: 0.27s extra-megane-gcc-speed: 0.3s

cpu-time

extra-stock-gcc-speed: 13.69s extra-megane-gcc-speed: 13.74s

major-gcs-time

extra-stock-gcc-speed: 0s extra-megane-gcc-speed: 0s

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

minor-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

mutations-tracked

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

major-gcs

extra-stock-gcc-speed: 0 extra-megane-gcc-speed: 0

max-live-heap

extra-stock-gcc-speed: 0 bytes extra-megane-gcc-speed: 0 bytes

xml

build-time

extra-stock-gcc-speed: 0.21s extra-megane-gcc-speed: 0.21s

cpu-time

extra-stock-gcc-speed: 4.73s extra-megane-gcc-speed: 4.32s

major-gcs-time

extra-stock-gcc-speed: 0.54s extra-megane-gcc-speed: 0.19s

major-gcs

extra-stock-gcc-speed: 62 extra-megane-gcc-speed: 9.8

minor-gcs

extra-stock-gcc-speed: 46545 extra-megane-gcc-speed: 46597.2

mutations

extra-stock-gcc-speed: 27824.6 extra-megane-gcc-speed: 27799.8

mutations-tracked

extra-stock-gcc-speed: 115.6 extra-megane-gcc-speed: 90.8

major-gcs

extra-stock-gcc-speed: 62 extra-megane-gcc-speed: 9.8

max-live-heap

extra-stock-gcc-speed: 51.56 MiB extra-megane-gcc-speed: 51.56 MiB

Deviances by metric (raw percentages)

Deviances greater than 5% are highlighted.

cpu-time

Program 0 1
awful 1.06 1.23
base64 0.48 0.04
chicken-distfiles 0.46 0.36
jsmin 0.49 0.28
json 3.16 0.61
manual-labor 0.46 0.73
salmonella-diff 0.9 0.63
salmonella-html-report 0.41 0.65
xml 2.51 0.92

major-gcs-time

Program 0 1
awful 0 0
base64 18.38 0.83
chicken-distfiles 0 0
jsmin 46.25 37.66
json 8.48 0.48
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 14.71 1.02

major-gcs

Program 0 1
awful 0 0
base64 1.72 0
chicken-distfiles 0 0
jsmin 70.37 22.22
json 1.08 4.62
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 3.22 4.08

minor-gcs

Program 0 1
awful 0 0
base64 0.0 0
chicken-distfiles 0 0
jsmin 0.19 0.0
json 0.0 0.0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.0 0.0

mutations

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0.0 0.0

mutations-tracked

Program 0 1
awful 0 0
base64 0 0
chicken-distfiles 0 0
jsmin 0 0
json 0 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 1.03 0.44

major-gcs

Program 0 1
awful 0 0
base64 1.72 0
chicken-distfiles 0 0
jsmin 70.37 22.22
json 1.08 4.62
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 3.22 4.08

max-live-heap

Program 0 1
awful 0 0
base64 1.62 0
chicken-distfiles 0 0
jsmin 0 0
json 7.27 0
manual-labor 0 0
salmonella-diff 0 0
salmonella-html-report 0 0
xml 0 0