Skip to content

Add benchmark workflow#407

Draft
michelle-clayton-work wants to merge 6 commits intov2from
dev/mclayton/benchmark-workflow
Draft

Add benchmark workflow#407
michelle-clayton-work wants to merge 6 commits intov2from
dev/mclayton/benchmark-workflow

Conversation

@michelle-clayton-work
Copy link
Copy Markdown
Collaborator

@michelle-clayton-work michelle-clayton-work commented Mar 25, 2026

Test for now

@michelle-clayton-work michelle-clayton-work force-pushed the dev/mclayton/benchmark-workflow branch 7 times, most recently from a5e5456 to 97411ab Compare March 25, 2026 22:06
@michelle-clayton-work
Copy link
Copy Markdown
Collaborator Author

michelle-clayton-work commented Mar 26, 2026

/bench

@michelle-clayton-work michelle-clayton-work force-pushed the dev/mclayton/benchmark-workflow branch from 6652160 to 60501e4 Compare March 26, 2026 18:41
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmark Results

⚠️ Regressions detected (>= 5%, statistically significant)

✅ azl3-go1.25.x
✅ azl3-go1.26.x
❌ ubuntu-ubuntu-22.04-ossl3.0.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.637s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	60.681s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                642.9n ± 2%   639.9n ± 1%       ~ (p=0.383 n=7)
AES_Decrypt-4                804.4n ± 3%   815.8n ± 3%       ~ (p=0.620 n=7)
AESGCM_Open-4                1.524µ ± 2%   1.541µ ± 2%       ~ (p=0.096 n=7)
AESGCM_Seal-4                1.522µ ± 3%   1.531µ ± 2%       ~ (p=0.928 n=7)
Chacha20Poly1305/Open-64-4   1.955µ ± 1%   1.945µ ± 1%       ~ (p=0.104 n=7)
Chacha20Poly1305/Seal-64-4   1.956µ ± 3%   1.932µ ± 1%       ~ (p=0.456 n=7)
geomean                      1.289µ        1.291µ       +0.15%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.74Mi ± 2%   23.84Mi ± 1%       ~ (p=0.402 n=7)
AES_Decrypt-4                18.97Mi ± 3%   18.70Mi ± 3%       ~ (p=0.620 n=7)
AESGCM_Open-4                40.04Mi ± 2%   39.61Mi ± 2%       ~ (p=0.128 n=7)
AESGCM_Seal-4                40.09Mi ± 3%   39.85Mi ± 2%       ~ (p=0.928 n=7)
Chacha20Poly1305/Open-64-4   31.21Mi ± 1%   31.38Mi ± 1%       ~ (p=0.104 n=7)
Chacha20Poly1305/Seal-64-4   31.20Mi ± 3%   31.59Mi ± 1%       ~ (p=0.456 n=7)
geomean                      29.83Mi        29.78Mi       -0.16%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.0.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	59.876s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	60.220s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │              head.txt              │
                           │   sec/op    │    sec/op     vs base              │
AES_Encrypt-4                527.3n ± 2%   531.1n ± 22%       ~ (p=0.209 n=7)
AES_Decrypt-4                709.8n ± 4%   696.4n ±  4%       ~ (p=0.209 n=7)
AESGCM_Open-4                1.410µ ± 3%   1.420µ ±  1%       ~ (p=0.258 n=7)
AESGCM_Seal-4                1.365µ ± 4%   1.487µ ±  8%  +8.94% (p=0.035 n=7)
Chacha20Poly1305/Open-64-4   1.763µ ± 5%   1.739µ ±  3%       ~ (p=0.128 n=7)
Chacha20Poly1305/Seal-64-4   1.732µ ± 8%   1.757µ ±  1%  +1.44% (p=0.025 n=7)
geomean                      1.140µ        1.156µ        +1.37%

                           │   base.txt   │              head.txt               │
                           │     B/s      │      B/s       vs base              │
AES_Encrypt-4                28.93Mi ± 2%   28.73Mi ± 18%       ~ (p=0.209 n=7)
AES_Decrypt-4                21.50Mi ± 4%   21.91Mi ±  4%       ~ (p=0.209 n=7)
AESGCM_Open-4                43.30Mi ± 3%   42.97Mi ±  1%       ~ (p=0.209 n=7)
AESGCM_Seal-4                44.73Mi ± 4%   41.04Mi ±  9%  -8.25% (p=0.035 n=7)
Chacha20Poly1305/Open-64-4   34.63Mi ± 4%   35.10Mi ±  3%       ~ (p=0.128 n=7)
Chacha20Poly1305/Seal-64-4   35.24Mi ± 7%   34.73Mi ±  1%  -1.43% (p=0.025 n=7)
geomean                      33.72Mi        33.26Mi        -1.36%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.0.13-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.099s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.990s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                635.6n ± 1%   631.1n ± 2%       ~ (p=0.128 n=7)
AES_Decrypt-4                809.1n ± 7%   810.2n ± 1%       ~ (p=0.735 n=7)
AESGCM_Open-4                1.643µ ± 2%   1.636µ ± 2%       ~ (p=0.175 n=7)
AESGCM_Seal-4                1.580µ ± 2%   1.572µ ± 5%       ~ (p=0.804 n=7)
Chacha20Poly1305/Open-64-4   1.969µ ± 1%   1.984µ ± 2%       ~ (p=0.115 n=7)
Chacha20Poly1305/Seal-64-4   1.950µ ± 1%   1.950µ ± 2%       ~ (p=0.832 n=7)
geomean                      1.313µ        1.311µ       -0.12%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                24.00Mi ± 1%   24.18Mi ± 2%       ~ (p=0.128 n=7)
AES_Decrypt-4                18.85Mi ± 7%   18.84Mi ± 1%       ~ (p=0.730 n=7)
AESGCM_Open-4                37.16Mi ± 2%   37.32Mi ± 2%       ~ (p=0.175 n=7)
AESGCM_Seal-4                38.62Mi ± 2%   38.83Mi ± 5%       ~ (p=0.684 n=7)
Chacha20Poly1305/Open-64-4   30.99Mi ± 1%   30.76Mi ± 2%       ~ (p=0.102 n=7)
Chacha20Poly1305/Seal-64-4   31.31Mi ± 1%   31.29Mi ± 2%       ~ (p=0.737 n=7)
geomean                      29.28Mi        29.32Mi       +0.13%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.0.13-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.002s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	59.990s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                555.0n ± 1%   551.4n ± 1%       ~ (p=0.318 n=7)
AES_Decrypt-4                724.1n ± 1%   721.4n ± 1%       ~ (p=0.383 n=7)
AESGCM_Open-4                1.498µ ± 1%   1.510µ ± 1%       ~ (p=0.219 n=7)
AESGCM_Seal-4                1.424µ ± 2%   1.452µ ± 1%  +1.97% (p=0.004 n=7)
Chacha20Poly1305/Open-64-4   1.807µ ± 1%   1.812µ ± 1%       ~ (p=0.171 n=7)
Chacha20Poly1305/Seal-64-4   1.758µ ± 1%   1.772µ ± 1%  +0.80% (p=0.003 n=7)
geomean                      1.182µ        1.187µ       +0.47%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                27.49Mi ± 1%   27.68Mi ± 1%       ~ (p=0.318 n=7)
AES_Decrypt-4                21.08Mi ± 1%   21.15Mi ± 1%       ~ (p=0.402 n=7)
AESGCM_Open-4                40.74Mi ± 1%   40.42Mi ± 1%       ~ (p=0.219 n=7)
AESGCM_Seal-4                42.86Mi ± 1%   42.03Mi ± 1%  -1.94% (p=0.004 n=7)
Chacha20Poly1305/Open-64-4   33.77Mi ± 1%   33.68Mi ± 1%       ~ (p=0.197 n=7)
Chacha20Poly1305/Seal-64-4   34.71Mi ± 1%   34.45Mi ± 1%  -0.77% (p=0.002 n=7)
geomean                      32.54Mi        32.39Mi       -0.46%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.1.5-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.295s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.403s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                645.1n ± 4%   648.2n ± 7%       ~ (p=0.902 n=7)
AES_Decrypt-4                830.0n ± 1%   820.6n ± 2%       ~ (p=0.259 n=7)
AESGCM_Open-4                1.637µ ± 2%   1.607µ ± 1%  -1.83% (p=0.001 n=7)
AESGCM_Seal-4                1.566µ ± 1%   1.527µ ± 0%  -2.49% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   1.929µ ± 2%   1.937µ ± 1%       ~ (p=0.557 n=7)
Chacha20Poly1305/Seal-64-4   1.884µ ± 1%   1.896µ ± 4%  +0.64% (p=0.016 n=7)
geomean                      1.307µ        1.299µ       -0.66%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.65Mi ± 4%   23.54Mi ± 6%       ~ (p=0.902 n=7)
AES_Decrypt-4                18.39Mi ± 1%   18.60Mi ± 2%       ~ (p=0.245 n=7)
AESGCM_Open-4                37.29Mi ± 2%   37.98Mi ± 1%  +1.84% (p=0.001 n=7)
AESGCM_Seal-4                38.97Mi ± 1%   39.98Mi ± 0%  +2.59% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   31.64Mi ± 2%   31.52Mi ± 1%       ~ (p=0.557 n=7)
Chacha20Poly1305/Seal-64-4   32.39Mi ± 1%   32.19Mi ± 3%  -0.62% (p=0.017 n=7)
geomean                      29.41Mi        29.61Mi       +0.67%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.1.5-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.020s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	60.277s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 9V74 80-Core Processor                
                           │  base.txt   │              head.txt              │
                           │   sec/op    │    sec/op     vs base              │
AES_Encrypt-4                567.9n ± 2%   567.2n ±  3%       ~ (p=0.932 n=7)
AES_Decrypt-4                722.7n ± 6%   707.8n ± 13%       ~ (p=0.209 n=7)
AESGCM_Open-4                1.519µ ± 6%   1.518µ ±  1%       ~ (p=0.935 n=7)
AESGCM_Seal-4                1.441µ ± 1%   1.410µ ±  1%  -2.15% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   1.791µ ± 4%   1.775µ ±  1%       ~ (p=0.067 n=7)
Chacha20Poly1305/Seal-64-4   1.748µ ± 3%   1.722µ ±  1%  -1.49% (p=0.017 n=7)
geomean                      1.188µ        1.175µ        -1.13%

                           │   base.txt   │              head.txt               │
                           │     B/s      │      B/s       vs base              │
AES_Encrypt-4                26.87Mi ± 2%   26.90Mi ±  3%       ~ (p=0.932 n=7)
AES_Decrypt-4                21.11Mi ± 6%   21.55Mi ± 11%       ~ (p=0.222 n=7)
AESGCM_Open-4                40.18Mi ± 6%   40.21Mi ±  1%       ~ (p=0.976 n=7)
AESGCM_Seal-4                42.36Mi ± 1%   43.29Mi ±  1%  +2.18% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   34.07Mi ± 3%   34.39Mi ±  1%       ~ (p=0.067 n=7)
Chacha20Poly1305/Seal-64-4   34.92Mi ± 3%   35.44Mi ±  1%  +1.47% (p=0.017 n=7)
geomean                      32.36Mi        32.73Mi        +1.14%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.2.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	62.078s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.547s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                674.6n ± 4%   660.8n ± 2%  -2.05% (p=0.038 n=7)
AES_Decrypt-4                847.9n ± 1%   837.7n ± 1%       ~ (p=0.053 n=7)
AESGCM_Open-4                1.535µ ± 1%   1.541µ ± 1%       ~ (p=0.596 n=7)
AESGCM_Seal-4                1.482µ ± 1%   1.456µ ± 5%  -1.75% (p=0.035 n=7)
Chacha20Poly1305/Open-64-4   1.973µ ± 2%   1.971µ ± 1%       ~ (p=0.435 n=7)
Chacha20Poly1305/Seal-64-4   1.973µ ± 1%   1.958µ ± 1%  -0.76% (p=0.003 n=7)
geomean                      1.310µ        1.298µ       -0.92%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                22.62Mi ± 4%   23.09Mi ± 2%  +2.07% (p=0.041 n=7)
AES_Decrypt-4                18.00Mi ± 1%   18.22Mi ± 1%       ~ (p=0.058 n=7)
AESGCM_Open-4                39.76Mi ± 1%   39.62Mi ± 1%       ~ (p=0.619 n=7)
AESGCM_Seal-4                41.19Mi ± 1%   41.92Mi ± 5%  +1.78% (p=0.038 n=7)
Chacha20Poly1305/Open-64-4   30.94Mi ± 2%   30.97Mi ± 1%       ~ (p=0.456 n=7)
Chacha20Poly1305/Seal-64-4   30.94Mi ± 1%   31.18Mi ± 1%  +0.77% (p=0.003 n=7)
geomean                      29.34Mi        29.61Mi       +0.92%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.2.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.379s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	60.675s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                577.7n ± 2%   581.7n ± 1%       ~ (p=0.902 n=7)
AES_Decrypt-4                755.7n ± 2%   752.7n ± 0%       ~ (p=0.067 n=7)
AESGCM_Open-4                1.358µ ± 1%   1.349µ ± 1%       ~ (p=0.055 n=7)
AESGCM_Seal-4                1.353µ ± 1%   1.332µ ± 2%  -1.55% (p=0.024 n=7)
Chacha20Poly1305/Open-64-4   1.753µ ± 1%   1.745µ ± 7%       ~ (p=0.710 n=7)
Chacha20Poly1305/Seal-64-4   1.756µ ± 1%   1.723µ ± 6%       ~ (p=0.209 n=7)
geomean                      1.163µ        1.154µ       -0.71%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                26.42Mi ± 2%   26.23Mi ± 1%       ~ (p=0.876 n=7)
AES_Decrypt-4                20.19Mi ± 2%   20.28Mi ± 0%       ~ (p=0.061 n=7)
AESGCM_Open-4                44.95Mi ± 0%   45.24Mi ± 1%  +0.66% (p=0.050 n=7)
AESGCM_Seal-4                45.10Mi ± 1%   45.83Mi ± 2%  +1.63% (p=0.024 n=7)
Chacha20Poly1305/Open-64-4   34.83Mi ± 1%   34.97Mi ± 7%       ~ (p=0.644 n=7)
Chacha20Poly1305/Seal-64-4   34.76Mi ± 1%   35.43Mi ± 5%       ~ (p=0.209 n=7)
geomean                      33.07Mi        33.31Mi       +0.72%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.3.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.634s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.666s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                662.4n ± 4%   666.7n ± 5%       ~ (p=0.138 n=7)
AES_Decrypt-4                832.1n ± 2%   824.6n ± 1%  -0.90% (p=0.002 n=7)
AESGCM_Open-4                1.555µ ± 1%   1.543µ ± 1%       ~ (p=0.272 n=7)
AESGCM_Seal-4                1.467µ ± 1%   1.475µ ± 2%       ~ (p=0.176 n=7)
Chacha20Poly1305/Open-64-4   1.949µ ± 1%   1.946µ ± 1%       ~ (p=0.976 n=7)
Chacha20Poly1305/Seal-64-4   1.935µ ± 1%   1.990µ ± 8%  +2.84% (p=0.012 n=7)
geomean                      1.296µ        1.301µ       +0.36%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.03Mi ± 3%   22.89Mi ± 5%       ~ (p=0.138 n=7)
AES_Decrypt-4                18.34Mi ± 2%   18.50Mi ± 1%  +0.88% (p=0.002 n=7)
AESGCM_Open-4                39.26Mi ± 1%   39.57Mi ± 1%       ~ (p=0.272 n=7)
AESGCM_Seal-4                41.60Mi ± 1%   41.38Mi ± 2%       ~ (p=0.176 n=7)
Chacha20Poly1305/Open-64-4   31.32Mi ± 1%   31.36Mi ± 1%       ~ (p=1.000 n=7)
Chacha20Poly1305/Seal-64-4   31.54Mi ± 1%   30.67Mi ± 7%  -2.75% (p=0.012 n=7)
geomean                      29.66Mi        29.56Mi       -0.36%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.3.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	59.946s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	59.983s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                559.9n ± 1%   563.2n ± 2%       ~ (p=0.402 n=7)
AES_Decrypt-4                718.6n ± 5%   741.3n ± 8%  +3.16% (p=0.011 n=7)
AESGCM_Open-4                1.376µ ± 1%   1.363µ ± 1%  -0.94% (p=0.030 n=7)
AESGCM_Seal-4                1.325µ ± 2%   1.334µ ± 2%       ~ (p=0.056 n=7)
Chacha20Poly1305/Open-64-4   1.735µ ± 1%   1.740µ ± 4%  +0.29% (p=0.048 n=7)
Chacha20Poly1305/Seal-64-4   1.714µ ± 1%   1.724µ ± 1%       ~ (p=0.155 n=7)
geomean                      1.139µ        1.147µ       +0.72%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                27.26Mi ± 1%   27.09Mi ± 2%       ~ (p=0.402 n=7)
AES_Decrypt-4                21.24Mi ± 5%   20.58Mi ± 7%  -3.10% (p=0.011 n=7)
AESGCM_Open-4                44.36Mi ± 1%   44.78Mi ± 1%  +0.95% (p=0.023 n=7)
AESGCM_Seal-4                46.07Mi ± 2%   45.74Mi ± 2%       ~ (p=0.056 n=7)
Chacha20Poly1305/Open-64-4   35.19Mi ± 1%   35.08Mi ± 4%  -0.33% (p=0.034 n=7)
Chacha20Poly1305/Seal-64-4   35.61Mi ± 1%   35.39Mi ± 1%       ~ (p=0.135 n=7)
geomean                      33.77Mi        33.52Mi       -0.74%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.3.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.453s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.344s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │              head.txt              │
                           │   sec/op    │    sec/op     vs base              │
AES_Encrypt-4                647.6n ± 2%   654.6n ±  1%       ~ (p=0.165 n=7)
AES_Decrypt-4                830.1n ± 2%   841.2n ±  1%  +1.34% (p=0.026 n=7)
AESGCM_Open-4                1.536µ ± 1%   1.541µ ±  1%       ~ (p=0.831 n=7)
AESGCM_Seal-4                1.484µ ± 2%   1.489µ ±  1%       ~ (p=0.826 n=7)
Chacha20Poly1305/Open-64-4   1.954µ ± 1%   1.968µ ±  5%       ~ (p=0.512 n=7)
Chacha20Poly1305/Seal-64-4   1.942µ ± 1%   1.946µ ± 11%       ~ (p=0.456 n=7)
geomean                      1.292µ        1.301µ        +0.67%

                           │   base.txt   │              head.txt               │
                           │     B/s      │      B/s       vs base              │
AES_Encrypt-4                23.57Mi ± 2%   23.31Mi ±  1%       ~ (p=0.152 n=7)
AES_Decrypt-4                18.39Mi ± 2%   18.14Mi ±  1%  -1.35% (p=0.019 n=7)
AESGCM_Open-4                39.73Mi ± 1%   39.60Mi ±  1%       ~ (p=0.805 n=7)
AESGCM_Seal-4                41.13Mi ± 2%   40.99Mi ±  1%       ~ (p=0.932 n=7)
Chacha20Poly1305/Open-64-4   31.23Mi ± 1%   31.01Mi ±  5%       ~ (p=0.512 n=7)
Chacha20Poly1305/Seal-64-4   31.42Mi ± 1%   31.38Mi ± 10%       ~ (p=0.456 n=7)
geomean                      29.76Mi        29.56Mi        -0.66%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.3.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	59.684s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	59.874s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 9V74 80-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                564.1n ± 1%   562.4n ± 7%       ~ (p=0.710 n=7)
AES_Decrypt-4                703.0n ± 1%   707.1n ± 6%       ~ (p=0.535 n=7)
AESGCM_Open-4                1.357µ ± 2%   1.389µ ± 3%  +2.36% (p=0.007 n=7)
AESGCM_Seal-4                1.295µ ± 1%   1.337µ ± 4%  +3.24% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   1.756µ ± 1%   1.756µ ± 0%       ~ (p=0.691 n=7)
Chacha20Poly1305/Seal-64-4   1.730µ ± 1%   1.736µ ± 2%       ~ (p=0.477 n=7)
geomean                      1.133µ        1.145µ       +1.03%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                27.06Mi ± 1%   27.13Mi ± 6%       ~ (p=0.684 n=7)
AES_Decrypt-4                21.71Mi ± 1%   21.58Mi ± 6%       ~ (p=0.535 n=7)
AESGCM_Open-4                44.97Mi ± 2%   43.94Mi ± 3%  -2.29% (p=0.007 n=7)
AESGCM_Seal-4                47.12Mi ± 1%   45.66Mi ± 4%  -3.10% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   34.75Mi ± 1%   34.75Mi ± 0%       ~ (p=0.691 n=7)
Chacha20Poly1305/Seal-64-4   35.29Mi ± 1%   35.17Mi ± 2%       ~ (p=0.535 n=7)
geomean                      33.93Mi        33.59Mi       -1.01%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.4.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	62.083s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.836s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                734.5n ± 2%   726.8n ± 2%       ~ (p=0.535 n=7)
AES_Decrypt-4                897.6n ± 2%   898.5n ± 1%       ~ (p=0.535 n=7)
AESGCM_Open-4                1.597µ ± 2%   1.525µ ± 1%  -4.51% (p=0.001 n=7)
AESGCM_Seal-4                1.484µ ± 3%   1.492µ ± 2%       ~ (p=0.647 n=7)
Chacha20Poly1305/Open-64-4   2.000µ ± 1%   2.044µ ± 2%  +2.20% (p=0.002 n=7)
Chacha20Poly1305/Seal-64-4   2.022µ ± 1%   2.053µ ± 1%  +1.53% (p=0.026 n=7)
geomean                      1.360µ        1.357µ       -0.22%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                20.77Mi ± 2%   21.00Mi ± 2%       ~ (p=0.513 n=7)
AES_Decrypt-4                17.00Mi ± 2%   16.98Mi ± 1%       ~ (p=0.509 n=7)
AESGCM_Open-4                38.22Mi ± 2%   40.04Mi ± 1%  +4.74% (p=0.001 n=7)
AESGCM_Seal-4                41.11Mi ± 3%   40.92Mi ± 2%       ~ (p=0.710 n=7)
Chacha20Poly1305/Open-64-4   30.52Mi ± 1%   29.86Mi ± 2%  -2.16% (p=0.002 n=7)
Chacha20Poly1305/Seal-64-4   30.19Mi ± 1%   29.73Mi ± 1%  -1.55% (p=0.026 n=7)
geomean                      28.28Mi        28.35Mi       +0.24%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.4.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.050s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	59.687s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                566.7n ± 2%   560.1n ± 1%  -1.16% (p=0.035 n=7)
AES_Decrypt-4                726.7n ± 2%   725.1n ± 1%       ~ (p=0.513 n=7)
AESGCM_Open-4                1.390µ ± 7%   1.388µ ± 1%       ~ (p=0.301 n=7)
AESGCM_Seal-4                1.359µ ± 1%   1.357µ ± 1%       ~ (p=0.930 n=7)
Chacha20Poly1305/Open-64-4   1.757µ ± 1%   1.749µ ± 1%       ~ (p=0.646 n=7)
Chacha20Poly1305/Seal-64-4   1.718µ ± 2%   1.717µ ± 0%       ~ (p=0.786 n=7)
geomean                      1.153µ        1.149µ       -0.37%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                26.92Mi ± 2%   27.25Mi ± 1%  +1.20% (p=0.029 n=7)
AES_Decrypt-4                21.00Mi ± 2%   21.05Mi ± 1%       ~ (p=0.518 n=7)
AESGCM_Open-4                43.91Mi ± 7%   43.96Mi ± 1%       ~ (p=0.318 n=7)
AESGCM_Seal-4                44.93Mi ± 1%   44.97Mi ± 1%       ~ (p=0.805 n=7)
Chacha20Poly1305/Open-64-4   34.74Mi ± 1%   34.89Mi ± 1%       ~ (p=0.737 n=7)
Chacha20Poly1305/Seal-64-4   35.53Mi ± 2%   35.55Mi ± 0%       ~ (p=0.829 n=7)
geomean                      33.35Mi        33.47Mi       +0.35%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.5.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.875s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.613s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: AMD EPYC 7763 64-Core Processor                
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                678.7n ± 4%   677.9n ± 1%       ~ (p=0.302 n=7)
AES_Decrypt-4                847.1n ± 1%   843.1n ± 3%       ~ (p=0.874 n=7)
AESGCM_Open-4                1.540µ ± 2%   1.536µ ± 2%       ~ (p=0.453 n=7)
AESGCM_Seal-4                1.472µ ± 1%   1.461µ ± 1%  -0.75% (p=0.007 n=7)
Chacha20Poly1305/Open-64-4   1.979µ ± 1%   1.943µ ± 3%       ~ (p=0.090 n=7)
Chacha20Poly1305/Seal-64-4   1.931µ ± 0%   1.919µ ± 1%       ~ (p=0.121 n=7)
geomean                      1.307µ        1.298µ       -0.67%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                22.49Mi ± 3%   22.51Mi ± 1%       ~ (p=0.315 n=7)
AES_Decrypt-4                18.01Mi ± 1%   18.10Mi ± 3%       ~ (p=0.876 n=7)
AESGCM_Open-4                39.63Mi ± 2%   39.74Mi ± 2%       ~ (p=0.365 n=7)
AESGCM_Seal-4                41.46Mi ± 1%   41.78Mi ± 1%  +0.78% (p=0.011 n=7)
Chacha20Poly1305/Open-64-4   30.84Mi ± 1%   31.41Mi ± 3%       ~ (p=0.097 n=7)
Chacha20Poly1305/Seal-64-4   31.60Mi ± 0%   31.81Mi ± 1%       ~ (p=0.121 n=7)
geomean                      29.42Mi        29.62Mi       +0.69%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-22.04-ossl3.5.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.478s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	60.384s
head: FAIL

Benchstat:

goos: linux
goarch: amd64
pkg: github.com/golang-fips/openssl/v2
cpu: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                635.4n ± 1%   631.2n ± 1%  -0.66% (p=0.002 n=7)
AES_Decrypt-4                731.2n ± 1%   726.3n ± 2%       ~ (p=0.805 n=7)
AESGCM_Open-4                1.352µ ± 2%   1.355µ ± 1%       ~ (p=0.789 n=7)
AESGCM_Seal-4                1.312µ ± 1%   1.308µ ± 1%       ~ (p=0.138 n=7)
Chacha20Poly1305/Open-64-4   1.823µ ± 1%   1.825µ ± 1%       ~ (p=0.476 n=7)
Chacha20Poly1305/Seal-64-4   1.777µ ± 3%   1.777µ ± 1%       ~ (p=0.828 n=7)
geomean                      1.178µ        1.175µ       -0.22%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                24.01Mi ± 1%   24.18Mi ± 1%  +0.68% (p=0.002 n=7)
AES_Decrypt-4                20.87Mi ± 1%   21.01Mi ± 2%       ~ (p=0.779 n=7)
AESGCM_Open-4                45.16Mi ± 2%   45.03Mi ± 1%       ~ (p=0.736 n=7)
AESGCM_Seal-4                46.52Mi ± 1%   46.67Mi ± 1%       ~ (p=0.138 n=7)
Chacha20Poly1305/Open-64-4   33.47Mi ± 1%   33.44Mi ± 1%       ~ (p=0.456 n=7)
Chacha20Poly1305/Seal-64-4   34.34Mi ± 3%   34.35Mi ± 1%       ~ (p=0.902 n=7)
geomean                      32.64Mi        32.72Mi       +0.22%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.0.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	63.480s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	63.423s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                774.3n ± 1%   766.3n ± 1%  -1.03% (p=0.001 n=7)
AES_Decrypt-4                989.7n ± 0%   989.2n ± 1%       ~ (p=1.000 n=7)
AESGCM_Open-4                1.739µ ± 1%   1.739µ ± 1%       ~ (p=0.548 n=7)
AESGCM_Seal-4                1.715µ ± 0%   1.711µ ± 1%       ~ (p=0.117 n=7)
Chacha20Poly1305/Open-64-4   2.193µ ± 0%   2.193µ ± 1%       ~ (p=1.000 n=7)
Chacha20Poly1305/Seal-64-4   2.129µ ± 1%   2.126µ ± 1%       ~ (p=0.829 n=7)
geomean                      1.484µ        1.480µ       -0.24%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.70Mi ± 1%   19.91Mi ± 1%  +1.06% (p=0.001 n=7)
AES_Decrypt-4                15.42Mi ± 0%   15.42Mi ± 1%       ~ (p=1.000 n=7)
AESGCM_Open-4                35.10Mi ± 1%   35.10Mi ± 0%       ~ (p=0.647 n=7)
AESGCM_Seal-4                35.58Mi ± 0%   35.66Mi ± 1%       ~ (p=0.156 n=7)
Chacha20Poly1305/Open-64-4   27.84Mi ± 0%   27.83Mi ± 1%       ~ (p=0.987 n=7)
Chacha20Poly1305/Seal-64-4   28.68Mi ± 1%   28.72Mi ± 1%       ~ (p=0.828 n=7)
geomean                      25.91Mi        25.97Mi       +0.23%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.0.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.089s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.156s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                630.6n ± 0%   630.4n ± 0%       ~ (p=1.000 n=7)
AES_Decrypt-4                819.0n ± 1%   818.8n ± 1%       ~ (p=0.596 n=7)
AESGCM_Open-4                1.496µ ± 0%   1.487µ ± 1%  -0.60% (p=0.006 n=7)
AESGCM_Seal-4                1.423µ ± 0%   1.420µ ± 1%       ~ (p=0.174 n=7)
Chacha20Poly1305/Open-64-4   1.915µ ± 0%   1.928µ ± 1%  +0.68% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   1.847µ ± 1%   1.855µ ± 1%  +0.43% (p=0.015 n=7)
geomean                      1.254µ        1.255µ       +0.04%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                24.19Mi ± 0%   24.20Mi ± 0%       ~ (p=1.000 n=7)
AES_Decrypt-4                18.63Mi ± 1%   18.63Mi ± 1%       ~ (p=0.534 n=7)
AESGCM_Open-4                40.79Mi ± 0%   41.04Mi ± 1%  +0.61% (p=0.007 n=7)
AESGCM_Seal-4                42.89Mi ± 0%   42.98Mi ± 1%       ~ (p=0.154 n=7)
Chacha20Poly1305/Open-64-4   31.87Mi ± 0%   31.65Mi ± 1%  -0.69% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   33.05Mi ± 1%   32.89Mi ± 1%  -0.49% (p=0.015 n=7)
geomean                      30.66Mi        30.65Mi       -0.05%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.0.13-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	63.379s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	63.340s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                766.2n ± 0%   766.7n ± 1%       ~ (p=0.779 n=7)
AES_Decrypt-4                982.5n ± 1%   977.5n ± 1%       ~ (p=0.209 n=7)
AESGCM_Open-4                1.728µ ± 0%   1.737µ ± 0%  +0.52% (p=0.001 n=7)
AESGCM_Seal-4                1.703µ ± 1%   1.706µ ± 1%       ~ (p=0.401 n=7)
Chacha20Poly1305/Open-64-4   2.206µ ± 1%   2.206µ ± 0%       ~ (p=0.734 n=7)
Chacha20Poly1305/Seal-64-4   2.171µ ± 1%   2.171µ ± 1%       ~ (p=0.258 n=7)
geomean                      1.482µ        1.483µ       +0.04%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.91Mi ± 0%   19.90Mi ± 1%       ~ (p=0.785 n=7)
AES_Decrypt-4                15.53Mi ± 1%   15.61Mi ± 1%       ~ (p=0.175 n=7)
AESGCM_Open-4                35.32Mi ± 0%   35.13Mi ± 0%  -0.54% (p=0.001 n=7)
AESGCM_Seal-4                35.83Mi ± 1%   35.78Mi ± 1%       ~ (p=0.513 n=7)
Chacha20Poly1305/Open-64-4   27.67Mi ± 1%   27.68Mi ± 0%       ~ (p=0.557 n=7)
Chacha20Poly1305/Seal-64-4   28.11Mi ± 1%   28.11Mi ± 1%       ~ (p=0.275 n=7)
geomean                      25.94Mi        25.93Mi       -0.02%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.0.13-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.116s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.101s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                635.9n ± 1%   633.5n ± 1%       ~ (p=0.556 n=7)
AES_Decrypt-4                807.7n ± 0%   807.3n ± 1%       ~ (p=0.875 n=7)
AESGCM_Open-4                1.488µ ± 1%   1.488µ ± 1%       ~ (p=0.642 n=7)
AESGCM_Seal-4                1.435µ ± 0%   1.424µ ± 1%  -0.77% (p=0.003 n=7)
Chacha20Poly1305/Open-64-4   1.891µ ± 0%   1.885µ ± 0%  -0.32% (p=0.034 n=7)
Chacha20Poly1305/Seal-64-4   1.848µ ± 1%   1.845µ ± 0%       ~ (p=0.727 n=7)
geomean                      1.251µ        1.247µ       -0.28%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.99Mi ± 1%   24.09Mi ± 1%       ~ (p=0.554 n=7)
AES_Decrypt-4                18.89Mi ± 0%   18.90Mi ± 1%       ~ (p=0.877 n=7)
AESGCM_Open-4                41.01Mi ± 1%   41.03Mi ± 1%       ~ (p=0.515 n=7)
AESGCM_Seal-4                42.51Mi ± 0%   42.86Mi ± 1%  +0.81% (p=0.004 n=7)
Chacha20Poly1305/Open-64-4   32.28Mi ± 0%   32.38Mi ± 0%  +0.30% (p=0.034 n=7)
Chacha20Poly1305/Seal-64-4   33.04Mi ± 1%   33.07Mi ± 0%       ~ (p=0.828 n=7)
geomean                      30.73Mi        30.82Mi       +0.29%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.1.5-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.173s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	63.560s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                771.4n ± 1%   769.3n ± 1%       ~ (p=0.165 n=7)
AES_Decrypt-4                994.8n ± 1%   996.3n ± 1%       ~ (p=0.710 n=7)
AESGCM_Open-4                1.776µ ± 0%   1.769µ ± 1%       ~ (p=0.068 n=7)
AESGCM_Seal-4                1.736µ ± 0%   1.733µ ± 1%       ~ (p=0.920 n=7)
Chacha20Poly1305/Open-64-4   2.204µ ± 0%   2.205µ ± 1%       ~ (p=0.726 n=7)
Chacha20Poly1305/Seal-64-4   2.161µ ± 0%   2.162µ ± 1%       ~ (p=0.873 n=7)
geomean                      1.497µ        1.496µ       -0.10%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.78Mi ± 1%   19.84Mi ± 1%       ~ (p=0.175 n=7)
AES_Decrypt-4                15.34Mi ± 1%   15.32Mi ± 1%       ~ (p=0.734 n=7)
AESGCM_Open-4                34.36Mi ± 0%   34.50Mi ± 1%       ~ (p=0.073 n=7)
AESGCM_Seal-4                35.16Mi ± 0%   35.22Mi ± 1%       ~ (p=0.920 n=7)
Chacha20Poly1305/Open-64-4   27.69Mi ± 0%   27.69Mi ± 1%       ~ (p=0.826 n=7)
Chacha20Poly1305/Seal-64-4   28.25Mi ± 0%   28.24Mi ± 1%       ~ (p=0.873 n=7)
geomean                      25.68Mi        25.71Mi       +0.11%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.1.5-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.167s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.281s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                643.4n ± 0%   641.5n ± 1%       ~ (p=0.053 n=7)
AES_Decrypt-4                809.9n ± 1%   811.3n ± 1%       ~ (p=0.220 n=7)
AESGCM_Open-4                1.535µ ± 0%   1.526µ ± 0%  -0.59% (p=0.003 n=7)
AESGCM_Seal-4                1.465µ ± 1%   1.468µ ± 1%       ~ (p=0.452 n=7)
Chacha20Poly1305/Open-64-4   1.933µ ± 0%   1.932µ ± 0%       ~ (p=0.874 n=7)
Chacha20Poly1305/Seal-64-4   1.868µ ± 0%   1.865µ ± 0%       ~ (p=0.173 n=7)
geomean                      1.272µ        1.270µ       -0.12%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.72Mi ± 0%   23.78Mi ± 1%  +0.28% (p=0.050 n=7)
AES_Decrypt-4                18.84Mi ± 1%   18.81Mi ± 1%       ~ (p=0.242 n=7)
AESGCM_Open-4                39.75Mi ± 0%   40.01Mi ± 1%  +0.65% (p=0.004 n=7)
AESGCM_Seal-4                41.68Mi ± 1%   41.58Mi ± 1%       ~ (p=0.474 n=7)
Chacha20Poly1305/Open-64-4   31.58Mi ± 0%   31.60Mi ± 0%       ~ (p=0.837 n=7)
Chacha20Poly1305/Seal-64-4   32.68Mi ± 0%   32.73Mi ± 0%       ~ (p=0.154 n=7)
geomean                      30.24Mi        30.27Mi       +0.12%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.2.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	55.208s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	56.441s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                785.1n ± 0%   790.8n ± 1%  +0.73% (p=0.002 n=7)
AES_Decrypt-4                1.006µ ± 0%   1.004µ ± 1%  -0.20% (p=0.009 n=7)
AESGCM_Open-4                1.674µ ± 1%   1.668µ ± 1%  -0.36% (p=0.029 n=7)
AESGCM_Seal-4                1.640µ ± 1%   1.632µ ± 0%       ~ (p=0.119 n=7)
Chacha20Poly1305/Open-64-4   2.193µ ± 0%   2.193µ ± 0%       ~ (p=0.927 n=7)
Chacha20Poly1305/Seal-64-4   2.147µ ± 0%   2.142µ ± 1%       ~ (p=0.431 n=7)
geomean                      1.473µ        1.472µ       -0.09%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.44Mi ± 0%   19.29Mi ± 1%  -0.74% (p=0.003 n=7)
AES_Decrypt-4                15.16Mi ± 0%   15.20Mi ± 1%  +0.25% (p=0.010 n=7)
AESGCM_Open-4                36.47Mi ± 1%   36.58Mi ± 1%  +0.31% (p=0.034 n=7)
AESGCM_Seal-4                37.22Mi ± 1%   37.40Mi ± 0%       ~ (p=0.128 n=7)
Chacha20Poly1305/Open-64-4   27.83Mi ± 0%   27.84Mi ± 0%       ~ (p=0.784 n=7)
Chacha20Poly1305/Seal-64-4   28.43Mi ± 0%   28.49Mi ± 1%       ~ (p=0.619 n=7)
geomean                      26.11Mi        26.13Mi       +0.09%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.2.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.386s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.415s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                657.3n ± 0%   661.1n ± 1%       ~ (p=0.175 n=7)
AES_Decrypt-4                825.5n ± 1%   829.3n ± 1%  +0.46% (p=0.034 n=7)
AESGCM_Open-4                1.447µ ± 0%   1.432µ ± 2%  -1.04% (p=0.023 n=7)
AESGCM_Seal-4                1.389µ ± 1%   1.389µ ± 1%       ~ (p=0.861 n=7)
Chacha20Poly1305/Open-64-4   1.935µ ± 0%   1.948µ ± 0%  +0.67% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   1.869µ ± 1%   1.892µ ± 1%  +1.23% (p=0.001 n=7)
geomean                      1.257µ        1.261µ       +0.31%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.21Mi ± 0%   23.08Mi ± 1%       ~ (p=0.175 n=7)
AES_Decrypt-4                18.48Mi ± 1%   18.40Mi ± 1%  -0.46% (p=0.033 n=7)
AESGCM_Open-4                42.17Mi ± 0%   42.64Mi ± 2%  +1.11% (p=0.023 n=7)
AESGCM_Seal-4                43.95Mi ± 1%   43.93Mi ± 1%       ~ (p=0.881 n=7)
Chacha20Poly1305/Open-64-4   31.54Mi ± 0%   31.33Mi ± 0%  -0.67% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   32.66Mi ± 1%   32.25Mi ± 1%  -1.26% (p=0.001 n=7)
geomean                      30.59Mi        30.49Mi       -0.32%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.3.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	63.641s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	55.516s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │              head.txt              │
                           │   sec/op    │    sec/op     vs base              │
AES_Encrypt-4                787.5n ± 1%    808.3n ± 1%  +2.64% (p=0.001 n=7)
AES_Decrypt-4                992.4n ± 1%   1022.0n ± 2%  +2.98% (p=0.001 n=7)
AESGCM_Open-4                1.687µ ± 0%    1.720µ ± 2%  +1.96% (p=0.001 n=7)
AESGCM_Seal-4                1.653µ ± 0%    1.675µ ± 1%  +1.33% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   2.210µ ± 0%    2.242µ ± 1%  +1.45% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   2.166µ ± 0%    2.193µ ± 0%  +1.25% (p=0.001 n=7)
geomean                      1.478µ         1.507µ       +1.93%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.38Mi ± 1%   18.87Mi ± 1%  -2.61% (p=0.001 n=7)
AES_Decrypt-4                15.37Mi ± 1%   14.93Mi ± 2%  -2.92% (p=0.001 n=7)
AESGCM_Open-4                36.18Mi ± 0%   35.50Mi ± 2%  -1.90% (p=0.001 n=7)
AESGCM_Seal-4                36.93Mi ± 1%   36.45Mi ± 1%  -1.29% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   27.61Mi ± 0%   27.23Mi ± 1%  -1.38% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   28.18Mi ± 0%   27.83Mi ± 0%  -1.25% (p=0.001 n=7)
geomean                      26.01Mi        25.52Mi       -1.89%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.3.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.607s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.514s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                667.7n ± 1%   658.8n ± 1%  -1.33% (p=0.001 n=7)
AES_Decrypt-4                842.6n ± 1%   836.9n ± 1%  -0.68% (p=0.012 n=7)
AESGCM_Open-4                1.484µ ± 1%   1.451µ ± 0%  -2.22% (p=0.001 n=7)
AESGCM_Seal-4                1.426µ ± 1%   1.401µ ± 1%  -1.75% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   1.954µ ± 0%   1.937µ ± 0%  -0.87% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   1.929µ ± 0%   1.906µ ± 2%  -1.19% (p=0.025 n=7)
geomean                      1.284µ        1.267µ       -1.34%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                22.85Mi ± 1%   23.16Mi ± 1%  +1.38% (p=0.001 n=7)
AES_Decrypt-4                18.11Mi ± 1%   18.23Mi ± 1%  +0.68% (p=0.009 n=7)
AESGCM_Open-4                41.11Mi ± 1%   42.08Mi ± 0%  +2.34% (p=0.001 n=7)
AESGCM_Seal-4                42.80Mi ± 1%   43.55Mi ± 1%  +1.76% (p=0.001 n=7)
Chacha20Poly1305/Open-64-4   31.23Mi ± 0%   31.51Mi ± 0%  +0.89% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   31.64Mi ± 0%   32.03Mi ± 2%  +1.24% (p=0.025 n=7)
geomean                      29.94Mi        30.35Mi       +1.38%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.3.1-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	60.011s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	59.958s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │              head.txt              │
                           │   sec/op    │    sec/op     vs base              │
AES_Encrypt-4                783.1n ± 0%    786.6n ± 1%  +0.45% (p=0.002 n=7)
AES_Decrypt-4                999.9n ± 0%   1004.0n ± 1%       ~ (p=0.078 n=7)
AESGCM_Open-4                1.666µ ± 1%    1.667µ ± 1%       ~ (p=0.932 n=7)
AESGCM_Seal-4                1.627µ ± 0%    1.626µ ± 1%       ~ (p=0.464 n=7)
Chacha20Poly1305/Open-64-4   2.201µ ± 0%    2.197µ ± 1%       ~ (p=0.739 n=7)
Chacha20Poly1305/Seal-64-4   2.154µ ± 0%    2.163µ ± 1%  +0.42% (p=0.019 n=7)
geomean                      1.469µ         1.472µ       +0.18%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.48Mi ± 0%   19.40Mi ± 1%  -0.44% (p=0.003 n=7)
AES_Decrypt-4                15.26Mi ± 0%   15.20Mi ± 1%       ~ (p=0.110 n=7)
AESGCM_Open-4                36.63Mi ± 1%   36.61Mi ± 1%       ~ (p=0.902 n=7)
AESGCM_Seal-4                37.51Mi ± 0%   37.54Mi ± 1%       ~ (p=0.533 n=7)
Chacha20Poly1305/Open-64-4   27.73Mi ± 0%   27.79Mi ± 1%       ~ (p=0.803 n=7)
Chacha20Poly1305/Seal-64-4   28.34Mi ± 0%   28.22Mi ± 1%  -0.44% (p=0.020 n=7)
geomean                      26.17Mi        26.12Mi       -0.17%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.3.1-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.411s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.367s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                659.5n ± 0%   657.8n ± 1%       ~ (p=0.383 n=7)
AES_Decrypt-4                828.8n ± 1%   821.6n ± 1%  -0.87% (p=0.035 n=7)
AESGCM_Open-4                1.444µ ± 2%   1.454µ ± 1%       ~ (p=0.135 n=7)
AESGCM_Seal-4                1.377µ ± 1%   1.376µ ± 1%       ~ (p=0.742 n=7)
Chacha20Poly1305/Open-64-4   1.927µ ± 0%   1.922µ ± 0%  -0.26% (p=0.008 n=7)
Chacha20Poly1305/Seal-64-4   1.883µ ± 0%   1.871µ ± 1%  -0.64% (p=0.008 n=7)
geomean                      1.257µ        1.254µ       -0.24%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                23.14Mi ± 0%   23.19Mi ± 1%       ~ (p=0.333 n=7)
AES_Decrypt-4                18.42Mi ± 1%   18.57Mi ± 1%  +0.83% (p=0.029 n=7)
AESGCM_Open-4                42.26Mi ± 2%   41.98Mi ± 1%       ~ (p=0.154 n=7)
AESGCM_Seal-4                44.32Mi ± 1%   44.36Mi ± 1%       ~ (p=0.781 n=7)
Chacha20Poly1305/Open-64-4   31.66Mi ± 0%   31.77Mi ± 0%  +0.33% (p=0.009 n=7)
Chacha20Poly1305/Seal-64-4   32.41Mi ± 0%   32.63Mi ± 1%  +0.68% (p=0.009 n=7)
geomean                      30.59Mi        30.66Mi       +0.26%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.4.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	57.707s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	62.435s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                788.1n ± 1%   786.6n ± 1%       ~ (p=0.209 n=7)
AES_Decrypt-4                1.002µ ± 0%   1.001µ ± 1%       ~ (p=0.303 n=7)
AESGCM_Open-4                1.680µ ± 1%   1.693µ ± 1%       ~ (p=0.132 n=7)
AESGCM_Seal-4                1.652µ ± 1%   1.648µ ± 1%       ~ (p=0.473 n=7)
Chacha20Poly1305/Open-64-4   2.203µ ± 0%   2.202µ ± 0%       ~ (p=1.000 n=7)
Chacha20Poly1305/Seal-64-4   2.170µ ± 0%   2.171µ ± 0%       ~ (p=0.644 n=7)
geomean                      1.479µ        1.480µ       +0.04%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                19.36Mi ± 1%   19.40Mi ± 1%       ~ (p=0.196 n=7)
AES_Decrypt-4                15.24Mi ± 0%   15.25Mi ± 1%       ~ (p=0.364 n=7)
AESGCM_Open-4                36.33Mi ± 1%   36.06Mi ± 1%       ~ (p=0.136 n=7)
AESGCM_Seal-4                36.95Mi ± 1%   37.04Mi ± 1%       ~ (p=0.364 n=7)
Chacha20Poly1305/Open-64-4   27.70Mi ± 0%   27.72Mi ± 0%       ~ (p=0.966 n=7)
Chacha20Poly1305/Seal-64-4   28.13Mi ± 0%   28.11Mi ± 0%       ~ (p=0.554 n=7)
geomean                      26.00Mi        25.99Mi       -0.04%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.4.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.648s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.481s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                663.8n ± 0%   659.3n ± 1%  -0.68% (p=0.001 n=7)
AES_Decrypt-4                850.6n ± 0%   846.8n ± 1%  -0.45% (p=0.013 n=7)
AESGCM_Open-4                1.466µ ± 1%   1.465µ ± 2%       ~ (p=0.558 n=7)
AESGCM_Seal-4                1.386µ ± 1%   1.393µ ± 1%       ~ (p=0.478 n=7)
Chacha20Poly1305/Open-64-4   1.933µ ± 0%   1.926µ ± 1%  -0.36% (p=0.020 n=7)
Chacha20Poly1305/Seal-64-4   1.894µ ± 0%   1.873µ ± 0%  -1.11% (p=0.001 n=7)
geomean                      1.270µ        1.266µ       -0.36%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                22.98Mi ± 0%   23.15Mi ± 1%  +0.71% (p=0.001 n=7)
AES_Decrypt-4                17.94Mi ± 0%   18.02Mi ± 1%  +0.48% (p=0.018 n=7)
AESGCM_Open-4                41.62Mi ± 1%   41.67Mi ± 2%       ~ (p=0.558 n=7)
AESGCM_Seal-4                44.04Mi ± 1%   43.82Mi ± 1%       ~ (p=0.435 n=7)
Chacha20Poly1305/Open-64-4   31.58Mi ± 0%   31.68Mi ± 1%  +0.33% (p=0.023 n=7)
Chacha20Poly1305/Seal-64-4   32.22Mi ± 0%   32.59Mi ± 0%  +1.12% (p=0.001 n=7)
geomean                      30.27Mi        30.38Mi       +0.37%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.5.0-go1.25.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	55.474s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	55.449s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                804.8n ± 1%   795.2n ± 1%  -1.19% (p=0.004 n=7)
AES_Decrypt-4                1.021µ ± 1%   1.014µ ± 1%  -0.69% (p=0.044 n=7)
AESGCM_Open-4                1.687µ ± 1%   1.667µ ± 1%  -1.19% (p=0.001 n=7)
AESGCM_Seal-4                1.667µ ± 1%   1.659µ ± 1%  -0.48% (p=0.041 n=7)
Chacha20Poly1305/Open-64-4   2.216µ ± 1%   2.223µ ± 0%       ~ (p=0.360 n=7)
Chacha20Poly1305/Seal-64-4   2.176µ ± 0%   2.178µ ± 1%       ~ (p=0.924 n=7)
geomean                      1.495µ        1.487µ       -0.52%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                18.96Mi ± 1%   19.19Mi ± 1%  +1.21% (p=0.003 n=7)
AES_Decrypt-4                14.94Mi ± 1%   15.06Mi ± 1%  +0.77% (p=0.049 n=7)
AESGCM_Open-4                36.19Mi ± 1%   36.62Mi ± 1%  +1.19% (p=0.001 n=7)
AESGCM_Seal-4                36.60Mi ± 1%   36.79Mi ± 1%  +0.52% (p=0.041 n=7)
Chacha20Poly1305/Open-64-4   27.55Mi ± 1%   27.46Mi ± 0%       ~ (p=0.365 n=7)
Chacha20Poly1305/Seal-64-4   28.05Mi ± 0%   28.03Mi ± 1%       ~ (p=0.976 n=7)
geomean                      25.73Mi        25.87Mi       +0.54%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean
❌ ubuntu-ubuntu-24.04-arm-ossl3.5.0-go1.26.x

Test failures:

base: FAIL	github.com/golang-fips/openssl/v2	61.472s
base: FAIL
head: FAIL	github.com/golang-fips/openssl/v2	61.793s
head: FAIL

Benchstat:

goos: linux
goarch: arm64
pkg: github.com/golang-fips/openssl/v2
                           │  base.txt   │             head.txt              │
                           │   sec/op    │   sec/op     vs base              │
AES_Encrypt-4                672.5n ± 0%   685.4n ± 1%  +1.92% (p=0.001 n=7)
AES_Decrypt-4                833.4n ± 1%   856.8n ± 1%  +2.81% (p=0.001 n=7)
AESGCM_Open-4                1.451µ ± 1%   1.447µ ± 1%  -0.28% (p=0.008 n=7)
AESGCM_Seal-4                1.396µ ± 1%   1.389µ ± 0%       ~ (p=0.215 n=7)
Chacha20Poly1305/Open-64-4   1.941µ ± 0%   1.970µ ± 0%  +1.49% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   1.884µ ± 0%   1.906µ ± 0%  +1.17% (p=0.001 n=7)
geomean                      1.268µ        1.282µ       +1.10%

                           │   base.txt   │              head.txt              │
                           │     B/s      │     B/s       vs base              │
AES_Encrypt-4                22.69Mi ± 0%   22.26Mi ± 1%  -1.89% (p=0.001 n=7)
AES_Decrypt-4                18.31Mi ± 1%   17.81Mi ± 1%  -2.76% (p=0.001 n=7)
AESGCM_Open-4                42.06Mi ± 1%   42.19Mi ± 1%  +0.32% (p=0.010 n=7)
AESGCM_Seal-4                43.71Mi ± 1%   43.95Mi ± 0%       ~ (p=0.139 n=7)
Chacha20Poly1305/Open-64-4   31.45Mi ± 0%   30.98Mi ± 0%  -1.49% (p=0.001 n=7)
Chacha20Poly1305/Seal-64-4   32.40Mi ± 0%   32.02Mi ± 0%  -1.15% (p=0.001 n=7)
geomean                      30.33Mi        30.00Mi       -1.08%

                           │   base.txt   │              head.txt              │
                           │     B/op     │    B/op     vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                           │   base.txt   │              head.txt              │
                           │  allocs/op   │ allocs/op   vs base                │
AES_Encrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AES_Decrypt-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Open-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
AESGCM_Seal-4                0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Open-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
Chacha20Poly1305/Seal-64-4   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                 ²               +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

@michelle-clayton-work michelle-clayton-work force-pushed the dev/mclayton/benchmark-workflow branch from 60501e4 to f28b9f1 Compare March 26, 2026 19:14
@michelle-clayton-work michelle-clayton-work force-pushed the dev/mclayton/benchmark-workflow branch from 0e766d0 to e604f95 Compare March 27, 2026 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@michelle-clayton-work