[Ostrich Benchmark] Z3 c3 branch — 2026-04-01

[github-actions[bot]]

Date: 2026-04-01
Branch: c3
Z3 version: 4.17.0 (commit f709f6d)
Benchmark set: Ostrich — all files from tests/ostrich.zip (299 benchmarks)
Timeout: 5 seconds per benchmark (-T:5 for Z3)
ZIPT: n/a — could not build (.NET bindings require NuGet network access, blocked by sandbox proxy)

---

Summary

Metric	seq solver	nseq solver	ZIPT solver
sat	198	170	n/a
unsat	75	73	n/a
unknown	26	28	n/a
timeout	0	0	n/a
bug/crash	0	28	n/a
Total solved (sat+unsat)	273	243	n/a
Total time (s)	107.793	78.879	n/a
Avg time/benchmark (s)	0.361	0.264	n/a

Note: The nseq solver returned bug for 28 benchmarks (error/crash output detected). The seq solver returned bug for 0 benchmarks.

Soundness disagreements (any two solvers return conflicting sat/unsat): 1

---

Notable Issues

⚠️ Soundness Disagreements (Critical)

• str-lt.smt2: seq=sat, nseq=unsat

🐛 Crashes / Bugs — nseq solver (28 files)

• bigSubstrIdx.smt2 (nseq)
• bug-56-replace-bug2.smt2 (nseq)
• concat_backjump_bug.smt2 (nseq)
• contains-7.smt2 (nseq)
• indexof-2.smt2 (nseq)
• indexof_const_index_unsat.smt2 (nseq)
• indexof_var_sat.smt2 (nseq)
• nikolai-sat.smt2 (nseq)
• norn-benchmark-9i.smt2 (nseq)
• parikh-constraints.smt2 (nseq)
• replace-length-2.smt2 (nseq)
• simple-replace-4.smt2 (nseq)
• simple-replace-4c.smt2 (nseq)
• slow-little.smt2 (nseq)
• str-leq12.smt2 (nseq)
• str-leq13.smt2 (nseq)
• str-leq3.smt2 (nseq)
• str-leq5.smt2 (nseq)
• str-leq7.smt2 (nseq)
• str-lt2.smt2 (nseq)
• str.at-2.smt2 (nseq)
• str.at-3.smt2 (nseq)
• str.to_int_4.smt2 (nseq)
• substr_const_begin_sat.smt2 (nseq)
• substr_var_sat.smt2 (nseq)
• word-equation-2.smt2 (nseq)
• word-equation-3.smt2 (nseq)
• word-equation-4.smt2 (nseq)

🐌 Slow Benchmarks (> 4s for any solver) — 23 files

• artur-unsat-we.smt2: seq=5.008s, nseq=5.021s
• artur-unsat.smt2: seq=5.011s, nseq=5.019s
• bigSubstrIdx.smt2: seq=5.016s, nseq=0.160s
• concat-regex2.smt2: seq=5.016s, nseq=0.012s
• concat-regex3.smt2: seq=0.022s, nseq=5.023s
• concat-regex4.smt2: seq=5.046s, nseq=5.035s
• indexof-2.smt2: seq=5.010s, nseq=0.135s
• nikolai-sat.smt2: seq=5.007s, nseq=0.138s
• nikolai-unsat.smt2: seq=5.008s, nseq=5.026s
• nonlinear.smt2: seq=5.013s, nseq=5.011s
• noodles-unsat.smt2: seq=5.036s, nseq=0.016s
• noodles-unsat2.smt2: seq=5.037s, nseq=0.013s
• noodles-unsat3.smt2: seq=5.011s, nseq=0.017s
• noodles-unsat5.smt2: seq=5.008s, nseq=5.014s
• noodles-unsat6.smt2: seq=5.023s, nseq=5.010s
• noodles-unsat7.smt2: seq=5.016s, nseq=0.014s
• noodles-unsat8.smt2: seq=5.010s, nseq=5.024s
• noodles-unsat9.smt2: seq=5.011s, nseq=5.034s
• pcp-1.smt2: seq=0.160s, nseq=5.014s
• regexdeep.smt2: seq=5.008s, nseq=0.017s
• simple-replace-4b.smt2: seq=0.014s, nseq=5.173s
• str.to_int_4.smt2: seq=5.025s, nseq=0.035s
• substring-bug2.smt2: seq=5.009s, nseq=5.011s

ℹ️ ZIPT Build Status

ZIPT could not be built. The .NET bindings (Microsoft.Z3.dll) require restoring NuGet packages from nuget.org, but outbound HTTPS is blocked by the sandbox proxy (HTTP 403). Network access is also blocked for git clone, so ZIPT source could not be fetched. All ZIPT columns show n/a.

---

Per-File Results

Click to expand full per-file table (299 rows)

#	File	seq verdict	seq time (s)	nseq verdict	nseq time (s)	ZIPT verdict	ZIPT time (s)	Notes
1	03_track_1.smt2	unsat	.010	unsat	.010	n/a	n/a
2	03_track_10.smt2	unsat	.009	unsat	.010	n/a	n/a
3	03_track_11.smt2	unsat	.012	unsat	.012	n/a	n/a
4	1234.corecstrs.readable.smt2	sat	.010	sat	.010	n/a	n/a
5	adt.smt2	sat	.011	sat	.012	n/a	n/a
6	adt2.smt2	sat	.011	sat	.011	n/a	n/a
7	all-quantifiers.smt2	unsat	.013	unsat	.017	n/a	n/a
8	artur-unsat-common-prefix.smt2	unsat	.011	unsat	.013	n/a	n/a
9	artur-unsat-we.smt2	unknown	5.008	unknown	5.021	n/a	n/a
10	artur-unsat.smt2	unknown	5.011	unknown	5.019	n/a	n/a
11	bigSubstrIdx.smt2	unknown	5.016	bug	.160	n/a	n/a
12	brackets-regex.smt2	sat	.009	sat	.009	n/a	n/a
13	bug-56-replace-bug2.smt2	sat	.012	bug	.452	n/a	n/a
14	bug-58-replace-re.smt2	unknown	.011	sat	.012	n/a	n/a
15	chars.smt2	sat	.009	sat	.009	n/a	n/a
16	chars2.smt2	sat	.011	sat	.012	n/a	n/a
17	chars3.smt2	sat	.012	sat	.027	n/a	n/a
18	concat-001.smt2	sat	.015	unknown	.168	n/a	n/a
19	concat-002.smt2	sat	.010	sat	.010	n/a	n/a
20	concat-003.smt2	sat	.010	sat	.010	n/a	n/a
21	concat-004-unsat.smt2	unsat	.010	unsat	.009	n/a	n/a
22	concat-005-unsat.smt2	unsat	.010	unsat	.010	n/a	n/a
23	concat-006.smt2	sat	.010	sat	.011	n/a	n/a
24	concat-007.smt2	sat	.010	sat	.010	n/a	n/a
25	concat-008.smt2	sat	.009	sat	.010	n/a	n/a
26	concat-009.smt2	sat	.010	sat	.010	n/a	n/a
27	concat-010.smt2	sat	.010	sat	.010	n/a	n/a
28	concat-empty.smt2	unsat	.009	unsat	.009	n/a	n/a
29	concat-regex.smt2	sat	.016	unknown	.190	n/a	n/a
30	concat-regex2.smt2	unknown	5.016	unsat	.012	n/a	n/a
31	concat-regex3.smt2	sat	.022	unknown	5.023	n/a	n/a
32	concat-regex4.smt2	unknown	5.046	unknown	5.035	n/a	n/a
33	concat.smt2	sat	.020	unknown	.011	n/a	n/a
34	concat2.smt2	sat	.011	sat	.009	n/a	n/a
35	concat_backjump_bug.smt2	sat	.101	bug	.018	n/a	n/a
36	concat_sat.smt2	sat	.013	sat	.011	n/a	n/a
37	concat_unsat.smt2	unsat	.010	unsat	.011	n/a	n/a
38	contains-1.smt2	sat	.012	sat	.014	n/a	n/a
39	contains-2.smt2	sat	.011	sat	.014	n/a	n/a
40	contains-3.smt2	unsat	.009	unsat	.009	n/a	n/a
41	contains-4.smt2	unsat	.010	unknown	.051	n/a	n/a
42	contains-5.smt2	sat	.011	sat	.013	n/a	n/a
43	contains-6.smt2	sat	.011	sat	.012	n/a	n/a
44	contains-7.smt2	sat	.019	bug	.884	n/a	n/a
45	contains-8.smt2	unknown	.011	sat	.013	n/a	n/a
46	cvc_replace_185.smt2	unsat	.011	unsat	.010	n/a	n/a
47	cvc_replace_28.smt2	sat	2.137	unknown	.067	n/a	n/a
48	cvc_replace_4062.smt2	sat	.055	sat	2.024	n/a	n/a
49	cyclic-xy.smt2	unsat	.015	unsat	.013	n/a	n/a
50	email-regex.smt2	sat	.014	sat	.024	n/a	n/a
51	empty-concat.smt2	sat	.010	sat	.009	n/a	n/a
52	empty-union.smt2	sat	.013	sat	.012	n/a	n/a
53	epsilon-1.smt2	sat	.014	sat	.014	n/a	n/a
54	epsilon-2.smt2	unsat	.009	unsat	.009	n/a	n/a
55	epsilon-3.smt2	sat	.014	sat	.012	n/a	n/a
56	equal-001.smt2	sat	.012	sat	.011	n/a	n/a
57	escapeSequences-1a.smt2	sat	.009	sat	.010	n/a	n/a
58	escapeSequences-1b.smt2	sat	.009	sat	.009	n/a	n/a
59	euf.smt2	unsat	.010	unsat	.008	n/a	n/a
60	extract-1.smt2	sat	.009	sat	.010	n/a	n/a
61	extract-1b.smt2	sat	.010	sat	.009	n/a	n/a
62	extract-1c.smt2	sat	.010	sat	.009	n/a	n/a
63	failedProp.smt2	unsat	.011	unsat	.012	n/a	n/a
64	failedProp2.smt2	unsat	.011	unsat	.013	n/a	n/a
65	indexof-2.smt2	unknown	5.010	bug	.135	n/a	n/a
66	indexof-3.smt2	sat	.013	sat	.012	n/a	n/a
67	indexof-4.smt2	sat	.012	sat	.012	n/a	n/a
68	indexof-5.smt2	sat	.013	sat	.013	n/a	n/a
69	indexof-6.smt2	unsat	.010	unsat	.009	n/a	n/a
70	indexof.smt2	sat	.029	sat	.041	n/a	n/a
71	indexof_const_index_sat.smt2	sat	.030	sat	.050	n/a	n/a
72	indexof_const_index_unsat.smt2	unsat	.047	bug	.290	n/a	n/a
73	indexof_const_startpos_sat.smt2	sat	.010	sat	.009	n/a	n/a
74	indexof_const_startpos_unsat.smt2	unsat	.009	unsat	.009	n/a	n/a
75	indexof_empty_sat.smt2	sat	.013	sat	.012	n/a	n/a
76	indexof_empty_sat2.smt2	sat	.013	sat	.012	n/a	n/a
77	indexof_empty_unsat.smt2	unsat	.010	unsat	.011	n/a	n/a
78	indexof_var_sat.smt2	sat	.044	bug	.086	n/a	n/a
79	indexof_var_unsat.smt2	unsat	.067	unknown	.450	n/a	n/a
80	is-digit-2.smt2	sat	.031	sat	.055	n/a	n/a
81	is-digit.smt2	sat	.018	sat	.017	n/a	n/a
82	len-bug.smt2	unsat	.009	unsat	.010	n/a	n/a
83	length_sat.smt2	sat	.011	sat	.012	n/a	n/a
84	membership_427.smt2	sat	.009	sat	.009	n/a	n/a
85	model-bug.smt2	sat	.011	sat	.011	n/a	n/a
86	monadic-length.smt2	sat	.014	sat	.012	n/a	n/a
87	name-regex.smt2	sat	.010	sat	.011	n/a	n/a
88	negated-equation-1.smt2	unsat	.009	unsat	.010	n/a	n/a
89	negated-equation-2.smt2	unsat	.009	unsat	.009	n/a	n/a
90	nikolai-sat.smt2	unknown	5.007	bug	.138	n/a	n/a
91	nikolai-unsat.smt2	unknown	5.008	unknown	5.026	n/a	n/a
92	no-regexes.smt2	sat	.010	sat	.010	n/a	n/a
93	nonlinear-2.smt2	sat	.012	sat	.027	n/a	n/a
94	nonlinear.smt2	unknown	5.013	unknown	5.011	n/a	n/a
95	noodles-unsat.smt2	unknown	5.036	unsat	.016	n/a	n/a
96	noodles-unsat10.smt2	sat	.013	sat	.017	n/a	n/a
97	noodles-unsat2.smt2	unknown	5.037	unsat	.013	n/a	n/a
98	noodles-unsat3.smt2	unknown	5.011	unsat	.017	n/a	n/a
99	noodles-unsat4.smt2	unsat	.012	unsat	.012	n/a	n/a
100	noodles-unsat5.smt2	unknown	5.008	unknown	5.014	n/a	n/a
101	noodles-unsat6.smt2	unknown	5.023	unknown	5.010	n/a	n/a
102	noodles-unsat7.smt2	unknown	5.016	unsat	.014	n/a	n/a
103	noodles-unsat8.smt2	unknown	5.010	unknown	5.024	n/a	n/a
104	noodles-unsat9.smt2	unknown	5.011	unknown	5.034	n/a	n/a
105	norn-benchmark-9.smt2	unsat	.010	unsat	.011	n/a	n/a
106	norn-benchmark-9b.smt2	sat	.013	sat	.012	n/a	n/a
107	norn-benchmark-9c.smt2	sat	.012	sat	.011	n/a	n/a
108	norn-benchmark-9d.smt2	unsat	.011	unsat	.012	n/a	n/a
109	norn-benchmark-9e.smt2	unsat	.012	unsat	.013	n/a	n/a
110	norn-benchmark-9f.smt2	unsat	.013	unknown	.014	n/a	n/a
111	norn-benchmark-9g.smt2	sat	.010	sat	.010	n/a	n/a
112	norn-benchmark-9h.smt2	unsat	.010	unsat	.010	n/a	n/a
113	norn-benchmark-9i.smt2	sat	.012	bug	.048	n/a	n/a
114	norn-benchmark-9j.smt2	unsat	.010	unsat	.011	n/a	n/a
115	norn-benchmark-9k.smt2	unsat	.010	unsat	.010	n/a	n/a
116	null-problem.smt2	sat	.011	sat	.011	n/a	n/a
117	parikh-constraints.smt2	sat	.022	bug	.485	n/a	n/a
118	parikh.smt2	unsat	.011	unsat	.013	n/a	n/a
119	parse-regex-incremental.smt2	sat	.015	sat	.012	n/a	n/a
120	parse-regex-lookahead.smt2	sat	.021	sat	.015	n/a	n/a
121	parse-regex-lookahead2.smt2	sat	.010	sat	.010	n/a	n/a
122	parse-regex-lookahead2b.smt2	sat	.012	sat	.014	n/a	n/a
123	parse-regex-lookahead3.smt2	sat	.011	sat	.013	n/a	n/a
124	parse-regex-lookahead3b.smt2	sat	.013	sat	.012	n/a	n/a
125	parse-regex-lookahead4.smt2	sat	.013	sat	.012	n/a	n/a
126	parse-regex.smt2	sat	.017	sat	.012	n/a	n/a
127	parse-regex2.smt2	sat	.010	sat	.011	n/a	n/a
128	parse-regex2b.smt2	sat	.013	sat	.013	n/a	n/a
129	parse-regex3.smt2	sat	.012	sat	.013	n/a	n/a
130	parse-regex4.smt2	sat	.010	sat	.010	n/a	n/a
131	pcp-1.smt2	unknown	.160	unknown	5.014	n/a	n/a
132	prefix-1.smt2	unsat	.010	unsat	.010	n/a	n/a
133	prefix-2.smt2	sat	.012	sat	.013	n/a	n/a
134	prefix-suffix.smt2	unsat	.012	unsat	.016	n/a	n/a
135	prefix.smt2	sat	.012	sat	.012	n/a	n/a
136	prefix2.smt2	sat	.011	sat	.013	n/a	n/a
137	prefix3.smt2	sat	.016	unknown	.013	n/a	n/a
138	priorityTransducer.smt2	sat	.017	sat	.013	n/a	n/a
139	priorityTransducer3.smt2	sat	.069	unknown	.014	n/a	n/a
140	priorityTransducer4.smt2	sat	.069	unknown	.014	n/a	n/a
141	regex-001.smt2	sat	.010	sat	.010	n/a	n/a
142	regex-002-unsat.smt2	unsat	.010	unsat	.011	n/a	n/a
143	regex-003.smt2	sat	.010	sat	.010	n/a	n/a
144	regex-004-unsat.smt2	unsat	.010	unsat	.011	n/a	n/a
145	regex-005-unsat.smt2	unsat	.011	unsat	.010	n/a	n/a
146	regex-006.smt2	sat	.010	sat	.011	n/a	n/a
147	regexdeep.smt2	unknown	5.008	sat	.017	n/a	n/a
148	replace-bug.smt2	unsat	.011	unsat	.010	n/a	n/a
149	replace-length-2.smt2	sat	.078	bug	.301	n/a	n/a
150	replace-length.smt2	sat	.023	sat	.013	n/a	n/a
151	replace-special-2.smt2	unsat	.010	unsat	.010	n/a	n/a
152	replace-special-3.smt2	unsat	.010	unsat	.010	n/a	n/a
153	replace-special-4.smt2	unsat	.015	unsat	.017	n/a	n/a
154	replace-special-5.smt2	unsat	.014	unsat	.015	n/a	n/a
155	replace-special.smt2	unsat	.012	unsat	.019	n/a	n/a
156	replaceAll-001.smt2	sat	.014	sat	.012	n/a	n/a
157	replaceAll-002.smt2	sat	.012	sat	.013	n/a	n/a
158	replaceAll-003.smt2	sat	.010	sat	.010	n/a	n/a
159	replaceAll-004.smt2	sat	.014	sat	.013	n/a	n/a
160	replaceAll-005.smt2	sat	.012	sat	.012	n/a	n/a
161	replaceAll-006.smt2	sat	.016	sat	.013	n/a	n/a
162	replaceAll-007.smt2	sat	.012	sat	.012	n/a	n/a
163	replaceAll-008.smt2	sat	.011	sat	.010	n/a	n/a
164	replaceAll-009.smt2	sat	.014	sat	.012	n/a	n/a
165	replaceAll-010.smt2	sat	.014	sat	.013	n/a	n/a
166	replaceAll-011.smt2	sat	.011	sat	.013	n/a	n/a
167	replaceAll-012.smt2	sat	.014	sat	.013	n/a	n/a
168	replaceAll-013.smt2	sat	.015	sat	.013	n/a	n/a
169	replaceAll-014.smt2	sat	.013	sat	.013	n/a	n/a
170	replaceAll-015.smt2	sat	.014	sat	.013	n/a	n/a
171	replaceAll-016.smt2	sat	.013	sat	.013	n/a	n/a
172	replaceAll-017.smt2	sat	.014	sat	.013	n/a	n/a
173	replaceAll-018.smt2	sat	.014	sat	.013	n/a	n/a
174	replaceAll-019.smt2	sat	.015	sat	.012	n/a	n/a
175	replaceAll-020.smt2	sat	.014	sat	.013	n/a	n/a
176	replaceAll-021.smt2	sat	.014	sat	.012	n/a	n/a
177	replaceAll-022.smt2	sat	.014	sat	.012	n/a	n/a
178	replaceAll-023.smt2	sat	.014	sat	.013	n/a	n/a
179	replaceAll-024.smt2	sat	.013	sat	.012	n/a	n/a
180	replaceAll-025.smt2	sat	.011	sat	.013	n/a	n/a
181	replace_all-bug.smt2	unsat	.010	unsat	.010	n/a	n/a
182	replace_empty_string.smt2	unknown	.012	sat	.013	n/a	n/a
183	replace_longest_unsat.smt2	sat	.012	sat	.013	n/a	n/a
184	replace_shortest_sat.smt2	unknown	.012	sat	.014	n/a	n/a
185	simple-concat-2.smt2	sat	.013	sat	.013	n/a	n/a
186	simple-concat-3.smt2	sat	.015	sat	.013	n/a	n/a
187	simple-concat-4.smt2	sat	.016	unknown	.013	n/a	n/a
188	simple-concat-4b.smt2	unsat	.014	unsat	.013	n/a	n/a
189	simple-concat-5.smt2	sat	.015	sat	.013	n/a	n/a
190	simple-concat-5b.smt2	sat	.013	sat	.013	n/a	n/a
191	simple-concat.smt2	sat	.013	sat	.012	n/a	n/a
192	simple-cvc-smtlib-b.smt2	unsat	.010	unsat	.010	n/a	n/a
193	simple-cvc-smtlib-c.smt2	sat	.022	sat	.013	n/a	n/a
194	simple-cvc-smtlib.smt2	sat	.013	sat	.013	n/a	n/a
195	simple-cycle.smt2	unsat	.010	unsat	.010	n/a	n/a
196	simple-cycle2.smt2	unsat	.010	unsat	.010	n/a	n/a
197	simple-replace-1b.smt2	sat	.010	sat	.010	n/a	n/a
198	simple-replace-1c.smt2	sat	.011	sat	.011	n/a	n/a
199	simple-replace-1d.smt2	unsat	.010	unsat	.010	n/a	n/a
200	simple-replace-1e.smt2	sat	.010	sat	.010	n/a	n/a
201	simple-replace-1f.smt2	unsat	.010	unsat	.010	n/a	n/a
202	simple-replace-1g.smt2	sat	.010	sat	.010	n/a	n/a
203	simple-replace-2.smt2	sat	.011	sat	.011	n/a	n/a
204	simple-replace-2b.smt2	sat	.011	sat	.012	n/a	n/a
205	simple-replace-2c.smt2	sat	.011	sat	.012	n/a	n/a
206	simple-replace-2d.smt2	sat	.011	sat	.010	n/a	n/a
207	simple-replace-3.smt2	sat	.010	sat	.011	n/a	n/a
208	simple-replace-3b.smt2	sat	.010	sat	.011	n/a	n/a
209	simple-replace-4.smt2	sat	.020	bug	.533	n/a	n/a
210	simple-replace-4b.smt2	unsat	.014	unknown	5.173	n/a	n/a
211	simple-replace-4c.smt2	sat	.012	bug	.448	n/a	n/a
212	simple-replace-5.smt2	sat	.011	sat	.011	n/a	n/a
213	simple-replace.smt2	sat	.011	sat	.010	n/a	n/a
214	slow-little.smt2	sat	.027	bug	.021	n/a	n/a
215	str-leq-reflexive-2.smt2	sat	.011	sat	.010	n/a	n/a
216	str-leq-reflexive.smt2	sat	.010	sat	.010	n/a	n/a
217	str-leq.smt2	unsat	.011	unsat	.010	n/a	n/a
218	str-leq10.smt2	unsat	.010	unsat	.010	n/a	n/a
219	str-leq11.smt2	sat	.048	sat	.476	n/a	n/a
220	str-leq12.smt2	sat	.043	bug	.092	n/a	n/a
221	str-leq13.smt2	sat	.015	bug	.082	n/a	n/a
222	str-leq14.smt2	unsat	.010	unsat	.012	n/a	n/a
223	str-leq2.smt2	sat	.012	sat	.010	n/a	n/a
224	str-leq3.smt2	sat	.019	bug	.038	n/a	n/a
225	str-leq4.smt2	unsat	.010	unsat	.010	n/a	n/a
226	str-leq5.smt2	sat	.059	bug	.162	n/a	n/a
227	str-leq6.smt2	sat	.010	sat	.010	n/a	n/a
228	str-leq7.smt2	sat	.028	bug	.224	n/a	n/a
229	str-leq8.smt2	unsat	.010	unsat	.010	n/a	n/a
230	str-leq9.smt2	sat	.011	sat	.012	n/a	n/a
231	str-lt.smt2	sat	.041	unsat	.779	n/a	n/a	SOUNDNESS_DISAGREEMENT(seq:sat,nseq:unsat)
232	str-lt2.smt2	unsat	.060	bug	.544	n/a	n/a
233	str-term-small-rw_164.smt2	unsat	.010	unsat	.010	n/a	n/a
234	str-term-small-rw_186.smt2	unsat	.010	unsat	.011	n/a	n/a
235	str.at-2.smt2	unsat	.021	bug	.359	n/a	n/a
236	str.at-3.smt2	sat	.013	bug	.048	n/a	n/a
237	str.at-3b.smt2	unsat	.011	unsat	.013	n/a	n/a
238	str.at-3c.smt2	unsat	.010	unsat	.010	n/a	n/a
239	str.at-bug.smt2	sat	.010	sat	.011	n/a	n/a
240	str.at.smt2	sat	.014	sat	.035	n/a	n/a
241	str.from_int.smt2	sat	.011	sat	.011	n/a	n/a
242	str.from_int_2.smt2	unsat	.010	unsat	.011	n/a	n/a
243	str.from_int_3.smt2	sat	.011	sat	.011	n/a	n/a
244	str.from_int_4.smt2	unsat	.010	unsat	.010	n/a	n/a
245	str.from_int_5.smt2	sat	.011	sat	.012	n/a	n/a
246	str.from_int_6.smt2	sat	.035	unknown	.107	n/a	n/a
247	str.to_int.smt2	sat	.012	sat	.011	n/a	n/a
248	str.to_int_2.smt2	unsat	.010	unsat	.010	n/a	n/a
249	str.to_int_3.smt2	sat	.030	sat	.016	n/a	n/a
250	str.to_int_4.smt2	unknown	5.025	bug	.035	n/a	n/a
251	str.to_int_5.smt2	sat	.208	unknown	.021	n/a	n/a
252	str.to_int_6.smt2	sat	.150	unknown	.020	n/a	n/a
253	str_in_re_translation.smt2	sat	.013	sat	.012	n/a	n/a
254	str_to_int_sat.smt2	sat	.012	sat	.013	n/a	n/a
255	substr_const_begin_sat.smt2	sat	.015	bug	.163	n/a	n/a
256	substr_const_begin_unsat.smt2	unsat	.015	unsat	.014	n/a	n/a
257	substr_const_len_sat.smt2	sat	.018	sat	.038	n/a	n/a
258	substr_const_len_unsat.smt2	unsat	.016	unsat	.013	n/a	n/a
259	substr_empty_sat.smt2	sat	.018	sat	.019	n/a	n/a
260	substr_empty_unsat.smt2	unsat	.015	unsat	.013	n/a	n/a
261	substr_var_sat.smt2	sat	.021	bug	.024	n/a	n/a
262	substr_var_unsat.smt2	unsat	.014	unsat	.014	n/a	n/a
263	substring-bug.smt2	sat	.010	sat	.010	n/a	n/a
264	substring-bug2.smt2	unknown	5.009	unknown	5.011	n/a	n/a
265	substring-bug3.smt2	sat	.010	sat	.010	n/a	n/a
266	substring.smt2	sat	.016	sat	.016	n/a	n/a
267	subsumption.smt2	sat	.013	sat	.013	n/a	n/a
268	subsumption2.smt2	unsat	.012	unsat	.013	n/a	n/a
269	suffix-1.smt2	unsat	.010	unsat	.010	n/a	n/a
270	suffix-2.smt2	sat	.012	sat	.014	n/a	n/a
271	suffix-3.smt2	sat	.011	sat	.014	n/a	n/a
272	suffix-4.smt2	sat	.012	sat	.013	n/a	n/a
273	suffix-5.smt2	unsat	.009	unsat	.009	n/a	n/a
274	test-replace-regex.smt2	sat	.010	sat	.010	n/a	n/a
275	test-replace-regex2.smt2	sat	.010	sat	.010	n/a	n/a
276	test-replace-regex3.smt2	unknown	.012	sat	.013	n/a	n/a
277	test-replace-regex4.smt2	sat	.011	sat	.012	n/a	n/a
278	test-replace-word.smt2	sat	.010	sat	.011	n/a	n/a
279	test-replace-word2.smt2	sat	.010	sat	.010	n/a	n/a
280	test-replace.smt2	sat	.010	sat	.010	n/a	n/a
281	test-replace2.smt2	sat	.011	sat	.011	n/a	n/a
282	test-replace3.smt2	sat	.012	sat	.012	n/a	n/a
283	test-replace4.smt2	sat	.012	sat	.012	n/a	n/a
284	transducer1.smt2	sat	.015	sat	.013	n/a	n/a
285	transducer1b.smt2	sat	.014	sat	.013	n/a	n/a
286	transducer1c.smt2	sat	.014	sat	.013	n/a	n/a
287	transducer2.smt2	sat	.012	sat	.012	n/a	n/a
288	transducer2b.smt2	sat	.010	sat	.011	n/a	n/a
289	transducer2c.smt2	sat	.010	sat	.010	n/a	n/a
290	transducer2d.smt2	sat	.011	sat	.011	n/a	n/a
291	transducer3.smt2	sat	.012	sat	.013	n/a	n/a
292	transducer4.smt2	sat	.011	sat	.010	n/a	n/a
293	word-equation-2.smt2	sat	.015	bug	.013	n/a	n/a
294	word-equation-3.smt2	unsat	.729	bug	.050	n/a	n/a
295	word-equation-4.smt2	sat	.014	bug	.016	n/a	n/a
296	word-equation-6-copy.smt2	sat	.014	unknown	.165	n/a	n/a
297	word-equation-6-regex.smt2	sat	.017	sat	.015	n/a	n/a
298	word-equation-6.smt2	sat	.019	sat	.015	n/a	n/a
299	word-equation.smt2	sat	.012	sat	.015	n/a	n/a

---

Generated automatically by the Ostrich Benchmark workflow on the c3 branch.

AI generated by Ostrich Benchmark: Z3 c3 branch vs ZIPT · history

• expires on Apr 8, 2026, 5:45 PM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-04-08T17:45:56.296Z.

Closed by Workflow