Skip to content

[NA] [BE] Update model prices file#5757

Merged
andrescrz merged 3 commits intomainfrom
github-actions/NA-automatically-update-model-prices-file-2026-03-20-00-25-08
Mar 20, 2026
Merged

[NA] [BE] Update model prices file#5757
andrescrz merged 3 commits intomainfrom
github-actions/NA-automatically-update-model-prices-file-2026-03-20-00-25-08

Conversation

@CometActions
Copy link
Collaborator

@CometActions CometActions commented Mar 20, 2026

Details

Automated update of model_prices_and_context_window.json file and regeneration of supported models documentation.

Files updated:

  • apps/opik-backend/src/main/resources/model_prices_and_context_window.json - Latest model pricing data from LiteLLM
  • apps/opik-frontend/src/data/model_prices_and_context_window.json - Frontend copy kept in sync with backend

Change checklist

  • User facing change
  • Documentation update

Issues

N/A

Testing

  • Passed CI

Documentation

@CometActions CometActions requested a review from a team as a code owner March 20, 2026 00:25
@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Unit Tests

1 496 tests   1 494 ✅  55s ⏱️
  180 suites      2 💤
  180 files        0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 5

251 tests   251 ✅  2m 11s ⏱️
 26 suites    0 💤
 26 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 16

 16 files   16 suites   59s ⏱️
187 tests 187 ✅ 0 💤 0 ❌
165 runs  165 ✅ 0 💤 0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 6

105 tests   105 ✅  2m 44s ⏱️
 23 suites    0 💤
 23 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 11

131 tests   131 ✅  4m 23s ⏱️
 23 suites    0 💤
 23 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 13

445 tests   442 ✅  3m 48s ⏱️
 21 suites    3 💤
 21 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 15

172 tests   170 ✅  3m 44s ⏱️
 27 suites    2 💤
 27 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 8

280 tests   280 ✅  4m 43s ⏱️
 22 suites    0 💤
 22 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 7

1 137 tests   1 136 ✅  5m 57s ⏱️
    9 suites      1 💤
    9 files        0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 12

184 tests   182 ✅  5m 47s ⏱️
 36 suites    2 💤
 36 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 10

 21 files   21 suites   4m 16s ⏱️
253 tests 251 ✅ 2 💤 0 ❌
215 runs  213 ✅ 2 💤 0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 4

1 362 tests   1 362 ✅  8m 40s ⏱️
    5 suites      0 💤
    5 files        0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 3

313 tests   313 ✅  9m 52s ⏱️
 29 suites    0 💤
 29 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 9

322 tests   321 ✅  9m 27s ⏱️
 24 suites    1 💤
 24 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 1

413 tests   413 ✅  13m 15s ⏱️
 24 suites    0 💤
 24 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 14

267 tests   267 ✅  7m 59s ⏱️
 29 suites    0 💤
 29 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Backend Tests - Integration Group 2

261 tests   261 ✅  19m 52s ⏱️
 20 suites    0 💤
 20 files      0 ❌

Results for commit 79ac53a.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

TS SDK E2E Tests - Node 18

238 tests  ±0   236 ✅ ±0   16m 12s ⏱️ -54s
 25 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

TS SDK E2E Tests - Node 22

238 tests  ±0   236 ✅ ±0   15m 33s ⏱️ - 2m 0s
 25 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

TS SDK E2E Tests - Node 20

238 tests  ±0   236 ✅ ±0   15m 52s ⏱️ - 2m 4s
 25 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Python SDK E2E Tests Results (Python 3.14)

238 tests  ±0   236 ✅ ±0   9m 40s ⏱️ +8s
  1 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

This pull request removes 1 and adds 1 tests. Note that renamed tests count towards both. 
tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a67-e070-7bc8-9731-e41020d6f647]

tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a80-1b5b-74ba-a319-edf73fc9b422]

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Python SDK E2E Tests Results (Python 3.13)

238 tests  ±0   236 ✅ ±0   9m 26s ⏱️ +11s
  1 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

This pull request removes 1 and adds 1 tests. Note that renamed tests count towards both. 
tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a67-b0a3-75e8-a6e2-bbd1483cef49]

tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a80-e469-7267-a3a7-f3cc4819d751]

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Python SDK E2E Tests Results (Python 3.12)

238 tests  ±0   236 ✅ ±0   9m 22s ⏱️ -10s
  1 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

This pull request removes 1 and adds 1 tests. Note that renamed tests count towards both. 
tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a67-b510-7505-a20b-37701acf6a7f]

tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a7f-b70a-7939-add3-e1a78563f926]

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Python SDK E2E Tests Results (Python 3.11)

238 tests  ±0   236 ✅ ±0   9m 17s ⏱️ -14s
  1 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

This pull request removes 1 and adds 1 tests. Note that renamed tests count towards both. 
tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a67-a7bc-750c-90a8-d83ca089abb7]

tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a80-d121-74f1-a254-65a475698f04]

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 20, 2026 •
edited
Loading

Python SDK E2E Tests Results (Python 3.10)

238 tests  ±0   236 ✅ ±0   9m 35s ⏱️ -23s
  1 suites ±0     2 💤 ±0 
  1 files   ±0     0 ❌ ±0 

Results for commit 79ac53a. ± Comparison against base commit 6a597fa.

This pull request removes 1 and adds 1 tests. Note that renamed tests count towards both. 
tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a67-9c1c-7cd6-a8ef-ae2001bfc943]

tests.e2e.test_tracing ‑ test_opik_client__update_trace__happy_flow[None-None-None-None-019d0a7f-cd39-74c7-a13c-441036a0d943]

♻️ This comment has been updated with latest results.

aadereiko
aadereiko previously approved these changes Mar 20, 2026
View reviewed changes
@aadereiko
Copy link
Collaborator

aadereiko commented Mar 20, 2026

FE part is good to go

@andrescrz
Copy link
Member

andrescrz commented Mar 20, 2026

Test legitimately fail, working on a fix right now.

@andrescrz @claude
[NA] [BE] fix: update tests to use current models from pricing file
79ac53a 
Deprecated models (claude-3-5-sonnet-20241022, gpt-4-vision-preview,
gemini-1.5-pro, etc.) were removed from the upstream LiteLLM pricing
file. Update test references to use models that exist in the current
pricing database.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions github-actions bot added java Pull requests that update Java code tests Including test files, or tests related like configuration. labels Mar 20, 2026
@andrescrz andrescrz merged commit 7a31abb into main Mar 20, 2026
61 checks passed
@andrescrz andrescrz deleted the github-actions/NA-automatically-update-model-prices-file-2026-03-20-00-25-08 branch March 20, 2026 09:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andrescrz andrescrz andrescrz approved these changes

@aadereiko aadereiko aadereiko left review comments

Assignees

@andrescrz andrescrz

@CometActions CometActions

Labels

Backend Frontend java Pull requests that update Java code tests Including test files, or tests related like configuration.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@CometActions @aadereiko @andrescrz