[OPIK-6260] [BE] [FE] feat: display recent activity on project home page by miguelgrc · Pull Request #6595 · comet-ml/opik

miguelgrc · 2026-05-04T12:21:40Z

Details

Redesigns the project home page to display a unified "Recent Activity" feed showing the most recent items across 6 entity types.

Backend

New GET /v1/private/projects/{projectId}/recent-activity?size=10 endpoint
RecentActivityService orchestrates 6 parallel queries (experiments, optimizations, dataset/test suite creations + version updates, agent config blueprints, alert events), merges results, sorts by date, and returns the top N
Experiments and optimizations queried from ClickHouse via existing services; datasets, test suites, and agent configs from MySQL via JDBI; alert events from ClickHouse alert_logs table filtered by project_id marker
Dataset/test suite query uses UNION ALL to combine creation events (from datasets table) with non-empty version updates (from dataset_versions table), deduplicating empty scaffold versions
Enriched alert event logging with project_id in markers to enable project-scoped filtering (WebhookEvent, WebhookHttpClient, WebhookPublisher, AlertEventLogsDAO)
Graceful degradation: individual source failures return partial results

Frontend

Redesigned ProjectHomePage with greeting ("Hi, {username}"), action buttons (View logs, View dashboards), and Recent Activity section
RecentActivitySection component with loading skeletons, empty state (activity-cloud icon), and activity item list
Each item shows type-specific icon + color, label, entity name, relative date, and arrow on hover — all configured in a single ACTIVITY_CONFIG record
Clickable items navigate to the relevant entity page (experiment compare view, dataset/test suite details, optimization details, agent config version, alert details)
Split sidebar "Opik Connect" into "Home" (house icon → new home page) and "Ollie" (owl icon → full-page assistant, previous home behavior)
New /ollie route preserving the old full-page AssistantSidebar experience
Content max-width 720px centered on large screens

Change checklist

User facing
Documentation update

Issues

OPIK-6260

Testing

Verified all 6 entity types appear in the feed with correct icons, colors, labels, and navigation links
Tested loading state (skeleton), empty state (no activity), and populated state
Verified experiment links include dataset_id path + experiment_id query param
Verified agent config links select the specific version via configId query param
Verified dataset/test suite deduplication: creation shows 1 entry, adding items shows 1 additional entry (empty versions filtered)
Verified sidebar shows Home + Ollie tabs, Ollie page renders full-page assistant
TypeScript, ESLint, Spotless all pass; FE tests pass (1532/1532)

Documentation

N/A

BE: New aggregated endpoint GET /v1/private/projects/{projectId}/recent-activity that fetches the most recent items across 6 entity types (experiments, optimizations, dataset/test suite versions, agent config blueprints, alert events) in parallel, merges and returns the top N sorted by date. Also enriches alert event logs with project_id in markers for project-scoped filtering. FE: Redesigned project home page with greeting, action buttons, and recent activity feed. Split sidebar into Home + Ollie tabs. Added /ollie route for full-page assistant (previous home behavior).

github-actions · 2026-05-04T12:22:52Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-04T12:31:18Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2050
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

CometActions · 2026-05-05T05:10:20Z

🌙 Nightly cleanup: The test environment for this PR (pr-6595) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

github-actions · 2026-05-05T08:31:14Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-05T08:40:33Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2054
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

@max

- Fix import order in RecentActivitySection (external before internal) - Add @max(100) to size query param in RecentActivityResource - Pass size through to per-source queries instead of hardcoded limit - Use UserLog constants for marker keys and add null guard in fetchAlertEvents - Fix dataset/test suite links to navigate to /items directly

github-actions · 2026-05-05T09:03:43Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

github-actions · 2026-05-05T09:05:11Z

Backend Tests - Integration Group 9

24 files ±0 24 suites ±0 4m 56s ⏱️ + 1m 24s
316 tests ±0 316 ✅ ±0 0 💤 ±0 0 ❌ ±0
316 runs +5 316 ✅ +5 0 💤 ±0 0 ❌ ±0

Results for commit 496af9b. ± Comparison against base commit 0d07020.

♻️ This comment has been updated with latest results.

Tests cover: merge/sort across sources, size limiting, graceful degradation (partial + total failure), alert event null guard filtering, and empty project handling.

CometActions · 2026-05-05T09:12:01Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2058
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

Home should always be visible; only Ollie depends on the assistant plugin.

github-actions · 2026-05-05T09:29:59Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-05T09:38:16Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2059
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

aadereiko

In general, looks good! I've left a few comments how to make the code more semantically proper. Up to you if you want to fix it, good to go for the FE side.

andrescrz

Please check the BE feedback. Some comments were written once, but apply everywhere in the PR.

- Rename showHome → showOlliePage (only controls Ollie visibility now) - Replace Button+onClick with Link for nav buttons and activity items - Move formatRelativeDateTime to @/lib/date.ts alongside other date utils

github-actions · 2026-05-05T12:45:41Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-05T12:54:02Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2063
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

@consumes

- Rename endpoint path to /activities (RESTful plural) - Add @consumes(JSON), @JSONVIEW, @apiresponse docs (200, 400, 500) - Add pagination (RecentActivityPage with page/size/total/projectId/content) - Add createdBy field to RecentActivityItem - Use @builder pattern for all DTOs and construction - Remove top-level onErrorResume (errors bubble as 500) - Add class-level javadoc documenting page-1 limitation - Parallelize JDBI sources (datasets + agent configs as separate Monos) - Merge dataset/test suite query into single call (drop type filter) - Add UUIDv7 30-day lookback filter for dataset query scan reduction - Import HashMap instead of inline java.util.HashMap - Update unit tests: @Injectmocks, Podam, precise mocks, full object assertions - Add resource-level black box tests with Testcontainers (all entity types, sort order, project isolation, permission enforcement)

…stamps - Hide "View dashboards" button when canViewDashboards is false - Guard future timestamps in formatRelativeDateTime to prevent "0 days ago"

github-actions · 2026-05-05T16:42:30Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-05T16:51:41Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2066
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

CometActions · 2026-05-06T05:11:41Z

🌙 Nightly cleanup: The test environment for this PR (pr-6595) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

github-actions · 2026-05-06T10:16:09Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 2.0.21-5213 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch miguelg/OPIK-6260-display-recent-activity
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-05-06T10:25:22Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-6595.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-6595
Version: 2.0.21-6595-merge-2070
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

andrescrz

I left a bit more of feedback for stuff to check, but no blockers. Some of them are questions and others are things that can be followed-up in a separated PR. Please take a look at one comment from the previous review, not sure if you saw it.

andrescrz · 2026-05-06T13:55:21Z

+            @JsonView(View.Public.class) int page,
+            @JsonView(View.Public.class) int size,
+            @JsonView(View.Public.class) long total,
+            @JsonView(View.Public.class) UUID projectId,


Minor: we generally keep the top level page free of content fields, such as projectId here. On the other hand, while this is inconsistent with the service conventions, we know the projectId is unique here, so the response is more optimal.

It's a matter of conventions vs optimising. I'm fine with this.

andrescrz · 2026-05-06T13:57:04Z

+            @JsonView(View.Public.class) Instant createdAt,
+            @JsonView(View.Public.class) UUID resourceId,
+            @JsonView(View.Public.class) String createdBy) {


Very nit: we typically list together createdBy, createdAt as it's more readable.

andrescrz · 2026-05-06T13:57:46Z

+    }
+
+    @Builder(toBuilder = true)
+    public record RecentDatasetVersion(UUID datasetId, String datasetName, String datasetType, Instant createdAt,


Minor: this record represents the DB row, feel free to add @NonNull validations to those fields where that's enforced on the DB.

andrescrz · 2026-05-06T14:04:37Z

+                    AND dv.created_at > d.created_at
+                    AND dv.items_total > 0
+            ) combined
+            ORDER BY created_at DESC


Related to similar questions: is this created_at sorting over the whole union performant? Do we lack or need index here?

andrescrz · 2026-05-06T14:10:08Z

+    }
+
+    private Mono<List<RecentActivityItem>> fetchDatasetSources(String workspaceId, UUID projectId, int size) {
+        var minId = idGenerator.generateId(Instant.now().minus(LOOKBACK_DAYS, ChronoUnit.DAYS));


I believe this generateId method doesn't properly set the random part of the UUID to all 0s or all F. There were some other methods available in the service, please double check. You might leave some records behind, which might be ok when no strong precision is required. Eventually, we need to clean up these duplications in our code base.

andrescrz · 2026-05-06T14:12:26Z

+        wireMock.server().stop();
+    }
+
+    private RecentActivity.RecentActivityPage getActivities(UUID projectId, String apiKey, String workspaceName) {


Minor: we generally create a separated client class to encapsulate and reuse all these.

andrescrz · 2026-05-06T14:13:40Z

+
+            var result = getActivities(projectId, API_KEY, TEST_WORKSPACE_NAME);
+
+            assertThat(result.content()).isNotEmpty();


Minor: I miss some assertions on the whole content (full object assertion).

Applies to all tests.

andrescrz · 2026-05-06T14:15:49Z

+
+    private static final String WORKSPACE_ID = UUID.randomUUID().toString();
+    private static final UUID PROJECT_ID = UUID.randomUUID();
+    private static final PodamFactory PODAM = PodamFactoryUtils.newPodamFactory();


Minor: podam is in theory not fully thread-safe, better not have it as static. We aren't running paralel tests now, that's why it works.

andrescrz · 2026-05-06T14:17:04Z

+                })
+                .onErrorResume(e -> {
+                    log.error("Failed to fetch recent activity for project '{}'", projectId, e);
+                    return Mono.just(new RecentActivity(List.of()));


Please double check this, I believe you left it behind.

CometActions · 2026-05-07T05:14:10Z

🌙 Nightly cleanup: The test environment for this PR (pr-6595) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

miguelgrc requested a review from a team as a code owner May 4, 2026 12:21

github-actions Bot assigned miguelgrc May 4, 2026

github-actions Bot added java Pull requests that update Java code Frontend Backend typescript *.ts *.tsx labels May 4, 2026

miguelgrc added the test-environment Deploy Opik adhoc environment label May 4, 2026

baz-reviewer Bot reviewed May 4, 2026

View reviewed changes

CometActions removed the test-environment Deploy Opik adhoc environment label May 5, 2026

miguelgrc added the test-environment Deploy Opik adhoc environment label May 5, 2026

miguelgrc added test-environment Deploy Opik adhoc environment and removed test-environment Deploy Opik adhoc environment labels May 5, 2026

Revision 2: Add unit tests for RecentActivityService

496af9b

Tests cover: merge/sort across sources, size limiting, graceful degradation (partial + total failure), alert event null guard filtering, and empty project handling.

baz-reviewer Bot reviewed May 5, 2026

View reviewed changes

Comment thread apps/opik-frontend/src/v2/pages/ProjectHomePage/RecentActivitySection.tsx

github-actions Bot added the tests Including test files, or tests related like configuration. label May 5, 2026

Revision 3: Show Home in sidebar even when Ollie is disabled

235bc06

Home should always be visible; only Ollie depends on the assistant plugin.

miguelgrc added test-environment Deploy Opik adhoc environment and removed test-environment Deploy Opik adhoc environment labels May 5, 2026

aadereiko reviewed May 5, 2026

View reviewed changes

baz-reviewer Bot reviewed May 5, 2026

View reviewed changes

Comment thread apps/opik-frontend/src/v2/layout/SideBar/helpers/getMenuItems.ts

thiagohora reviewed May 5, 2026

View reviewed changes

Comment thread apps/opik-backend/src/main/java/com/comet/opik/domain/DatasetVersionDAO.java

thiagohora reviewed May 5, 2026

View reviewed changes

Comment thread apps/opik-backend/src/main/java/com/comet/opik/domain/DatasetVersionDAO.java

andrescrz requested changes May 5, 2026

View reviewed changes

Revision 4: Address FE review comments

99c4784

- Rename showHome → showOlliePage (only controls Ollie visibility now) - Replace Button+onClick with Link for nav buttons and activity items - Move formatRelativeDateTime to @/lib/date.ts alongside other date utils

miguelgrc added test-environment Deploy Opik adhoc environment and removed test-environment Deploy Opik adhoc environment labels May 5, 2026

baz-reviewer Bot reviewed May 5, 2026

View reviewed changes

Comment thread apps/opik-frontend/src/v2/pages/ProjectHomePage/ProjectHomePage.tsx Outdated

Comment thread apps/opik-frontend/src/lib/date.ts

miguelgrc added 2 commits May 5, 2026 18:08

Revision 6: Gate dashboards button with permission, guard future time…

e800f8b

…stamps - Hide "View dashboards" button when canViewDashboards is false - Guard future timestamps in formatRelativeDateTime to prevent "0 days ago"

baz-reviewer Bot reviewed May 5, 2026

View reviewed changes

baz-reviewer Bot approved these changes May 5, 2026

View reviewed changes

miguelgrc added test-environment Deploy Opik adhoc environment and removed test-environment Deploy Opik adhoc environment labels May 5, 2026

CometActions removed the test-environment Deploy Opik adhoc environment label May 6, 2026

miguelgrc added the test-environment Deploy Opik adhoc environment label May 6, 2026

andrescrz approved these changes May 6, 2026

View reviewed changes

CometActions removed the test-environment Deploy Opik adhoc environment label May 7, 2026


		var result = getActivities(projectId, API_KEY, TEST_WORKSPACE_NAME);

		assertThat(result.content()).isNotEmpty();

Conversation

miguelgrc commented May 4, 2026

Details

Backend

Frontend

Change checklist

Issues

Testing

Documentation

Uh oh!

github-actions Bot commented May 4, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

CometActions commented May 4, 2026

Access Information

Uh oh!

CometActions commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

CometActions commented May 5, 2026

Access Information

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Backend Tests - Integration Group 9

Uh oh!

Uh oh!

CometActions commented May 5, 2026

Access Information

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

CometActions commented May 5, 2026

Access Information

Uh oh!

aadereiko left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

andrescrz left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

Uh oh!

Uh oh!

CometActions commented May 5, 2026

Access Information

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented May 5, 2026 •

edited

Loading