Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(llm-obs): LLM observability dashboard #27415

Draft
wants to merge 7 commits into
base: master
Choose a base branch
from
Draft

Conversation

Twixes
Copy link
Member

@Twixes Twixes commented Jan 9, 2025

Changes

Introducing the LLM observability MVP.

Screenshot 2025-01-09 at 21 00 36

Initially tried to reuse the layout code of web analytics (WebDashboard.tsx), but that turned out to be more web analytics-specific than ideal, and quite hard to parse (the tiles selector is almost 1000 lines long). Hence scrapped that approach and going for something simpler.

How did you test this code?

TODO: Storybook stories.

Copy link
Contributor

github-actions bot commented Jan 9, 2025

Size Change: +80 B (+0.01%)

Total Size: 1.11 MB

ℹ️ View Unchanged
Filename Size Change
frontend/dist/toolbar.js 1.11 MB +80 B (+0.01%)

compressed-size-action

@posthog-bot
Copy link
Contributor

📸 UI snapshots have been updated

2 snapshot changes in total. 0 added, 2 modified, 0 deleted:

  • chromium: 0 added, 2 modified, 0 deleted (diff for shard 1)
  • webkit: 0 added, 0 modified, 0 deleted

Triggered by this commit.

👉 Review this PR's diff of snapshots.

@Twixes
Copy link
Member Author

Twixes commented Jan 9, 2025

Need to set up some demo data:
Screenshot 2025-01-09 at 21 21 30

@Twixes Twixes force-pushed the llm-observability branch from 01d77ee to a752108 Compare January 9, 2025 20:23
@posthog-bot
Copy link
Contributor

📸 UI snapshots have been updated

1 snapshot changes in total. 0 added, 1 modified, 0 deleted:

  • chromium: 0 added, 1 modified, 0 deleted (diff for shard 2)
  • webkit: 0 added, 0 modified, 0 deleted

Triggered by this commit.

👉 Review this PR's diff of snapshots.

@posthog-bot
Copy link
Contributor

📸 UI snapshots have been updated

3 snapshot changes in total. 0 added, 3 modified, 0 deleted:

Triggered by this commit.

👉 Review this PR's diff of snapshots.

@timgl timgl added the deploy label Jan 9, 2025

export const LLM_OBSERVABILITY_DATA_COLLECTION_NODE_ID = 'llm-observability-data'

const INITIAL_DATE_FROM = '-24h' as string | null
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I feel like our default should be 30 days for the overall dashboard

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants