Karini AI Documentation
Go Back to Karini AI
  • Introduction
  • Installation
  • Getting Started
  • Organization
  • User Management
    • User Invitations
    • Role Management
  • Model Hub
    • Embeddings Models
    • Large Language Models (LLMs)
  • Prompt Management
    • Prompt Templates
    • Create Prompt
    • Test Prompt
      • Test & Compare
      • Prompt Observability
      • Prompt Runs
    • Agentic Prompts
      • Create Agent Prompt
      • Test Agent Prompt
    • Prompt Task Types
    • Prompt Versions
  • Datasets
  • Recipes
    • QnA Recipe
      • Data Storage Connectors
      • Connector Credential Setup
      • Vector Stores
      • Create Recipe
      • Run Recipe
      • Test Recipe
      • Evaluate Recipe
      • Export Recipe
      • Recipe Runs
      • Recipe Actions
    • Agent Recipe
      • Agent Recipe Configuration
      • Set up Agentic Recipe
      • Test Agentic Recipe
      • Agentic Evaluation
    • Databricks Recipe
  • Copilots
  • Observability
  • Dashboard Overview
    • Statistical Overview
    • Cost & Usage Summary
      • Spend by LLM Endpoint
      • Spend by Generative AI Application
    • Model Endpoints & Datasets Distribution
    • Dataset Dashboard
    • Copilot Dashboard
    • Model Endpoints Dashboard
  • Catalog Schemas
    • Connectors
    • Catalog Schema Import and Publication Process
  • Prompt Optimization Experiments
    • Set up and execute experiment
    • Optimization Insights
  • Generative AI Workshop
    • Agentic RAG
    • Intelligent Document Processing
    • Generative BI Agentic Assistant
  • Release Notes
Powered by GitBook
On this page
  • Total cost
  • Total API Requests
  • Total Tokens
  1. Dashboard Overview

Model Endpoints Dashboard

PreviousCopilot DashboardNextCatalog Schemas

Last updated 10 months ago

You can view granular cost and usage dashboards for each registered model endpoint on the Model Endpoint page.

Click on View model link of the desired model endpoint to explore the associated dashboards.

Below are the particulars for comprehending the model endpoints dashboard for LLM endpoints as well as embedding model endpoints.

  1. Data can be viewed and analyzed at both daily and hourly levels of detail. The default level of granularity is set to hourly.

  2. The dashboard is set to showcase data ranging from the previous day's date to the current date, with hourly granularity.

  3. When selecting Hourly Granularity, select a date range that does not exceed 48 hours. Your start and end dates must fall within this 2-day period.

  4. When selecting Daily Granularity, the date range cannot exceed 30 days. Ensure that your selected dates are no more than a month apart.

  5. When a date filter or granularity is changed, all the charts update with the appropriate values dynamically.

  6. When you click on the Clear filter option, the selected date range, granularity reset to their default values.

Total cost

This dashboard provides a daily or hourly breakdown of the costs associated with the selected model endpoint for the specified time period.

The model price set in the , and the number of Input/Output tokens are used to calculate the endpoint cost for the selected date range.

Total API Requests

This dashboard illustrates the total number of API requests served by the model endpoint within the selected timeframe.

Total Tokens

This dashboard illustrates the count of input and output tokens processed by the model endpoint over the selected timeframe.

model hub