Cost & Usage Summary
Last updated
Last updated
Karini AI's cost analysis dashboard features an intuitive interface that allows you to easily visualize, understand, and monitor your cost and usage trends over time. You can review your usage and costs via the main dashboard or explore specific resources like endpoints or copilots on their respective pages.
The primary cost drivers for generative AI applications are the model endpoints, where costs accrue based on token usage. Karini's dashboards enable you to track spending across these model endpoints effectively. Additionally, you can monitor expenditures on copilot applications to analyze usage patterns and manage resources efficiently.
Refer to below.
You can dig deeper into your data by filtering based on date range and grouping your resources. For example, you can visualize your monthly cost for the last three months grouped by the copilots, or daily costs for the previous month grouped by the LLM endpoints. Karini’s dashboards show the cost and provide deeper insights by showing the number of API requests and token counts for the selected date and resources and delivering insights into your cost and usage patterns over the period chosen.
Along with filtering by date range and grouping by resources, you can also visualize your costs and usage by selecting monthly and daily granularity. This helps provide deeper insights into the costs, API requests, and associated token counts to identify trends, pinpoint cost drivers, and detect anomalies.
For monthly granularity, the date range cannot exceed 1 year, ensuring selections are within a 12-month period.
For daily granularity, the date range is limited to a 30 day period.
By default, the dashboard displays data from the 1st day of the current month to today's date.
Additionally, selecting the "Clear filter" option resets the filters, restoring the default dashboard state.
You can visualize your Organization's cost and usage details for the following components:
Spend by Batch recipes