Prompt Observability

Karini AI's prompt playground enables you to easily observe prompt traces. When a prompt response is being generated, you can click on the trace icon to view detailed step-by-step information about the prompt request processing and response generation.

This includes the following:

  • Traces and Requests: You can see the traces for each operation that is executed during the prompt processing. It includes the following:

    • Input:

    • Output:

  • Attributes: These include various parameters and metrics associated with each request. Some of the attributes include:

    • Input Tokens:

    • Completion tokens:

    • Model parameters such as temperature, max tokens etc.

<<Video of prompt traces>>

Last updated