Prompt Observability

Karini AI's prompt playground enables you to easily observe prompt traces. When a prompt response is being generated, you can click on the trace icon to view detailed step-by-step information about the prompt request processing and response generation.

This includes the following:

• Traces and Requests: You can see the traces for each operation that is executed during the prompt processing. It includes the following:

  • Input:

  • Output:

• Attributes: These include various parameters and metrics associated with each request. Some of the attributes include:

  • Input Tokens:

  • Completion tokens:

  • Model parameters such as temperature, max tokens etc.

Please refer to the video to view the prompt traces.