Prompts
Analyzing Prompt Performance
Understanding how your prompts perform in production is essential for optimizing cost and accuracy. Datograde provides detailed analytics and logs to help you track prompt performance.
Accessing Performance Metrics
- Select a prompt from the Prompts Dashboard.
- Go to the Performance tab to view:
- Execution Frequency: How often the prompt is called.
- Latency: Average time taken to generate a response.
- Cost: Token usage and associated cost.
- Error Rate: Percentage of failed or unexpected outputs.
Using Execution Logs
- Open the Execution Logs tab to see:
- Input and output data for each execution.
- Any errors or warnings generated during execution.
- Use logs to:
- Debug problematic inputs.
- Validate that outputs align with expectations.
Identifying Optimization Opportunities
- Use performance trends to identify:
- High-cost prompts for refinement.
- Low-performing prompts requiring updates or retirement.
- Compare metrics across different versions to choose the most efficient and effective prompt.