Challenges
How to create a test strategy for your AI products
Challenges are test cases for your AI product.
Every challenge has inputs, and outputs. You can log unlimited number of files and data into both the input and the output side of the screen.
Create a challenge in the dashboard
Click the "Add Challenge" button to open the creation dialog
Select your project from the dropdown menu
Enter a name for your challenge, and optionally add a description
Click "Create Challenge" to create and navigate to your new challenge
Once created, you can add inputs in one of three ways:
- Generate from scratch: Provide a brief or prompt that will be used to generate content
- Upload files: Add input files such as CSVs, PDFs, or other documents
- Website: Enter a URL to show a website in an iframe
Auto created challenges
If you log into a challenge using the SDK that doesn't exist, Datograde will create it for you. This enables you to log unseen test cases.