The Manage Datasets page allows you to upload a .CSV file and save it in PolicyAI for easy testing against policies.

Upload and Configure CSV

Upload a CSV file with your dataset. You can either:

• Use columns named input and expected_output (auto-detected)
• Or select which columns to map to input and expected output

All other columns will be stored as metadata.

https://www.loom.com/share/3ef19f0b061247f793f2a283028fdd50

Refine or edit a Dataset

If you’d like to make changes to the dataset, we have two options.

1. Edit - click “view and edit” on the Manage Datasets page, and then make any changes you’d like. You can add comments, change the expected output (decision/ label), and even edit the content itself.

2. Refine - click “Refine” and then “Generate Policy Labels”. This is a simple way to review any disagreements between your labels and the labels applied by the policy/ LLM. If you want to change your saved label.

   

The red box around the button shows the current label that is Correct in the dataset. If you’d like to change it, click the other box. You can also add an explanation, which helps with any policy iteration and optimization later.