​
Overview

Evaluation feature allows you to evaluate the text-to-SQL model against your database to ensure accurate query generation and answers. This feature is useful for verifying the model’s performance and identifying areas for improvement.
Evaluation overview

​
Evaluate text-to-SQL against your database

1

Create test questions

There are 2 ways to create test questions:
  • Manual: Manually create test questions by typing them in the input field.
  • Upload CSV: Upload a CSV file containing test questions.
2

Run questions

Select the test questions you want to evaluate and run them against your database.
Run questions
3

Verify answers

Verify the generated SQL queries and answers to ensure they are accurate.
Verify answers

​
FAQs

​
How do I correct an incorrect query?

If the generated SQL query is incorrect, here are some steps you can take:
  • Add correct query into Query Library: Save the correct query in the Query Library for future reference.
  • Enrich data catalog: Add missing information to the data catalog to help the model generate accurate queries.
  • Storing distinct values: Use the Distinct Values feature to store unique string values of a column.

​
Can I evaluate multiple questions at once?

Yes, you can evaluate multiple questions at once by selecting them and running the evaluation.