Test an AI Language Tutor With a Conversation and Correction Rubric
A short roleplay reveals whether an AI tutor can support a conversation at your level. Reuse the same role and correction brief across candidates to compare the feedback.
Worked example
French A2 roleplay prompt
Act as a station clerk. I want to change the time of one train ticket. Ask one short French question per turn. After two turns, correct one important mistake and let me retry. Start by asking for my departure time.
Steps
- Pick a language, proficiency goal, and one everyday transaction. Ask the tutor to use short turns and let you answer before giving feedback.
- Introduce the same intentional verb or vocabulary mistake with each candidate. Ask for one corrected sentence and one explanation before trying again.
- Log whether the next question stays in role, whether the correction addresses the intended issue, and whether the second attempt is possible without switching languages.
What to check
- The tutor asks about the train time first and does not supply the learner's reply.
- Have a fluent speaker or reliable reference verify unexpected corrections. Judge usefulness by whether you can apply the fix on the next turn.