AGI Agents (6-week course) › W6 · Evaluating agents honestly

0/0 this session +0 XP
Multiple choice Easy sample-sizenoise ~50s

On a 10-task suite your agent went from 6/10 to 7/10 after a prompt change. What can you conclude?

Hints are free to take and they are counted. A correct answer after two hints moves your mastery less than one without — which is the honest way to score it.

Why this question? this skill is new to you; the difficulty is about right — roughly 79% chance you get it; and it needs calibrating — few people have tried it Predicted chance you get it: 79% — the selector aims at 78%.
difficulty fit 0.999
skill need 0.75
review boost 0
calibration bonus 0.12
recency penalty 0
repetition penalty 0
frustration 0