AGI Agents (6-week course) › W2 · Q-learning & SARSA

0/0 this session +0 XP
Numeric Easy q-learningtd-update ~60s

A Q-learning agent uses α = 0.5 and γ = 0.95. Currently Q(s, a) = 2. It takes a, receives r = −1 and lands in a non-terminal state s′ where max_a′ Q(s′, a′) = 4. What is the updated Q(s, a)? Give your answer to 2 decimal places.

Fractions, decimals and π are all understood.

Hints are free to take and they are counted. A correct answer after two hints moves your mastery less than one without — which is the honest way to score it.

Why this question? this skill is new to you; the difficulty is about right — roughly 79% chance you get it; and it needs calibrating — few people have tried it Predicted chance you get it: 79% — the selector aims at 78%.
difficulty fit 0.999
skill need 0.75
review boost 0
calibration bonus 0.12
recency penalty 0
repetition penalty 0
frustration 0