Structures

Intro

Rich Sutton and David Silver seems to think that rollout of environments is all we need, and that we are “done” with human generated supervizing data, so… What’s special about human data?

How to get Inductive Bias into your system?

So we learned from what’s special about human data? that if you want to make inference

Content

• How do we capture human choice: choice data
• Bradley-Terry Preference Model

Important Results / Claims

• A softmax predictor follows Luce’s Axiom
• Bradley-Terry Preference Model

positively vs. normatively

• positively: “what is true” - facts, cause and effect, measurable reality
• normatively: “what ought to be” - what is good, bad, etc.

Questions

Interesting Factoids