If we are tele-operating a robot, we ideally want to minimize cost. We want to estimate a user’s goal via user inputs. Predict the most likely goal + assist for it.

“find a cost function for which user input \(u\) is optimal”.

• system does not know the goal
• the user may not change their goal on a whim

Hindsight Optimization

To solve this, we use QMDP: “select the most optimal actions to estimating cost-to-go assuming full observability”.

history

economics

• utility theory —

psychology

• Pavlov’s salivating togs: biological reinforcement learning
• Alan Turing thought about this regarding

neuroscience

• bio-simulated things

computer science

• how “systems composed of matter can have properties of the mind

engineering

• control theory

maffs

• statistics

operations research

• WWII logistics optimization
• allocating decisions, etc.
• simplex algorithm

societal impact

• classes can help amplify intention (whether good or evil)
• data-driven methods

Homestead Act is the legal colonization of the west that was a Contributor to the Guilded Age

statistical context

Homogeneity is a measure of how similar many things are.

Linear Algebra context

…of linear maps

homogeneity is a property of Linear Maps to describe the ability to “factor out” scalars

…of linear equations

A homogenous linear equation is one which the constant term on the right of the equations are \(0\).

homogenous system with more variables than equations has nonzero solutions

Proof: You can imagine the system as a matrix equation: