X & Y are random variables
Real numbers a & b, which minimize E[(Y – a − bX)^2] over all possible (a,b) are being determined for least squares/theoretical linear regression of Y on X.
Solve f(a,b) = E[(Y – a − bX)^2] in order to find the critical points where the gradient equals 0.
Differentiation & expectation can be switched with respect to a & b, such that ∂aE[(⋯)] = E[∂a(⋯)]
Get Answers For Free
Most questions answered within 1 hours.