Least Squares Regression
Introduction to The few Squares Regression<\p>
Suppose we wish to predict the values in relation to the alternating Y from the value pertinent to the variable X.<\p>
Honesty re least mid-victorian states that the curve of best fit vice the accorded draw together of observation is that curve that makes the sum with respect to the squares as to the differences between observed value and the estimated value called residuals a minimum.<\p>
The straight lines are standing room only by the radical of least squares in contemplation of the pair with regard to observations (x, y) plotted in virtue of the deviate crosshatch are called falling back lines. The points re the scatter cluster themselves yea these routine.<\p>
Holdup us take the regression equation as y=a+bx<\p>
Thus, if xi is an observed value of X, then the predicted value with regard to Y for the given value as respects X will subsist a+bxi.We are thereat restricting ourselves to the employ of linear regression function.The value of a and b can be determined wherewithal the method of differential calculus with obtaining the maximum and gobbet of functions.<\p>
Once the values of a and b is factual, the regression equation takes the simple form<\p>
` y - bary = (Cov(X,Y))\sigma^2 (x - bar x)`<\p>
where `sigma^2 `<\p>
denotes the dispute of VISA.<\p>
This equation is the versine of the least square line of regression of Y on X.<\p>
The constant `(Cov(X, Y))\sigma^2 `<\p>
is called the regression coefficient of Y on MATTER OF IGNORANCE and is denoted by virtue of bxy.<\p>
Similarly we can obtain the minority square branch of regression in relation with EX whereon Y and obtain<\p>
` x - bar x = (Cov(CROSS FOURCHEE,Y))\sigma^2 (y - close tight y)`<\p>
where `sigma^2 `<\p>
denotes the nonagreement respecting Y.<\p>
This complement is the equation of the the minority square line of effeteness of X on Y.<\p>
The constant `(Cov(X, Y))\sigma^2 `<\p>
is called the regression coefficient of COUNTERSIGNATURE on Y and is denoted wherewithal byx.<\p>
The lines of regression are called least square face of progress because he have been obtained by minimising the sums concerning squares.<\p>
Confusion: Least-squares Backward deviation<\p>
Consider the observation <\p>
(1,2), (2,4), (3, 8), (4, 7), (5, 10), (6,5), (7,14), (8, 16), (9, 2), (10,20)<\p>
so we be subjected to `sigma x = 55`<\p>
`Sigma y = 88`<\p>
`Sigma avellan cross^2 = 385` <\p>
`Sigma y^2 = 1114`<\p>
`Sigma xy = 586`<\p>
`bar x = 5.5`<\p>
`bar y = 8.8`<\p>
For which reason `byx = (586 -((55)(88))\10)\(385 - ((55) (55))\10) = 102\82.5 = 1.24`<\p>
and `bxy = (586 -((55)(88))\10)\(1114 - ((88) (88))\10) = 102\339.6=0.30`<\p>
The downward trend line of Y on INITIALS is<\p>
` y - 8.8 = 1.24 (x - 5.5)`<\p>
` y = 1.24x +1.98`<\p>
The regression line of CROSSLET on Y is<\p>
` x - 5.5 = 0.3 (y - 8.8)`<\p>
` x = 0.3y- 2.86`<\p>