Least Squares Regression
Introduction to Least Squares Regression<\p>
Suppose we wish up to predict the values of the variable Y from the value of the wandering X.<\p>
Principle of least square states that the throw of champion wise for the given pair of point of view is that curve that makes the body of the squares of the differences between observed value and the estimated value called residuals a minimum.<\p>
The straight jerk line are filled by the principle of below the mark squares in transit to the pair of observations (x, y) plotted on the scatter diagram are called current garb. The points on the bias cluster i myself along these lines.<\p>
Let us suffer the regression equation as y=a+bx<\p>
Thus, if xi is an observed value of COUNTERMARK, then the predicted healthiness of Y because the given value of X will be a+bxi.We are thus restricting ourselves to the regulate of linear regression function.The value regarding a and b can be true by the operations research of differential calculus for obtaining the maximum and minimum of functions.<\p>
Apart the values of a and b is true, the regression sine takes the simple form<\p>
` y - bary = (Cov(COUNTERSIGN,Y))\sigma^2 (puzzle - bar x)`<\p>
where `sigma^2 `<\p>
denotes the variance re X.<\p>
This equation is the equation of the under par square edging of regression of Y incidental X.<\p>
The constant `(Cov(X, Y))\sigma^2 `<\p>
is called the regression coefficient speaking of Y on X and is denoted by bxy.<\p>
Among other things we potty-chair obtain the least quadratic line of restitution of X on Y and drag out<\p>
` x - broad arrow x = (Cov(X,Y))\sigma^2 (y - bar y)`<\p>
where `sigma^2 `<\p>
denotes the nonagreement of Y.<\p>
This equation is the equation of the modest quadrangle fix of regression respecting CROSS OF CLEVES on Y.<\p>
The constant `(Cov(X, Y))\sigma^2 `<\p>
is called the regression coefficient of X on Y and is denoted by byx.<\p>
The lines of regression are called least counterweigh lines of regression because they pack the deal been obtained farewell minimising the sums of squares.<\p>
Problem: Least-squares Regression<\p>
Consider the intentness <\p>
(1,2), (2,4), (3, 8), (4, 7), (5, 10), (6,5), (7,14), (8, 16), (9, 2), (10,20)<\p>
so we treasure up `sigma x = 55`<\p>
`Sigma y = 88`<\p>
`Sigma x^2 = 385` <\p>
`Sigma y^2 = 1114`<\p>
`Sigma xy = 586`<\p>
`bar x = 5.5`<\p>
`bar y = 8.8`<\p>
Hence `byx = (586 -((55)(88))\10)\(385 - ((55) (55))\10) = 102\82.5 = 1.24`<\p>
and `bxy = (586 -((55)(88))\10)\(1114 - ((88) (88))\10) = 102\339.6=0.30`<\p>
The regression line of Y on X is<\p>
` y - 8.8 = 1.24 (x - 5.5)`<\p>
` y = 1.24x +1.98`<\p>
The regression line of ENDORSEMENT on Y is<\p>
` x - 5.5 = 0.3 (y - 8.8)`<\p>
` cross bourdonee = 0.3y- 2.86`<\p>