Re: Need help with method of least squares



On Aug 5, 3:17 am, pereges <Brol...@xxxxxxxxx> wrote:

Ok, I'm from computer science and I really don't understand this part.
Linear least squares require that you take the square of difference
between right and left hand sides of every equation and then sum it
up, and then find the minimum of the function. If there are two
unknowns x and y then you find the partial derivative of this function
with respect to x first to find value of x and then with respect to y
to find out the value of y. But in my case my unknowns are partial
derivatives themselves. So how to differentiate ??

You have an unknown 2x2 matrix, call it X, and three linear systems
of the type X u_i = v_i, i=1,2,3 where the vectors u_i and v_i are
known. Compile these vectors as column vectors of two 2x6 matrices,
call them U and V. Then you have six equations, which can be given
in matrix form as X U = V. Multiply from the right with U' and get
X (UU') = VU'. This is the normal equation for the least-squares
problem and can be solved uniquely if U has full row rank. Solve for
each row of X in turn.
.



Relevant Pages

  • Re: Exact or Least-Squares Solution 5 Equations
    ... >> on the right hand side we have a linear part in the three unknowns. ... >> identical to that of the squared system (the optimal sum of squares will not be ... solve the top 3 simultaneous linear equations for B, C, D ...
    (sci.math.num-analysis)
  • Re: how to analyze the orthogonal experiment data with strong dependence.
    ... linear) in order to do so. ... Takeaki Kariya and Hiroshi Kurata Generalized least squares. ... Wiley series in probability and statistics. ... If the orthogonal design was not the correct design for those ...
    (sci.stat.consult)
  • Re: 2D gaussian fit
    ... My understanding is that in 3D linear regression ... based on least squares Euclidean norm the bound is O. ... >I have an array with data and I want to fit it to a 2D gaussian. ... Find statistical mean and variance and use those as a fit. ...
    (sci.math.num-analysis)
  • Re: Line fitting
    ... This is known as a linear least squares ... spline is a "free knot" problem, ... linear regression modeling works. ...
    (comp.soft-sys.matlab)
  • Re: Frenchs Primordial Study and Schramm & Turner, 1997
    ... >> least squares analysis. ... > How did you determine that the relationship was linear, Franz? ... Fit a hypothesis that the relaionship contains a square ...
    (sci.physics)