In practical applications of least-squares polynomial fitting, it is always best to use the highest-order polynomial that is computationally feasible.

Least-squares function fitting works well for interpolation, but should never be used for extrapolation.

Recursive least-squares