Re: what's the best tool for doing statistical calculations of > 10e6 data points?


On 27-Jan-2006, "revansx" <revansx@xxxxxxx> wrote:

> I'm doing a statistical simulation using a tool called "Dataplot". The
> simulation requires me to sum the results of some simple trig-based
> equations N times (i.e. sum of F(Xn,r) for N = 1 to 10e6 for a given
> value of "r"). --- I'd like to extend this to N=10e9 and possible more,
> but these calculations are prohibitively time-consuming using Dataplot
> which is admitedly and old program. I have already generated my
> statistical data. I just need to crunch it now in as timely a way as
> possible.

That sounds like a simple calculation. The best thing would be to have
someone write a customized and optimized C++ program to do this. It could
easily be 20+ times faster than Dataplot. I could probably write this
program for you in an hour or two. Please contact me if you are interested
in hiring me to do this for you.

--
Phil Sherrod
(phil.sherrod 'at' sandh.com)
http://www.dtreg.com (decision tree and SVM predictive modeling)
http://www.nlreg.com (nonlinear regression)
.