Page 1 of 1

why is curve fitting so bad?

Posted: Thu Jul 15, 2004 9:08 pm
by TradingCoach
I am trying to understand this - I do not mean to curve fit a system for a specific commodity or an index for example but having a system curve fitted for say,l commodities is acceptable in my opinion. What do you think?

Posted: Thu Jul 15, 2004 9:52 pm
by verec
You may want to read what c.f. had to say on this.
But to make the discussion more productive, you might want to expand a bit on what you mean by
having a system curve fitted for say,l commodities is acceptable in my opinion
What kind of curve fitting? Parameter optimization? Market selection? And as a way to achieve what, better prediction ?

Hmm.

Posted: Sun Jul 18, 2004 2:35 pm
by TradingCoach
Good link. Thanks
I meant primarily parameter optimization and testing on a well selected group (basket) that one would normally trade from. I suppose it is ok to exlude Palladium if you do not ever want to trade that market, but trade gold and silver....

Posted: Sun Jul 18, 2004 11:50 pm
by TC
Curve fitting gets a generally bad press because it is so often associated with overfitting system parameters to past data to the extent that the system breaks down on out-of-sample data.

I do not have a problem conceptually with the idea of curve fitting, it seems reasonable to explore a range of parameter values to find a region that seems to be yield acceptable results.

However, I will never trade a system that has been optimised on a single market, even if that is the only market I plan to trade. If my system is not broadly profitable on a basket of futures markets or a random portfolio of 30+ equities I do not want to risk money on it.

Given the huge advantage equities have over futures (8000 stocks cf 80 futures markets) I have the luxury of leaving all of the equities I plan to trade out of the testing phase and keep them exclusively for out-of-sample testing.

For futures I optimise my parameters on a portfolio of every reasonably-liquid continuous contract I can find. Currently in TradeStation this is about 40 but hopefully soon, with data importing, I will increase this to 80.

Posted: Mon Jul 19, 2004 1:23 am
by blueberrycake
TC wrote: Given the huge advantage equities have over futures (8000 stocks cf 80 futures markets)
While I do not want to start on a discussion of whether futures or equities are "better". I should point out that the 8000 stocks figure is extremely misleading. Not only are most of the 8000 highly illiquid small cap stocks, but the vast majority of them are also well correlated to one of the primary indexes. The number of liquid stocks that have very little correlation to each other is actually relatively small.

-bbc