why is curve fitting so bad?
-
- Roundtable Knight
- Posts: 176
- Joined: Thu Apr 17, 2003 9:52 am
- Location: Sacramento, CA
- Contact:
why is curve fitting so bad?
I am trying to understand this - I do not mean to curve fit a system for a specific commodity or an index for example but having a system curve fitted for say,l commodities is acceptable in my opinion. What do you think?
You may want to read what c.f. had to say on this.
But to make the discussion more productive, you might want to expand a bit on what you mean by
But to make the discussion more productive, you might want to expand a bit on what you mean by
What kind of curve fitting? Parameter optimization? Market selection? And as a way to achieve what, better prediction ?having a system curve fitted for say,l commodities is acceptable in my opinion
-
- Roundtable Knight
- Posts: 176
- Joined: Thu Apr 17, 2003 9:52 am
- Location: Sacramento, CA
- Contact:
Hmm.
Good link. Thanks
I meant primarily parameter optimization and testing on a well selected group (basket) that one would normally trade from. I suppose it is ok to exlude Palladium if you do not ever want to trade that market, but trade gold and silver....
I meant primarily parameter optimization and testing on a well selected group (basket) that one would normally trade from. I suppose it is ok to exlude Palladium if you do not ever want to trade that market, but trade gold and silver....
Curve fitting gets a generally bad press because it is so often associated with overfitting system parameters to past data to the extent that the system breaks down on out-of-sample data.
I do not have a problem conceptually with the idea of curve fitting, it seems reasonable to explore a range of parameter values to find a region that seems to be yield acceptable results.
However, I will never trade a system that has been optimised on a single market, even if that is the only market I plan to trade. If my system is not broadly profitable on a basket of futures markets or a random portfolio of 30+ equities I do not want to risk money on it.
Given the huge advantage equities have over futures (8000 stocks cf 80 futures markets) I have the luxury of leaving all of the equities I plan to trade out of the testing phase and keep them exclusively for out-of-sample testing.
For futures I optimise my parameters on a portfolio of every reasonably-liquid continuous contract I can find. Currently in TradeStation this is about 40 but hopefully soon, with data importing, I will increase this to 80.
I do not have a problem conceptually with the idea of curve fitting, it seems reasonable to explore a range of parameter values to find a region that seems to be yield acceptable results.
However, I will never trade a system that has been optimised on a single market, even if that is the only market I plan to trade. If my system is not broadly profitable on a basket of futures markets or a random portfolio of 30+ equities I do not want to risk money on it.
Given the huge advantage equities have over futures (8000 stocks cf 80 futures markets) I have the luxury of leaving all of the equities I plan to trade out of the testing phase and keep them exclusively for out-of-sample testing.
For futures I optimise my parameters on a portfolio of every reasonably-liquid continuous contract I can find. Currently in TradeStation this is about 40 but hopefully soon, with data importing, I will increase this to 80.
-
- Roundtable Knight
- Posts: 125
- Joined: Mon Apr 21, 2003 11:04 pm
- Location: California
While I do not want to start on a discussion of whether futures or equities are "better". I should point out that the 8000 stocks figure is extremely misleading. Not only are most of the 8000 highly illiquid small cap stocks, but the vast majority of them are also well correlated to one of the primary indexes. The number of liquid stocks that have very little correlation to each other is actually relatively small.TC wrote: Given the huge advantage equities have over futures (8000 stocks cf 80 futures markets)
-bbc