When to implement a new system

Discussions about the testing and simulation of mechanical trading systems using historical data and other methods. Trading Blox Customers should post Trading Blox specific questions in the Customer Support forum.
Post Reply
SpireTrader
Full Member
Full Member
Posts: 10
Joined: Fri Oct 16, 2009 10:42 am

When to implement a new system

Post by SpireTrader »

So lets say you've got a system employed and during your testing and what not you stumble upon something more attractive. At what point and in what way do you decide to move to the new system? Do you immediately exist all existing positions and start from scratch or what?

Also, when testing using the same parameters but on different markets is it totally ridiculous to take the markets that result in negative average trades out of your test? Classic case of portfolio optimization but perhaps those markets don't trade as well.
sluggo
Roundtable Knight
Roundtable Knight
Posts: 2987
Joined: Fri Jun 11, 2004 2:50 pm

Re: When to implement a new system

Post by sluggo »

HWG wrote: in what way do you decide to move to the new system? Do you immediately exist all existing positions and start from scratch or what?
I'll bet that YOU can invent three or four different ways to "move to the new system". Why don't you post some of your ideas here, along with your opinions about the pros and cons of each one?

Perhaps your thoughts will resonate with readers; or perhaps readers will surprise you by saying "You left out ideas X, Y, and Z (as follows), and these are just as good if not better than the five ideas you proposed."
SpireTrader
Full Member
Full Member
Posts: 10
Joined: Fri Oct 16, 2009 10:42 am

Post by SpireTrader »

Well the plain as day way would be to close out existing positions and start from scratch. Running the new model from the previous ones start date would not work b/c you would have an equity not equal to the actual equity in the account plus existing positions not on. I think the best way would be to start the test from the current day with the current equity and somehow build the new model on top to recognize the existing positions. So if it recognized existing positions it could create exits for them as well as new entry orders.
LeviF
Roundtable Knight
Roundtable Knight
Posts: 1436
Joined: Mon Dec 22, 2003 12:24 pm
Location: Des Moines, IA
Contact:

Re: When to implement a new system

Post by LeviF »

HWG wrote:...is it totally ridiculous to take the markets that result in negative average trades out of your test? Classic case of portfolio optimization but perhaps those markets don't trade as well.
I think you are setting yourself up for a hurtin' down the road if you remove poor performing markets. Who says those same markets have to be bad in the future?

Also, sometimes even though a particular market lost money over the life of a test, doesnt mean it didnt contribute in some other fashion, like reduce drawdown.
SpireTrader
Full Member
Full Member
Posts: 10
Joined: Fri Oct 16, 2009 10:42 am

Re: When to implement a new system

Post by SpireTrader »

Levi wrote: I think you are setting yourself up for a hurtin' down the road if you remove poor performing markets. Who says those same markets have to be bad in the future?

Also, sometimes even though a particular market lost money over the life of a test, doesnt mean it didnt contribute in some other fashion, like reduce drawdown.
Yeah, I totally get that and figured as much. Best bet is probably to select as uncorrelated a group as I can.
sluggo
Roundtable Knight
Roundtable Knight
Posts: 2987
Joined: Fri Jun 11, 2004 2:50 pm

Post by sluggo »

You might choose to view this as a "Should I do X, or should I do Y?" kind of question. X stands for (Trade the old system) and Y stands for (Trade the new system).

Or equally well, X could stand for (make the transition from old system to new, according to These Rules) and Y could stand for (make the transition from old system to new, according to Those Other Rules).

Then you could apply the principle of "minimizing the maximum remorse" as discussed for example in some message threads here.In brief: Why assume you must do one OR the other? Why not do a little of each? If you do a little of each you are guaranteed to participate in whichever one has the most favorable outcome, which reduces (the remorse of betting on a horse that doesn't subsequently win the race).
alp
Roundtable Knight
Roundtable Knight
Posts: 309
Joined: Mon Aug 27, 2007 8:09 pm

Re: When to implement a new system

Post by alp »

HWG wrote:Also, when testing using the same parameters but on different markets is it totally ridiculous to take the markets that result in negative average trades out of your test? Classic case of portfolio optimization but perhaps those markets don't trade as well.
Perhaps you can also find a compromise here by trying to minimize the maximum remorse of different scenarios: 1) the poor past performers actually turning out to be the best future performers; 2) the past optimal portfolio actually proving to be the best future performing portfolio; 3) none of the previous options; and 4) you figure it out.
SpireTrader
Full Member
Full Member
Posts: 10
Joined: Fri Oct 16, 2009 10:42 am

Post by SpireTrader »

back to my original post, I think what I'm more interested in is determining when to add new markets to my current system. I should've clarified that. I just don't want to add new markets starting say tomorrow b/c then the past trades will be reflected in my current equity. So keep the same system but trade more market is the goal.
sluggo
Roundtable Knight
Roundtable Knight
Posts: 2987
Joined: Fri Jun 11, 2004 2:50 pm

Post by sluggo »

Good luck and best wishes. May your research be joyful, and your trading wildly successful.

"New graduates meet real world in uneasy times"
Post Reply