Testing Methods of Ranking Opportunities

Discussions about the testing and simulation of mechanical trading systems using historical data and other methods. Trading Blox Customers should post Trading Blox specific questions in the Customer Support forum.
Post Reply
trackstar
Roundtable Fellow
Roundtable Fellow
Posts: 76
Joined: Sun Mar 09, 2008 11:03 pm
Location: Houston Texas

Testing Methods of Ranking Opportunities

Post by trackstar »

Over the past few days I have been gathering data on ranking opportunities. So far I would say that I have been unsuccessful in finding a solid method. I present my data to see if anyone has done similar simulations. I ran 7 methods of ranking over 2 different trading systems to see if I could find a difference between winning trades rank and losing trades rank (another potential edge to exploit).

LT = system 1
ST = system 2

One of the methods in the test is pre-built into Blox. I believe its called "Strength". Measuring a % move over a lagged volatility. Anyone interested in discussing?
Attachments
Another.PNG
Another.PNG (40.53 KiB) Viewed 3757 times
Rank Methods.PNG
Rank Methods.PNG (35.65 KiB) Viewed 3781 times
Last edited by trackstar on Mon Apr 23, 2012 8:49 pm, edited 2 times in total.
sluggo
Roundtable Knight
Roundtable Knight
Posts: 2987
Joined: Fri Jun 11, 2004 2:50 pm

Post by sluggo »

It seems to me that if careful study and exhaustive experimentation has thoroughly convinced you that no algorithm for ranking opportunities exists, which performs better than assigning rankings by a random number generator, then this is very good news.

It's good news because you can "rank" your opportunities completely at random, pick the "top" N number of them (because you don't have sufficient capital to trade them all simultaneously), and feel good that you won't suffer a performance penalty. What's not to like?
trackstar
Roundtable Fellow
Roundtable Fellow
Posts: 76
Joined: Sun Mar 09, 2008 11:03 pm
Location: Houston Texas

Post by trackstar »

ha, thanks Sluggo. You were one of the gurus I was hoping would take notice of my thread. I do appreciate your many many methods of turning a half empty glass into a half full one.

Given that I have tested only 7 methods of ranking opportunities I am a far cry away from being convinced there is no other method that may produce better results. I think most of us here are in search of ways to improve and expand on our edges(which is something that being able to high grade a particular opportunity would clearly do). Skipping trades has never been problem for me psychologically for me, since as you correctly identified, I have not been able to prove any trade is better (or worse) than another. If others have done similar experiments and come to different conclusions, it would be interesting to share our experiences.

I am quite sure, specifically, you have done a comprehensive analysis of simulations such as mine. Did you arrive at a similar end?


edit: Also, I just realized I uploaded the wrong pic initially. I forgot to identify which was which system. Although, for the thorough investigator it was probably apparent based on the Avg Result.
AFJ Garner
Roundtable Knight
Roundtable Knight
Posts: 2071
Joined: Fri Apr 25, 2003 3:33 pm
Location: London
Contact:

Post by AFJ Garner »

trackstar wrote:Skipping trades has never been problem for me psychologically for me, since as you correctly identified, I have not been able to prove any trade is better (or worse) than another.
If you are skipping trades for risk management purposes you need at least to consider some sort of ranking method. Or at least realize by adopting no ranking method you have chosen to take trades in the default order taken from the futuresinfo.txt file.

And (whatever your object is in using ranking) it is certainly not a dumb idea to look at random ranking by way of comparison to your other methods:

Code: Select all

ranking = random (1,randomLimit)
trackstar
Roundtable Fellow
Roundtable Fellow
Posts: 76
Joined: Sun Mar 09, 2008 11:03 pm
Location: Houston Texas

Post by trackstar »

AFJ Garner wrote:
trackstar wrote:Skipping trades has never been problem for me psychologically for me, since as you correctly identified, I have not been able to prove any trade is better (or worse) than another.
If you are skipping trades for risk management purposes you need at least to consider some sort of ranking method. Or at least realize by adopting no ranking method you have chosen to take trades in the default order taken from the futuresinfo.txt file.

And (whatever your object is in using ranking) it is certainly not a dumb idea to look at random ranking by way of comparison to your other methods:

Code: Select all

ranking = random (1,randomLimit)
Totally agree. I do not use Blox for testing but the point is well taken. Hence the reason I started this thread to begin with.
Post Reply