Interesting study on predicting prices
Posted: Mon Apr 21, 2003 4:43 pm
On my site I posted a section from a book called "mind traps".
I have had many positive comments from it.
I wanted to share it with members of this forum.
The following text was taken from a popular trading book, Decision Traps, by J. Edward Russo and Paul J.H. Schoemaker. In this book, nine different types of decisions were tested using three different decision methods. The accuracy of the decisions was then compared and analyzed for effectiveness in predicting final outcomes. The investigator looked at different types of decisions, predicting grades, predicting recovery from cancer, performance of life insurance salesmen, as well as predicting changes in stock prices. He used three different decision making processes: an Intuitive Prediction Model, a Subjective Linear Model, and an Objective Linear Model.
Intuitive Model = Discretionary Trader
Subjective Model = Technical Trader
Objective Model = Systems Trader
Intuitive Prediction Model (Discretionary Trader)
Intuitive prediction is defined as making a decision without the use of any objective or quantifiable data. For instance, in trying to predict the academic performance of graduate students, the researches asked their advisors to do so without seeing their grades and just by talking to them. The decision-makers had to rely on their intuitive impressions and any other factors they thought relevant (how the student dressed, their language skills, grooming habits, etc.). This is the same way discretionary traders make trading decisions - using intuition and gut instinct. In predicting the stock prices, it is highly likely that the researcher engaged a discretionary trader to predict the future prices of stocks.
Subjective Linear Model (Technical Trader)
A Subjective Linear Model is a much more complex decision making process. It starts with the interviewing experts in a field and learning how they make decisions. The researcher literally asks the expert how he or she makes decisions and they respond by explaining how they make their predictions. Although these experts are not using quantifiable data, they have enough experience and knowledge in their field to be successful. This decision making process is then outlined by the researcher.
For instance, a physician, highly experienced in treating cancer, has probably become fairly adept at predicting the life expectancy of his patients, even without using any objective data. The researcher interviewed the physician and attempted to determine exactly how the physician made this assessment. Then the researcher put this newly quantified data into a regression model and attempted to predict the life expectancy of cancer patients.
This is very similar to how a technical trader makes decisions. He goes to seminars and reads books to learn how the experts make decisions using technical indicators. He then takes what he learns and attempts to trade like he experts. In a sense, he does his own regression model of the expert's process to make trading decisions.
Objective Linear Model (System Trader)
For the Objective Linear Model, the researcher developed an objective model based on historical tests and observations to predict results. This is defining and using quantifiable data, running historical tests, and then using the results of the tests to predict future outcomes.
For instance, the researcher would look at reams of physical data from terminal ill patients, and correlate the data with how long the patient lived. After running the historical tests, the researcher would then obtain the physical data form cancer patient, and using the historical test data, attempt to predict how long that cancer patient will live.
This is exactly what a system trader does. He runs historical tests and then uses that data to take a position in the market. He uses objective quantifiable data tested historically to make his trading decisions. The following table shows the results of tests.
Types of Judgment Intuitive Prediction Subjective Linear Objective Linear
Academic Performance of Graduate Students .19 .25 .54
Life Expectancy of Terminally Ill Patients -.01 .13 .35
Change in Stock Prices .23 .29 .80
Mental Illness using Personality Tests .28 .31 .46
Grades and Attitudes in Psychology Course .48 .56 .62
Business Failure using Financial Ratios .50 .53 .67
Student's Ratings of Teacher's Effectiveness .35 .56 .91
Performance of Life Insurance Salesmen .13 .14 .43
IQ Scores using Rorsach Tests .47 .51 .54
Mean Scores using Rorsach Tests .33 .39 .64
In every case, the Subjective Linear Model outperformed the Intuitive Prediction Model but only by a small margin. If you look at predicting the changes in stock prices, the Subjective Linear Model only slightly outperformed the Intuitive Prediction Model.
The real insight from this study comes when we look at the results of the Objective Linear Model. In every case, the Objective Linear Model outperformed both the Intuitive Prediction model and the Subjective Linear Model. In some cases, the improvement was minor, and in others it was substantial. It is interesting to observe that the greatest improvement came when using the Objective Linear Model in predicting the changes in stock prices.
I have had many positive comments from it.
I wanted to share it with members of this forum.
The following text was taken from a popular trading book, Decision Traps, by J. Edward Russo and Paul J.H. Schoemaker. In this book, nine different types of decisions were tested using three different decision methods. The accuracy of the decisions was then compared and analyzed for effectiveness in predicting final outcomes. The investigator looked at different types of decisions, predicting grades, predicting recovery from cancer, performance of life insurance salesmen, as well as predicting changes in stock prices. He used three different decision making processes: an Intuitive Prediction Model, a Subjective Linear Model, and an Objective Linear Model.
Intuitive Model = Discretionary Trader
Subjective Model = Technical Trader
Objective Model = Systems Trader
Intuitive Prediction Model (Discretionary Trader)
Intuitive prediction is defined as making a decision without the use of any objective or quantifiable data. For instance, in trying to predict the academic performance of graduate students, the researches asked their advisors to do so without seeing their grades and just by talking to them. The decision-makers had to rely on their intuitive impressions and any other factors they thought relevant (how the student dressed, their language skills, grooming habits, etc.). This is the same way discretionary traders make trading decisions - using intuition and gut instinct. In predicting the stock prices, it is highly likely that the researcher engaged a discretionary trader to predict the future prices of stocks.
Subjective Linear Model (Technical Trader)
A Subjective Linear Model is a much more complex decision making process. It starts with the interviewing experts in a field and learning how they make decisions. The researcher literally asks the expert how he or she makes decisions and they respond by explaining how they make their predictions. Although these experts are not using quantifiable data, they have enough experience and knowledge in their field to be successful. This decision making process is then outlined by the researcher.
For instance, a physician, highly experienced in treating cancer, has probably become fairly adept at predicting the life expectancy of his patients, even without using any objective data. The researcher interviewed the physician and attempted to determine exactly how the physician made this assessment. Then the researcher put this newly quantified data into a regression model and attempted to predict the life expectancy of cancer patients.
This is very similar to how a technical trader makes decisions. He goes to seminars and reads books to learn how the experts make decisions using technical indicators. He then takes what he learns and attempts to trade like he experts. In a sense, he does his own regression model of the expert's process to make trading decisions.
Objective Linear Model (System Trader)
For the Objective Linear Model, the researcher developed an objective model based on historical tests and observations to predict results. This is defining and using quantifiable data, running historical tests, and then using the results of the tests to predict future outcomes.
For instance, the researcher would look at reams of physical data from terminal ill patients, and correlate the data with how long the patient lived. After running the historical tests, the researcher would then obtain the physical data form cancer patient, and using the historical test data, attempt to predict how long that cancer patient will live.
This is exactly what a system trader does. He runs historical tests and then uses that data to take a position in the market. He uses objective quantifiable data tested historically to make his trading decisions. The following table shows the results of tests.
Types of Judgment Intuitive Prediction Subjective Linear Objective Linear
Academic Performance of Graduate Students .19 .25 .54
Life Expectancy of Terminally Ill Patients -.01 .13 .35
Change in Stock Prices .23 .29 .80
Mental Illness using Personality Tests .28 .31 .46
Grades and Attitudes in Psychology Course .48 .56 .62
Business Failure using Financial Ratios .50 .53 .67
Student's Ratings of Teacher's Effectiveness .35 .56 .91
Performance of Life Insurance Salesmen .13 .14 .43
IQ Scores using Rorsach Tests .47 .51 .54
Mean Scores using Rorsach Tests .33 .39 .64
In every case, the Subjective Linear Model outperformed the Intuitive Prediction Model but only by a small margin. If you look at predicting the changes in stock prices, the Subjective Linear Model only slightly outperformed the Intuitive Prediction Model.
The real insight from this study comes when we look at the results of the Objective Linear Model. In every case, the Objective Linear Model outperformed both the Intuitive Prediction model and the Subjective Linear Model. In some cases, the improvement was minor, and in others it was substantial. It is interesting to observe that the greatest improvement came when using the Objective Linear Model in predicting the changes in stock prices.