Random Walk Model and Establishing False Cause and Effect Relationships

royce crowd

Historical Notes and Applications of Random Walk Models:

Random Walk models are useful in many areas of physical and social sciences.  Random walks are models where there is an uncertain random element which changes at specified intervals.  These changes accumulate and a added to the original value of the problem creating seemingly random series of numbers whose applications are as varied as they are vast.  Here is a list of some of the applications where Random Walk models have been especially insightful:

  • Economics: Modeling stock share prices
  • Population Genetics:  Analyzing genetic drift
  • Mathematical Ecology: Modeling a foraging animals position
  • World War II:  Used to model an escaping prisoners movements
  • Brain Research: Creates models of neurons firing in the human brain and is helping to understand epilepsy
  • Gambling:  Probability models in lotteries and Las Vegas casinos use Random Walk models in slot machines and to catch cheaters
  • Internet Search Engines:  Google uses a Random Walk Model in its search engine to provide the most relevant search results

The list is long and full of interesting and dynamic problems and scientist are continuously finding more application to this fascinating and difficult area of applied mathematics. The Random Walk Model has also been used to show how to randomly generated series can appear to have a relationship when in fact they are completely random.  This problem of spurious regression is especially interesting to statisticians and economist and one experiment of spurious regression is conducted at the end of this posting.  The random numbers which accumulate in the random walk model have a mean (average) of zero, so that a you are just as likely to get a positive value as a negative value in the random component.  This might indicated that a Random Walk model is stationary, but strangely this is not the case.  The mathematical proof follows.

Mathematical Proof of Non-Stationary property of the Random Walk Models:

Given a Random Walk Model; we want to prove the two conditions of a stationary time series which are constant mean and variance and time independent covariance. Which can be defined mathematically as:

ScreenHunter_01 Oct. 25 10.13

ScreenHunter_03 Oct. 25 10.16

ScreenHunter_04 Oct. 25 10.16

In order to simplify the proof it is beneficial to write the random walk model in summation notation and we can use the principles of induction to prove that the random walk model is equivalent to the following summation…

ScreenHunter_05 Oct. 25 10.19

ScreenHunter_06 Oct. 25 10.21

ScreenHunter_07 Oct. 25 10.21

ScreenHunter_08 Oct. 25 10.21

ScreenHunter_09 Oct. 25 10.25

This simplified version of the equation composed of strictly linear terms in compact summation notation will increase the simplicity of the investigation of the stationary conditions.  The next step is to test the time invariant  covariance condition which is a necessary but not sufficient condition to establish a stationary time series model, but if there exist a time dependent covariance then we can definitively say that the random walk model fails to be stationary.

Time Series Stationary Test 1: Time Invariant Covariance Time Series

ScreenHunter_10 Oct. 25 10.29

ScreenHunter_11 Oct. 25 10.31

ScreenHunter_13 Oct. 25 10.35

ScreenHunter_14 Oct. 25 10.36

Time Series Stationary Test 2: Constant Mean and Variance Time Series

ScreenHunter_15 Oct. 25 10.39

ScreenHunter_16 Oct. 25 10.39

ScreenHunter_17 Oct. 25 10.43

ScreenHunter_18 Oct. 25 10.44


Excel: Random Walk on Excel and FALSE relationships visualized

A simple random walk model can be created on Excel.  An initial value can be added or omitted with the use of a spreadsheet and the iteration process is simply copied down to a large range of cells.  The only formula that is needed is the random number generating formula like in the picture below.  Excel also regenerates the random numbers in a spreadsheet if you press F2+Enter, this feature along with the graphical representation of two series demonstrates how Random Walks can create spurious relationships.

ScreenHunter_20 Oct. 25 10.53

ScreenHunter_11 Sep. 26 23.18

Here one can see how a two random time series models can lead a researcher to conclude a correlation where none exist:

A FALSE strong positive correlation where none exist because graphs where generated via the Random Walk Model.

ScreenHunter_12 Sep. 26 23.20

A FALSE negative correlation where no correlation exist because series are randomly generated in the Random Walk Model.

ScreenHunter_13 Sep. 26 23.21

Advertisements

8 thoughts on “Random Walk Model and Establishing False Cause and Effect Relationships

  1. Wao!! great article!!
    Another application that I though about while reading this article.
    http://en.wikipedia.org/wiki/Brownian_motion

    I wonder if we can model the evolutionary process, via gene mutation and physical/biological traits that species develop over a long period of time, by using the random walks concept; and see whether a random gene mutation along with the influence of natural selection can lead to a better adaptive species.

    Cheers

    1. Ahh yes Brownian motion! How could I forget! Yes, I think that the genetic model for evolution can be created with your suggestions. I also think that since most mutations are random and changing complex machinery in a random way… most of the time has adverse effects then it would take many iterations. Imagine if I randomly deleted or added a part to my cars engine…most of these changes would probably destroy my car, but after many many many tries there is the probability that this random change will benefit the car’s engine and that I would patent the idea thus increasing the proliferation of my random improvement. So I would predict a lot of bad mutations and only a few beneficial ones…that is an interesting problem, but I don’t know enough about biology and mutations to carry it out.

  2. I don’t know If I said it already but …This blog rocks! I gotta say, that I read a lot of blogs on a daily basis and for the most part, people lack substance but, I just wanted to make a quick comment to say I’m glad I found your blog. Thanks, 🙂

    A definite great read..Jim Bean

  3. I don’t know If I said it already but …I’m so glad I found this site…Keep up the good work I read a lot of blogs on a daily basis and for the most part, people lack substance but, I just wanted to make a quick comment to say GREAT blog. Thanks, 🙂

    A definite great read….

  4. SERIOUSLY, AM HUMBLED TO THE POINT TO ADMIT THAT, I HAVE NOT UNDERSTOOD ANYTHING WRITTEN IN THE ABOVE NOTES. ITS SAD, BUT THAT’S THE TRUTH!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s