Monday, July 4, 2011

Natural chaos in the markets

I'm giving a short talk in a couple weeks at a meeting of a Leverhulme Trust project on tipping points in physical and social systems. The organizers just asked me to send a rough outline of what I'm going to talk about -- under the working title of Financial Instabilities -- so I thought it might be useful to do that in a blog post, which might also give some useful background and motivation for everything in this blog (i.e. how ideas from physics can help us understanding financial systems). So here goes.

I used to work in plasma physics. A plasma is just a gas -- say, simple hydrogen gas -- which has been heated up to the point where the atoms come apart. At high enough temperature, the energy binding an electron to the nucleus (a single proton in this case) to form an atom is overwhelmed by the kinetic energy in collisions. The result is a hot gas of charged electrons and nuclei (protons), in which the particles, being charged, now interact over extended distances, unlike in normal gases where particles only interact when they undergo direct collisions.

These longer range interactions make plasmas behave very differently from ordinary gases, whether the plasma is in the Sun or the Earth's upper atmosphere, in a nuclear reactor, the interstellar medium, or in a particle beam racing around an accelerator. The basic properties of a plasma in equilibrium -- say, held at a fixed temperature in a glass tube -- were worked out (at least approximately) long ago, although the physics is still so rich that many subtle mysteries remain.

As soon as you do anything interesting with a plasma, taking it a little out of equilibrium, things get infinitely more complicated. Natural plasmas not held in fixed and unchanging conditions do all kinds of surprising things -- mostly involving natural instabilities driven by positive feed backs.

I think this example of what happens in a very simple system should give us some hints about how we should go about studying far more complicated things like markets and economies.

A good example of plasma surprises comes from the ongoing project to harness energy from nuclear fusion. The recipe for success seems simple: heat up some hydrogen gas to enormous temperatures and you create conditions in which colliding hydrogen nuclei will fuse together to form heavier nuclei. As an aside, you can't use ordinary hydrogen, but have it's isotopes, deuterium or tritium, the nuclei of which contain a proton and either one or two neutrons. These things can fuse together into unstable nuclei, which decay, ultimately creating nuclei of the stable element helium, with two neutrons and two protons. Lots of energy is given off in the process, so the reaction can be self-sustaining.

Lots of fusion requires nothing but high temperature (so the collisions are very energetic) and high density (so there are lots of collisions). So you put a mixture of deuterium and tritium into a container, heat it up and compress it, and there you go -- cheap, virtually inexhaustible energy. The only problem -- and it's a very big problem -- is making the damned plasma behave itself as you try to do this.

One of the principal routes for pursuing fusion energy is so-called Inertial Confinement Fusion (ICF). The idea is to take a tiny pellet which has a mixture of deuterium and tritium in it, and blast it from all sides with extremely high intensity x-rays. This violent bath vaporizes the pellet surface, producing plasma that explodes outward, compressing the rest of the pellet inward and creating extreme densities and temperatures. Through further mechanisms -- colliding shock waves and such -- you hope to get a fair number of nuclei colliding with sufficient energy to undergo fusion, giving off still more energy.

But it doesn't work, at least not yet, because of plasma misbehavior. The figure below illustrates the typical problem -- as the dense hot plasma rushes inwards, the spherical symmetry inevitably gets spoiled by growing ripples. These are caused mostly by the so-called Rayleigh-Taylor instability that happens whenever a lighter fluid pushes on a heavier fluid. As the waves get bigger, this first instability causes secondary instabilities of other kinds. In the figure below, the initially nice symmetry gets hopelessly ruined and different parts of the compressing system get mixed together, which undermines the process that would have given high temperature and density. Interestingly, what happens in inertial confinement fusion during implosion (left image) is very close to what happens during a supernovae explosion (right image).

The second figure below shows how one wave growing from the Rayleigh-Taylor instability soon creates a cascade of other instabilities, and the situation becomes infinitely complex very quickly through the interaction of several instabilities.

Remember, this all comes out of nothing but a system of electrons and positive nuclei compressed and heated in a spherically symmetric situation. The system in fact is remarkably simple. But natural instabilities -- mechanisms that make small differences and imbalances grow into much larger ones -- make it's behaviour anything but simple. Fifty years of intense research and engineering on inertial confinement fusion still hasn't managed to tame these problems. The plasma always finds another way to do something surprising that no one predicted.

Because of these instabilities, there's not a lot that is simple in plasma physics. Systems that are conceptually simple -- a beam of one single kind of particle flying around a circular ring in an accelerator -- can go unstable in hundreds of ways. There used to be a book (now out of print, I think) called the Handbook of Plasma Instabilities, which tried to list and describe all the stereotypical ways that a plasma in different simple situations will do something surprising and unexpected because of positive feed backs. It was about 800 pages long. Every entry testified to some situation in the past in which physicists or engineers had tried to do something with a plasma, only to find that it refused to go along -- its stable behaviour giving way, often explosively, to some wobbling or mixing or unexpected heating and so on.

The names of these instabilities refer crudely to what happened, why it happened or who first explained what happened. The list (wikipedia gives a brief one here) starts with the Beam acoustic instability, Bump-in-tail instability, Buneman instability, Cerenkov instability, Chute instability, Coalescence instability, Collapse instability, Counter-streaming instability, etc, continues through the Fan instability, Filamentation instability and Firehose instability leads up to the Oscillating two stream instability, Pair instability, Parker instability and Peratt instability, and finishes with the Two-stream instability, Weak beam instability, Weibel instability and Z-pinch instability. That's just a sample.

All the instabilities mentioned above illustrate how a really simple thing -- some charged particles held in a bottle -- has an extraordinarily rich set of dynamics because of natural non-linearities and interactions and the positive feed backs to which they lead. In the case of plasma, we know the laws of behaviour for the individual particles with perfect accuracy (Newtonian mechanics with corrections from quantum mechanics when necessary). Even so, these systems still surprise as as much as they do what we expect.

Now, let's think about finance and economics. Here we're dealing in general with systems made of people driven by thoughts and emotions and interactions with other people. We surely don't know with perfection the laws of behavior of these people -- we have a few crude rules offering guidance to how they sometimes behave or might behave. Humans being among the most complex things in the universe, we should surely expect these systems to present a much richer set of possibilities than a simple plasma. Indeed, we know that markets and other economic systems, historically, have routinely acted in surprising ways and caused crises of many different kinds. Even so, theories in economics and finance have until very recently been centered almost entirely on the study of equilibrium systems, with positive feed backs rarely being considered.
This shortcoming is one of the principal motivations for lots of recent work by physicists and others aimed at modeling and understanding natural instabilities in economic systems. The list of instabilities likely to be found will probably be a lot longer than the list in plasma physics. In my talk in Durham, I'm going to take a stab at making a similar (crude and very incomplete) list of some economic and financial instabilities. As in plasma physics, we should find instabilities acting on many timescales -- from milliseconds up to years. We should find some that act through fairly mechanical processes (laws which compel certain behaviours), and others working on the basis of natural human psychological and decision making tendencies (learning, speculation and so forth). We'll find some that take off through the actions of only a few parties (hedge funds, for example, during the "Quant Meltdown" of August 2007) and others driven by large-scale network effects.

I haven't finalized my talk yet,  but I intend to describe very briefly some recent work on a number of these kinds of instabilities (perhaps they should be called classes of instabilities, as many distinct situations may fall into classes of quite similar behaviour). My initial list:

1. Expectations instabilities -- these include market rallies or crashes driven by the interaction of chartists versus fundamentalist investors, or more general models of markets or economies in which people have heterogenous expectations. A fascinating example (of which there are quite a few) is this paper by Brock and Hommes from 1997 in which almost rational individuals acting adaptively in a simple market lead to natural instabilities and a true strange attractor (dynamical chaos) in the market.

2. Leveraged/correlated strategies instabilities -- the sub-prime fiasco is probably a good example of this, as so many banks were heavily leveraged and invested in CDOs and other assets ultimately backed by the mortgage market. But a more specific and perhaps simpler example to analyse is the Quant Meltdown of August 2007, during which a number of hedge funds went bust in two explosive episodes lasting only a few hours. I'll describe a simple and beautiful model (in this paper by Farmer, Geanakoplos and Thurner) suggesting a natural instability which puts a market in a metastable state in which explosive collapse is certain in the long run, yet hard to predict in its timing as the end is triggered by a random spark.

3. Hedging instabilities -- several recent papers (here and here, for example) document how adding more hedging instruments to a market, which traditional theories suggest should make markets more complete and effficient, actually makes them more unstable.

4. Trend following/relative strategy instabilities -- in a recent post I reviewed ongoing events in markets driven by high-frequency trading which suggest the action of some very unstable natural dynamics. These dynamics, still unknown in detail as yet, were probably behind the Flash Crash of 6 May, 2010, as well as a number of more recent similar events in which single stocks have plummeted to a few pennies in a matter of minutes before recovering. One of the most interesting analyses I've seen is this one by computer scientist Michael Kearns and colleagues, who analysed data from HFTs and found the signature of dynamical chaos (positive Lyapunoc exponents) in the dynamics of the order book (the book in which actors place market orders or limit orders to facilitate trades). The trouble seems to be caused by algorithms which use "relative strategies" -- taking action not on the basis of some fundamental view of prices, but reacting to recent price movements.

5. Diversification instabilities -- I'll also explore briefly the conclusions of this provocative paper which shows how an increasing density of risk sharing between banks in a network, naively believed to decrease overall systemic risk, can actually increase risk to the entire system. A network can become dangerously over-dense.

I'll also make a few stray comments on some other instabilities too -- the "loss of trust" instability, the "gaming" instability, the "looting" instability and the "this time is different" instability.

But my point overall isn't to argue that this list is anything but arbitrary. The more important point is to argue that making a list of this sort, and understanding the spectrum of natural market instabilities, ought to be a main focus of the science of finance and economics. The long-standing fixation on equilibrium analyses in economics effectively rule out of existence precisely the events and processes of greatest interest.


  1. Keep up the good work Mark.

  2. Thanks for visiting the very first day with the all your life. Isagenix can be your chance for monetary flexibility plus a very existence of pleasure knowing that you're helping others. Along with using the finest quality cleanse and cleansing goods that enable you to control your weight and wellness, additionally, you will get the opportunity have fun playing the pay plan.

  3. Hide your valuables in plain site with Best Diversion Safes's selection of diversion safes and hidden compartments. Burglar's spend an average of 8 minutes in burglarizing a home looking for valuables, lock boxes, and other obvious containers that might be worth their while. What better way to throw them off the scent than with a diversion safe for home security. Diversion safes are indistinguishable from the actual product they imitate. So if you are looking for the best diversion safes, you will find that we have over sixty different diversion safes that you can choose from. click here

  4. What is your most frightening unforgettable experience? Whenever I am asked that question by some one, I instantly flash-back two death-defying instances in my life—I had an encounter with an attacker twice and I almost lost my life to these horrible people. click here

  5. There's a lots good data in this blog, though I would like tell you something. I can understand the content, but the navigation doesn't work so good. I never usually post on blogs but I have found this is very useful work. I high appreciate this post. It’s hard to find the good from the bad sometimes, but I think you’ve nailed it! would you mind updating your blog with more information? Stun Guns and Pepper spray

  6. cheap sunglasses

    I will bookmark this site. I need it so much.

  7. This blog has useful details. It is informative. It is useful to me.


  8. This is what I am looking for. I am trying to find out information about topic. So happy to read your blog.

    Read more here about The Nut Job Free Online Movie

  9. This post is really informative. I feel very tired of my future assignment. My topic is about what your post said. So you saved my life.

    b schools in hyderabad

  10. This post is useful to me. My job needs these information.

    read more here

  11. wow it is he useful and helpful information...thank you for the information.....

    FCA complaints

  12. it is the very nice information...AND very cute images...i got the many more information for this blog please give me a many information...thank you for sharing the blog....

    Consumer credit

  13. I never did figure out where we voted to build throw away crap instead of the most long lasting, reparable equipment. I still use a toaster built in 1928.

    Its all kabuki to hide the machinations of the global inherited rich around the world. Its too important and complicated for us little people to understand…….you just need more FAITH.
    self defense products for women

  14. stun gun and pepper spray combo are committed to providing affordable non-lethal self defense products to everyone that desires them

  15. The great information about the plasma with the clear images. I am finding these information. best bear spray

  16. This comment has been removed by the author.

  17. Thanks for your anxiety in addition to results! This stuff with your web page is usually excellent. Furthermore When i really enjoy ones choices. For me these include valuable things. Anyhow thanks

    best stun baton

  18. Good post. This is a very nice blog that I will definitively come back to more times this year! Thanks for informative post. I am sure this post has helped me save many hours of browsing other similar posts just to find what I was looking for. I just want to say: Thank you!
    tbo tech

  19. Nice page indeed. thanks a lot for having what you've got in here. Impressive indeed.
    ovulation and fertility calendar

  20. Thank you for posting the great content…I was looking for something like this…I found it quiet interesting, hopefully you will keep posting such blogs.
    soda harmful effects

  21. First i would like greet author.Articles of interest, it is very nice to be listened and learned. Thanks for providing valuable information.
    For up coming govt jobs in delhi

  22. Thanks for the information. Your website really
    good information.

  23. TSPSC TRANSCO GENCO Recruitment 2015

    thanks for sharing the useful article very helpful .............

  24. UPSSSC Recruitment 2015 JE Technical 1377 Jobs

    We need to thank admin for publishing useful information..............

  25. There are many of govt jobs in Middle Eastern countries for those who have good technical knowledge in Mechanical and computer fields....

  26. Do not know whether govt jobs these days have same openings in typing, steno, like it used to be earlier, ie 5 to 6 years ago......????

  27. Latest Govt Bank Jobs 2016

    Thanks for providing valuable information in this article by author

  28. Latest Govt Jobs 2016

    I really appreciate your content. this article has actually peaks my interest. I'm going to bookmark your site and keep checking for brand new information.........................

  29. This is such a great experience hope to see and read more essay here. I cant wait for your next post. By the way, the photo looks so stunning.
    happy wheels
    super mario bros

  30. Good post. This is a very nice blog that I will definitively come back to more times this year! Thanks for informative post. I am sure this post has helped me save many hours of browsing other similar posts just to find what I was looking for. I just want to say: Thank you!

  31. Thanks for all your information, Website is very nice and informative content.

    goverment new jobs

  32. This blog has useful details. It is informative. It is useful to me

  33. MPCDF Technician Assistant Grade 3 Recruitment 2016

    Nice content many thanks! We think your posts are excellent as well as hope there will be more in future........

  34. Simply awesome article. Good information

  35. Good post. This is a very nice blog that I will definitively come back to more times this year! Thanks for informative post

  36. Andhra Pradesh 10th Results 2016

    First i would like greet author, thanks for providing valuable information.............

  37. Good Post, I’ll bookmark your blog and take a look at again right here regularly.
    Latest Railway Jobs 2016

  38. Good to know about the useful information from your site Sarkari

    Result keep informing like this

    Railway Jobs

  39. Thanks for sharing details about Natural chaos in the markets

    Govt Jobs

  40. We're Lucky to have a website like this for sarkari result as I am preparing for the government jobs exams in India. Thanks a million for maintaining the unique and rare content which is also helping me prepare for the exams.

  41. Welcomes to google terminal keep sharing such ideas in the future as well.
    google snake this was actually EARN TO DIE
    what i was looking for,and i am glad to came here! AGE OF WAR 2
    Hi! I’ve been reading your blog for a while HAPPY WHEELS
    I want you to thank for your time of this wonderful read!!! Slitherio
    Amazing insight you have on this, Slither io This article always blew me BIG FARM

  42. I was working and suddenly I visits your site frequently and recommended it to me to read also. Age Of War 2
    Big Farm | Slitherio
    Tank Trouble | Happy Wheels
    Goodgeme Empire |

  43. Recruitment Notification is one of the Top most Job Portal Job notifications 2017there

  44. 123freshers is one of the biggest Indian Job Site so here you will getLatest Freshers jobs 2017so

  45. Sarkari Recruitment is one of the biggest Indian Job Site so here you will getTamilnadu govt jobs 2017so

  46. Sarkari Recruitment is one of the biggest Indian Job Site so here you will getgovt jobs in madhya pradeshso

  47. Thank for sharing this information. cashback offers are available at cashback coupons

  48. Earn FREE satoshis from Easy Bitcoin. Up to 33 satoshis every 10 minutes.

  49. SBI PO Answer Key available here. Get the complete results about SBI PO Answer Key. For more click here
    Download here

  50. Freelance Best Makeup & Hair Artist in Jaipur with huge experience and Specialization in Bridal and Wedding Makeup,Celebrity Makeup,Professional Makeup,Creative Makeup,Bollywood Makeup and Character Makeup in Delhi,Jaipur,Rajasthan. Natural Makeup that allows your skin to breath with a radiant glow and remains flawless throughout your special day.

    Best Makeup and Hairstyle in jaipur
    Fiza Makeup Academy in jaipur
    Best bridal makeup artist in jaipur(bollywood makeup,creative makeup,Airbrush makeup,character makeup)
    Make up and Hair kit
    Professional makeup artist course in jaipur
    Makeup and hairstyle tips
    Makeup and hair Images
    Makeup and hair tutorials
    Makeup and hair contract