« Singletons | Another Livejournal Meme »
July 03, 2006
On Precious Delusions and Randomness
I've almost finished reading Fooled by Randomness: The Hidden Role of Chance in Life and the Markets. It is brilliant in a quiet, unassuming way. Actually, I find the book annoying because it takes apart so many of my carefully crafted intellectual delusions, for example, the one that allows me to believe I know what's going on because I read a lot of news. However, there is something to be said for an argument that forces you to pause and reflect on your own behaviour (even if the very idea of doing so is irritating).
None of the concepts presented in this book were new to me. My highschool philosophy/calculus teacher first explained the "rare event" argument as the "chicken parable" (a chicken leaves the henhouse and gets fed by a farmer for 1000 days straight, and on the 1001th day runs out and has his head cut off). Mental shortcuts and their associated risks were discussed in both compsci (algorithms vs. heuristics) and cognitive psych (stereotyping as adaptive behaviour). Basic probability and confidence inidicators were outlined in my introductory statistics course (having slept through most of the classes, I missed many details but managed to absorb the key principles). Finally, evo bio helped me make the distinction between "fitness" and "perfection". Oddly, all the pieces were there, but I'd never bothered to put them together in a cohesive way.
As the book repeatedly (and almost gleefully) points out, even people with a solid background in this type of reasoning fail to apply it in daily life.
The author (an eccentric polymath trader who seems like the ideal lunch date) spends rather a lot of time deconstructing the patterns humans like to create out of random events. He debunks the idea of fate and mocks the stupid little explanations people come up with to feel special, "chosen" or even skilled (e.g. US Presidents crediting themselves for upswings in the economy).
Occasionally I entertain the idea of non-random forces influencing my life because it amuses me. It's not hard to spot my own convenient delusions. Of course, accepting the fact that significant elements in life are probably random occurences is depressing and not worth thinking about unless one is trying to make a rational decision.
Having said that, I am routinely "fooled by randomness" in scenarios similar to the ones described in this book. Not my fault though, only human.
For future reference, I am copying down a few salient passages here.
On emotions:
Descartes' Error presents a very simple thesis: You perform a surgical ablation on a piece of someone's brain (say, to remove a tumor and tissue around it) wth the sole resulting effect of an inability to register emotions, nothing else (the IQ and every other faculty remain the same). What you have done is a controlled experiment to separate someone's intelligence from his emotions. Now you have a purely rational human being unencumbered with feelings and emotions. Let's watch: Damasio reported that the purely unemotional man was incapable of making the simplest decision. He could not get out of bed in the morning, and frittered away his day fruitlessly weighing decisions. Shock! This flies in the face of everything one would have expected: One cannot make a decision without emotion. Now, mathematics gives the same answer: If one were to perform an optimizing operation across a large collection of variables, even with a brain as large as ours, it would take a very long time to decide on the simplest of tasks. So we need a shortcut; emotions are there to prevent us from temporizing...Joseph LeDoux's theory about the role of emotions in behavior is even more potent: Emotions affect one's thinking. He figured out that much of the connections from the emotional systems to the cognitive systems are stronger than connections from the cognitive systems to the emotional systems. The implication is that we feel emotions (limbic brain) then find an explanation (neocortex). As we saw in Claparede's discovery, much of the opinions and assessments that we have concerning risks may be the simple result of emotions.
On journalists and minute-by-minute reporting:
A move of 1.03 with the Dow at 11,000 constitutes less than a 0.01% move. Such a move does not warrant an explanation. There is nothing there that an honest person can try to explain; there are no reasons to adduce. But like apprentice professors of comparative literature, journalists being paid to provide explanations will gladly and readily provide them...Significance: How did I decide that it was perfect noise? Take a simple analogy. If you engage in a mountain bicycle race with a friend across Siberia and, a month later, beat him by one single second, you clearly cannot quite boast that you are faster than him. You might have been helped by something, or it can be just plain randomness, nothing else. That second is not in itself significant enough for someone to draw conclusions...
Causality: There is another problem; even assuming statistical significance, one has to accept a cause and effect, meaning that the event in the market can be linked to the cause proffered. Post hoc ergo propter hoc (it is the consequence because it came after). Say hospital A delivered 52% boys and hospital B delivered the same year only 48%; would you try to give the explanation that you had a boy because it was delivered in hospital A?
On behaviour:
[B. F. Skinner] designed the [Skinner] box in order to study more general properties of the behavior of a collection of nonhumans, but it was in 1948 that he had the brilliant idea of ignoring the lever and focusing on the food delivery. He programmed it to deliver food at random to the famished birds.He saw quite astonishing behavior on the part of the birds; they developed an extremely sophisticated rain-dance type of behavior in response to their ingrained statistical machinery. One bird swung its head rhythmically against a specific corner of the box, others spun their heads counterclockwise; literally all of the birds developed a specific ritual that progressively became hardwired into their mind as linked to their feeding.
(I believe this last observation is disputed in scientific circles, but it is thought-provoking when considered in the context of human behavior)
Update: There is some discussion of stoic philosophy in the last few pages (everyone should know by now that I love Marcus Aurelius). Nothing quotable, but I do like the notion of dignity in the face of randomness.
Posted by eerie at July 3, 2006 12:02 AM
Filed Under:
Reviews
Trackback Pings
TrackBack URL for this entry:
http://www.aqoul.com/movabletype/mt-tb.cgi/2769
Comments
Terry Pratchett has a word: "substitious", the opposite of superstitious, refering to someone who believes in things that no one else believes in, even though they're true, like "if you don't pick at it, it'll heal faster", or "some things just happen for no good reason".
Posted by: Tom Scudder at July 3, 2006 04:11 AM
> Let's watch: Damasio reported that the purely unemotional man was incapable of making the simplest decision. He could not get out of bed in the morning, and frittered away his day fruitlessly weighing decisions. Shock! This flies in the face of everything one would have expected: One cannot make a decision without emotion.
*snort*
So we conclude from one brain-damaged individual that no entity anywhere can make a decision "without emotion". How rich. It's a good thing my computer is "happy" or else it might never boot up in the morning.
And yes, obsessive nitpickers, I assume he was referring to "one" as human, but that's really the point--logical decision-making is always hinged on emotions in *some* way in that we make value judgments a priori in respect to the process. Even a computer program is affected by the emotionally-based judgments and values of its programmer--maybe the program is a malicious virus or a useful application--but we wouldn't characterize the computer itself as making "emotional decisions".
Emotions are certainly elemental in most human decisions, one way or the other, but to suggest that "one cannot make a decision without emotion" is a gross oversimplification--particularly in the context of the example, which suggests that one needs to have some sort of emotion to do anything at all. Those who have experienced a phase of life they would describe as "going through the motions" could probably provide a sufficient counter-example.
Posted by: blue92 at July 3, 2006 09:51 AM
I don't think he means all decisions are automatically skewed by emotion, but that our decisions to do things (e.g. comment on blogs) indicate some underlying "investment". A fair chunk of the book centers on traders and the inability to make rational decisions (in spite of familiarity with probability/randomness) because emotional risk/reward behaviours get in the way.
Generally though, the book describes errors in judgement caused by emotion (not quite happy/sad, more subtle) and common problems re accurately assessing probabilities/risks in an information-rich environment.
Posted by: eerie
at July 3, 2006 11:00 AM
Just slightly annoyed at the blatant over-kill is all.
> ...our decisions to do things (e.g. comment on blogs) indicate some underlying "investment"...
Heh. Like with good semantics, no doubt.
Along more general lines, this is a rather fun list to skim through when reviewing one's own prejudices.
Posted by: blue92 at July 3, 2006 11:45 AM
Ah but the concept of action-at-a-distance shoots this all to hell, and makes our dancing birds into shaman-prophets of the transcendent.
Or something.
More seriously, randomness = transcendent free will.
Or something.
Posted by: matthew hogan at July 3, 2006 12:12 PM
Free will equals dancing spooky chickens?
The blue parrot is in the banana tree. Repeat, the blue parrot is IN the banana tree. Over.
Posted by: blue92 at July 3, 2006 01:08 PM
I would say a computer doesn't make decisions. It's just a machine, and doesn't make decisions any more than an electric drill or a toothbrush.
I guess a person without emotion would be without desire. Without desire, there is nothing to want. So it just sits around, doing nothing. Does pain count?
Posted by: Klaus
at July 3, 2006 02:44 PM
Logic is a wreath of pretty flowers . . . which smell bad.
Posted by: matthew hogan at July 3, 2006 09:48 PM
Free will equals dancing spooky chickens?
Colorless green ideas sleep furiously!
Posted by: Tom Scudder at July 4, 2006 08:43 AM
Also, I'm amused at how the title of this post has been truncated in the url: "on_precious_delusions_and_rand"
So true.
Posted by: Tom Scudder at July 4, 2006 08:44 AM
...
It's like everyone in this thread suddenly started eating shrooms.
Posted by: eerie
at July 4, 2006 11:52 AM
Fairly good choices, an excellent book. But of course.
Posted by: The Lounsbury at July 4, 2006 06:47 PM

RSS



