Recently, there’s been no small amount of discussion about how the government can help defend cyber-space from catastrophic cyber-risks. Many folks are saying that we (infosec) could have our own “Black Swan” moment and a sortof “kill switch” might provide a defense against attack.
The problem is this: If you’re reading Nassim Taleb, and coming away with the idea that a Black Swan is a low-likelihood/high-impact event, you’re
mistaken. This is a false characterization. I will red-card the next person who suggests such.
Rather, Black Swans are better characterized as events for which your prior distributions are COMPLETELY uninformative. BIG difference. Oil spills, EMP disruptions, Hurricane Strength and Levy Failure, even Economic Bubbles, these all have prior distributions that, in terms of either likelihood or impact (or both) I would characterize as relatively informative at some level of abstraction. To further press the point, regarding real “Black Swans”, the impact of a Rumsfieldian Unknown/Unknown may or may not be “high” (we just tend to worry about high-impact stuff).
Look, if you’re using past frequencies as direct evidence for pattern establishment in modeling complex systems then, yes, all these imagined
things for which we have no “actuarial quality data” become “low probability” events and we can seriously get burned. Duh. Bad models with
bad data create bad results. No magic there.
But if, on the other hand, you treat probabilities not as a nature-state count but as a statement of belief & hypothesis to be tested, then you can
develop models that better address expected changes to the threat landscape and relate them to the impact (impact being not as important because really,
you’re already assuming high impact in your hypothesis prior to testing, and done right, that’s OK).
But I would argue that in infosec, and with regards to “cyberwar” we have plenty of knowledge about attacks and ability to fail spectacularly. We
have past experience that shows that attackers dream up new threat actions, circumvent existing controls in clever ways, and when economically driven
(including behavioral aspects of being economically driven) will seek to cause impact by almost any means necessary. The specific vulnerability or
exploit (or pairing thereof) might be a complete unknown/unknown, possibly characterized as a real Black Swan, but we’ve never been able to prevent
them anyhow and the knowledge that these unknown/unknowns can and do exist, along with the foreknowledge and assumption of high impact, prevent all the
craziness we suppose these economic demagogues have to teach us. That is, the prior experience we have with 0days means that we can derive some state
of knowledge with acceptable amounts of uncertainty in many cases.
Finally, speaking of informative prior distributions – I’m not advocating a political stance on the issue, but it’s really, really odd to me that we’re
ready to discuss how (un)informative prior distributions are or aren’t in terms of Black Swans and cyber-kill switches, while ignoring the fact that we do
have very informative past examples of leadership – regardless of political ideology at this point – being incapable of reacting quickly to catastrophic
events. Events that unfolded much slower ( presumably) than a “cybercrisis” that results in “cybergeddon” (readers can blame @shrdlu for my “cyberness”
this morning, she’s a bad influence).
Recently, there’s been no small amount of discussion about how the government can help defend cyber-space from catastrophic cyber-risks. Many folks are saying that we (infosec) could have our own “Black Swan” moment and a sortof “kill switch” might provide a defense against attack.
The problem is this: If you’re reading Nassim Taleb, and coming away with the idea that a Black Swan is a low-likelihood/high-impact event, you’re mistaken. This is a false characterization. I will red-card the next person who suggests such.
Rather, Black Swans are better characterized as events for which your prior distributions are COMPLETELY uninformative. BIG difference. Oil spills, EMP disruptions, Hurricane Strength and Levy Failure, even Economic Bubbles, these all have prior distributions that, in terms of either likelihood or impact (or both) I would characterize as relatively informative at some level of abstraction. To further press the point, regarding real “Black Swans”, the impact of a Rumsfieldian Unknown/Unknown may or may not be “high” (we just tend to worry about high-impact stuff).
(more…)