Wednesday, July 01, 2026

Risk and AI: It's Tricky

The possibility that AI will end up unleashing waves of 'Anti-Progress'--malicious uses, untrustworthy output and uncontrollable floods of slop--also doesn't occur to those confined in the current belief construct.

A funny thing happens on the way to understanding risk: we discover it's tricky. We think we see all the risks, and think we can mitigate or hedge those risks, but by its very nature, risk evades such simplistic filters and metrics. Risk remains hidden, offscreen, invisible, building up out of sight, awaiting a catalyst that's equally undetectable until it manifests, and after the fact, we look back and ask, why didn't we see that coming?

Risk is tricky like that. It can lay dormant for decades and then erupt with little warning.

Risk is tricky in other ways. In our hubris, we see the power and might of our technologies, systems and foresight, and reckon these are so robust they will easily survive any tectonic shift, as we've planned for emergencies.

But our faith in the might of our civilization is itself a source of risk because the risk of Model Collapse--the breakdown not of a supply chain or technology but of our entire conceptual construct of how the world works--goes unrecognized because our confidence that our model maps the real world is so high that we are incapable of recognizing its drift into hallucination and civilizational psychosis.

In other words, our confidence that our conceptual mythologies are accurately mapping the real world is itself a source of civilizational risk because this confidence makes it inevitable that we do more of what's failing, as the alternative--recognizing our conceptual models and mythologies are self-serving rationalizations that substitute artifice for realistic appraisals--is conceptually and emotionally impossible.

Put another way: Emperor Norton's delusions of power and grandeur were harmless as long as he was recognized as delusional. But should Emperor Norton actually be given the power he believed was his to wield, then risk rises accordingly.

Consider the bet being made globally that the current iteration of AI will be 1) immensely profitable (the most important thing in the Universe) and 2) immensely productive (secondary to immensely profitable but necessary as a motivation for everyone to throw trillions of dollars at purveyors of AI). The risk that this bet--and the assumptions that make it not only rational but pressing--is the equivalent of handing Emperor Norton the keys to the kingdom with little evidence he will be a wise leader, is unimaginable in the current model / mythology, and so therefore it doesn't exist.

The worst that could possibly happen in the current model / mythology is a brief spot of bother in the stock market as euphoric overvaluations come down to Earth, and then the immense profits start flowing and markets rocket higher in a multi-decade Bull Market of AI Productivity.

The possibility that the current iteration of AI is innately incapable of metaphorically boiling away the seas is not on the screen, any more than a stock market crash or social upheaval is on the screen. Yet if the fantasy of vast, unstoppable floods of profits driven by vast increases in productivity fail to materialize on a very short timeline, then both a stock market crash and social upheaval move from "impossible" straight through "unlikely" to "happening now," leaving everyone who thought they understood risk and were properly hedged against unwelcome change in a state of disbelief and wonderment.



Risk is tricky that way. What's "impossible" in our current belief construct--a construct we mistakenly believe maps the real world perfectly--is a source of system-breaking risk that is invisible within the confines of this self-congratulatory belief construct.



The possibility that AI will end up unleashing waves of Anti-Progress--malicious uses, untrustworthy output and uncontrollable floods of slop--also doesn't occur to those confined in the current belief construct. The risk may be of a magnitude and scale that switching AI vendors or platforms and approving policy tweaks won't fix the problem.




My book Investing In Revolution is available at a 10% discount ($18 for the paperback, $24 for the hardcover and $8.95 for the ebook edition). Introduction (free)


Become a $3/month patron of my work via patreon.com

Subscribe to my Substack for free





NOTE: Contributions/subscriptions are acknowledged in the order received. Your name and email remain confidential and will not be given to any other individual, company or agency.

Thank you, Peter ($70), for your superb generous subscription to this site -- I am greatly honored by your support and readership.

 

Thank you, Mark ($7/month), for your marvelously generous subscription to this site -- I am greatly honored by your support and readership.


Thank you, Douglas H. ($70), for your massively generous subscription to this site -- I am greatly honored by your support and readership.

 

Thank you, Vermont R.P. ($70), for your splendidly generous subscription to this site -- I am greatly honored by your support and readership.

Read more...

Terms of Service

All content on this blog is provided by Trewe LLC for informational purposes only. The owner of this blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site. The owner will not be liable for any errors or omissions in this information nor for the availability of this information. The owner will not be liable for any losses, injuries, or damages from the display or use of this information. These terms and conditions of use are subject to change at anytime and without notice.


Our Privacy Policy:


Correspondents' email is strictly confidential. This site does not collect digital data from visitors or distribute cookies. Advertisements served by a third-party advertising network (Investing Channel) may use cookies or collect information from visitors for the purpose of Interest-Based Advertising; if you wish to opt out of Interest-Based Advertising, please go to Opt out of interest-based advertising (The Network Advertising Initiative). If you have other privacy concerns relating to advertisements, please contact advertisers directly. Websites and blog links on the site's blog roll are posted at my discretion.


PRIVACY NOTICE FOR EEA INDIVIDUALS


This section covers disclosures on the General Data Protection Regulation (GDPR) for users residing within EEA only. GDPR replaces the existing Directive 95/46/ec, and aims at harmonizing data protection laws in the EU that are fit for purpose in the digital age. The primary objective of the GDPR is to give citizens back control of their personal data. Please follow the link below to access InvestingChannel’s General Data Protection Notice. https://stg.media.investingchannel.com/gdpr-notice/


Notice of Compliance with The California Consumer Protection Act
This site does not collect digital data from visitors or distribute cookies. Advertisements served by a third-party advertising network (Investing Channel) may use cookies or collect information from visitors for the purpose of Interest-Based Advertising. If you do not want any personal information that may be collected by third-party advertising to be sold, please follow the instructions on this page: Limit the Use of My Sensitive Personal Information.


Regarding Cookies:


This site does not collect digital data from visitors or distribute cookies. Advertisements served by third-party advertising networks such as Investing Channel may use cookies or collect information from visitors for the purpose of Interest-Based Advertising; if you wish to opt out of Interest-Based Advertising, please go to Opt out of interest-based advertising (The Network Advertising Initiative) If you have other privacy concerns relating to advertisements, please contact advertisers directly.


Our Commission Policy:

As an Amazon Associate I earn from qualifying purchases. I also earn a commission on purchases of precious metals via BullionVault. I receive no fees or compensation for any other non-advertising links or content posted on my site.

  © Blogger templates Newspaper III by Ourblogtemplates.com 2008

Back to TOP