✋ Slowing it down
1. Key Themes
Washington is politically paralyzed on AI regulation, likely for years
The gap between Trump's accelerationism and Democrats' fractured response makes federal action nearly impossible in the near term.
"This staggering divide makes consensus on federal AI regulation almost unimaginable this year — and probably through early 2029, regardless of who wins control of Congress."
Trump has explicitly dismissed safety concerns as politically motivated noise:
"he dismissed new safety warnings as the work of 'a lot of negative forces ... bringing up things that won't happen' — and reduced the stakes to one line: 'Whoever wins AI wins.'"
Even the accelerationist camp's rebuttal to lab safety calls is telling — it reframes "pacing" as a competitive ploy rather than a genuine concern:
"If OpenAI and Anthropic truly think the frontier is moving too fast, Sacks argues, they can decelerate on their own without using Washington to force competitors to do the same."
AI politics is scrambling traditional left-right alliances
Unlikely coalitions are forming around human-control-of-AI concerns, cutting across party lines.
"An industry insider, the face of the progressive movement and a leading MAGA voice make for unlikely allies, in a sign of how AI is upending political norms."
Steve Bannon's rhetoric border on populist anti-oligarch framing rather than typical MAGA tech boosterism:
"'The Oligarchs are finally being forced to admit they've lied from the beginning about the dangers of acceleration with zero guardrails — they've put the nation and mankind in jeopardy,' Bannon told Axios in a statement."
Industry is quietly building safety infrastructure even as the political fight rages
Labs and enterprise vendors are shipping real technical guardrails — monitoring systems, kill switches — independent of any regulatory mandate.
"AI companies are already building emergency brakes to stop nefarious AI systems before they cause serious damage and kill us all."
OpenAI's post-incident overhaul shows a real operational response process, not just PR:
"an AI security guard monitoring AI chain-of-thought will alert staffers when an agent appears to be doing something dangerous... Responders are then charged with pausing activity unless they identify it as a false alarm within 30 minutes."
Anthropic's automated detection is imperfect but real:
"The monitoring caught 50% of malicious behavior, the company says."
Salesforce built a literal commercial product for this need:
"MuleSoft developed an actual product called 'Agent Kill Switch,' which targets the resources AI agents need to live... An operator can halt a single request, session, agent, or — in an emergency — an entire company account."
The AI capex boom is being financed by debt, and credit risk is quietly rising
The scale of AI infrastructure spending is starting to strain even the strongest balance sheets in tech.
"The trillions these companies are spending — much of it borrowed — to fund data centers and other AI-related infrastructure are fueling U.S. economic growth overall." "'The credit quality of hyperscalers is gradually weakening,' the S&P analysts wrote." "the top six hyperscalers — Amazon, Microsoft, Alphabet, Oracle, SpaceX and Meta — will spend more than $7 trillion on data centers and AI capex through 2030."
The real risk is contagion from unproven players riding on Big Tech's credit halo:
"these established players are lending their reputations and credit ratings to smaller and untested companies — neoclouds, data center operators and unproven yet giant startups like Anthropic and OpenAI." "'When we get together and talk about where the risks are from AI, it's these smaller companies,' said Naveen Sarma, an analyst at S&P."
2. Contrarian Perspectives
Microsoft is deliberately choosing to be less capable than competitors
While most labs race toward maximal capability, Microsoft's AI chief is explicitly rejecting the pursuit of superintelligence as a strategic and ethical stance — a notable departure from industry consensus that more capability is always better.
"Microsoft says it is willing to compromise on 'ultimate generality, autonomy, or capability' to preserve safety and control, and models should never resist human input, nor should they set their own goals." "'I think some people think that it's inevitable that superintelligence is going to exceed human control,' Suleyman told Axios. 'But I don't agree with that... it means that we're going to have to make decisions about what we're not going to do.'"
Safety warnings from top labs may be self-serving regulatory capture, not genuine concern
David Sacks and House Speaker Johnson argue that lab leaders calling for a slowdown are cynically trying to use government to hobble competitors rather than acting on real safety fears — a direct challenge to the sincerity of the "pacing" discourse.
"Trump's accelerationist allies, including venture capitalists in Silicon Valley, see the safety alarms as a cynical ploy by the field's dominant players to lock in favorable regulations." "David Sacks... has a simple answer: Slow yourselves down."
Money incentives make honest AI risk discourse nearly impossible
Dan Primack's point suggests that the entire public debate over AI safety is distorted by the scale of capital at stake, implying that neither doomers nor accelerationists are arguing in good faith.
"It's very difficult to have a sober conversation about AI risk when there's so much money at stake, Dan Primack writes."
3. Companies Identified
-
Microsoft — Big Tech/AI hyperscaler. Mentioned for publishing a "Humanist AI" code of conduct rejecting the race to superintelligence. "Microsoft AI models should remain subordinate to humans and rejects 'the race to produce an all-purpose superintelligence.'"
-
OpenAI — Leading AI lab. Mentioned for overhauling its incident-response system after a security breach and for facing political pressure over model risk disclosures. "OpenAI overhauled its response system following the Hugging Face incident."
-
Anthropic — Leading AI lab. Cited for its automated sabotage-monitoring approach and its "pacing" safety stance that sparked political backlash. "The monitoring caught 50% of malicious behavior, the company says."
-
Salesforce (MuleSoft) — Enterprise software company. Mentioned as building a literal commercial "kill switch" product for AI agents. "MuleSoft developed an actual product called 'Agent Kill Switch,' which targets the resources AI agents need to live."
-
Positron AI — Inference chip startup. Notable for extremely rapid valuation growth, signaling continued investor frenzy in AI infrastructure despite risk warnings. "Inference chip startup Positron AI raised $500 million at a $5 billion valuation just one month after closing $375 million at a $3.9 billion valuation."
-
Tomorrow.io — Climate tech company. Mentioned as building AI-powered weather satellites for disaster early-warning. "building a new generation of weather satellites that could give billions of people earlier warnings about dangerous storms."
-
Amazon, Alphabet, Oracle, SpaceX, Meta — Hyperscalers. Cited collectively as the center of AI capex/debt risk. "will spend more than $7 trillion on data centers and AI capex through 2030."
4. People Identified
-
Sam Altman — CEO, OpenAI. Mentioned for clarifying that "pacing" AI development doesn't mean stopping it. "development should follow a 'narrow middle path.'"
-
David Sacks — Trump's former AI czar, accelerationist voice. Mentioned for challenging labs to self-regulate rather than seek government intervention. "Slow yourselves down."
-
Mike Johnson — House Speaker (R-La.). Mentioned for rejecting an AI moratorium and proposing a lab/government safety summit instead. "he wants Trump, congressional leaders and the heads of the major AI labs in a room as soon as possible to hammer out a common approach to safety."
-
Hakeem Jeffries — House Minority Leader. Mentioned for organizing Democratic caucus debate on AI action. "his caucus will meet tomorrow to debate what action to take."
-
Barack Obama — Former President. Mentioned for privately pushing Democrats to prioritize AI policy. "is privately urging the party to make AI a top priority."
-
Bernie Sanders — Senator (I-Vt.). Mentioned for the most aggressive regulatory stance, including criminal penalties. "want to ban superintelligence outright, pause advanced AI development and threaten violators with up to 20 years in prison."
-
Ruben Gallego — Senator (D-Ariz.). Mentioned for proposing a bipartisan AI oversight committee. "wants a bipartisan AI select committee with subpoena power."
-
Chris Van Hollen — Senator (D-Md.). Mentioned for demanding OpenAI submit to federal safety review. "demanding that OpenAI open its models to federal safety reviews."
-
Jacob Coxon — Ex-OpenAI/Anthropic researcher. Mentioned as a whistleblower-type figure organizing cross-partisan safety advocacy. "who worked for OpenAI and then Anthropic and quit the latter over safety fears, will give in-person remarks."
-
Steve Bannon — Former Trump adviser. Mentioned for aligning with progressives on AI safety, framing it as an anti-oligarch fight. "The Oligarchs are finally being forced to admit they've lied from the beginning about the dangers of acceleration with zero guardrails."
-
Mustafa Suleyman — Microsoft AI chief. Mentioned for publicly drawing a hard "human control" red line for AI development. "I think that would be very, very dangerous... we're going to have to make decisions about what we're not going to do."
-
Naveen Sarma — S&P analyst. Mentioned for identifying credit risk concentration in smaller AI infrastructure players. "When we get together and talk about where the risks are from AI, it's these smaller companies."
-
Xi Jinping — Chinese President. Mentioned for positioning China as an AI leader for developing nations. "China will lead the way on AI cooperation and development among developing countries."
5. Operating Insights
-
Build incident response infrastructure before you need it, not after. OpenAI's overhaul came reactively, post-incident — labs and enterprises deploying autonomous agents should have monitoring and pause protocols (e.g., a 30-minute window to override false alarms) built into deployment from day one, not bolted on after a breach.
-
Kill switches are becoming table-stakes enterprise AI infrastructure, not a fringe feature. Salesforce's MuleSoft "Agent Kill Switch" (with granular control from single request to full account shutdown) suggests enterprise buyers are demanding — and vendors are productizing — explicit human-override mechanisms for agentic AI. Founders building agent infrastructure should treat controllability as a core product requirement, not an afterthought.
-
Positioning around "safety" or "human control" can be a market differentiator, not just a cost center. Microsoft's decision to explicitly trade off capability for control ("People matter more than AI") is a bet that trust and safety become a competitive advantage as concern about AI risk grows — a potential playbook for startups trying to differentiate against maximalist-capability competitors.
6. Overlooked Insights
-
Investors are still pricing in extreme AI infrastructure optimism despite mounting credit warnings. Positron AI's valuation jump from $3.9B to $5B in a single month — even as S&P flags weakening hyperscaler credit quality tied to exactly this kind of infrastructure spending — suggests a disconnect between private market enthusiasm and macro credit risk signals that investors should watch closely.
-
Anthropic's self-reported detection rate is a meaningful admission of limitation. The fact that automated monitoring "caught 50% of malicious behavior" — essentially a coin flip — is a quietly significant data point on the current ceiling of AI safety tooling, understated amid the broader "kill switch" narrative.