The people warning us about AI are also building it

5 hours ago 8

Anthropic's Dario Amodei

Anthropic's Dario Amodei Bloomberg/Getty Images

Anthropic has pushed for better safety protocols on AI. Now it's getting a firsthand view of the impact that can have on a business.

The AI giant's new models were sidelined by the White House over potential security risks. BI's Natalie Musumeci has a cheat sheet on the saga, which kicked off on Friday.

My colleagues at Politico also have a breakdown on the whirlwind 24 hours leading up to the White House's clampdown on Anthropic.

For Anthropic, it's been a hectic year balancing concerns over AI safety with its desire to compete in the AI race.

Just look at the back-and-forth over the past six months:

Jan. 27: Anthropic CEO Dario Amodei drops a 19,000-word message on the future of AI and the "serious civilizational challenge" it poses.

Feb. 24: Anthropic weakens its foundational safety commitment amid heightened competition and a lack of government regulation.

Feb. 27: A dispute between Anthropic and the Department of Defense over how its AI models are used leads the DoD to label Anthropic a supply chain risk.

April 7: Anthropic said its Mythos model is too powerful for the public, citing its knack for finding "high-severity vulnerabilities."

June 1: Anthropic files a confidential S-1 for its IPO.

June 5: Anthropic calls for a coordinated slowdown among frontier AI labs "to enable societal structures and alignment research to keep up with the advance of the technology."

June 9: Anthropic releases Fable 5, which it built by putting safeguards on the aforementioned Mythos model.

June 10: Amodei publishes a blog saying AI is moving at a "lightning pace" while policy is "moving very slowly."

June 12: A US order barring foreign entities or individuals from using Anthropic's Fable 5 and Mythos leads it to disable the models for everyone.

June 15: Trump officials reportedly met with Anthropic to resolve the export ban on Fable.

The Mythos drama is the clearest example yet of the difficult position the AI industry finds itself in.

The people most qualified to warn about the dangers of advanced AI are also the ones who stand to make trillions creating it.

Governments, meanwhile, are left trying to regulate technology that the people building it don't fully understand. And just like tech executives, they're worried about competition. Slowing innovation means risking your entire country falling behind.

That's the tricky part. You all might agree that something needs to be done, but no one wants to be the first to actually do something about it.

The real challenge isn't building safer AI. It's figuring out who gets to decide what "safe enough" means.

Many experts agree on the best way to maintain oversight of increasingly complex AI, but you probably won't like it.

It's more AI.

Dan is the lead writer for BI Today, Business Insider's flagship daily newsletter. Dan often interviews executives about everything from AI's impact on capitalism to robotics to the potential SaaSpocalypse as part of his work on the newsletter.Dan was an editor and reporter at BI, covering financial technology and market structure.His previous work includes everything from inside Robinhood's failed "Checking and Savings" product that eventually led to Congress getting involved to the internal arguments over JPMorgan's failed attempt to launch a finance app for millennials.Before joining Business Insider, Dan wrote about risk management in derivatives markets for Risk.net and fintech for WatersTechnology. He initially covered local sports for The Journal News, a daily newspaper serving the lower Hudson Valley. Got a tip? Contact this editor via email at [email protected].

Read Entire Article
| Opini Rakyat Politico | | |