How OpenAI's Codex figured out how to use Adobe software

5 hours ago 8

Alistair Barr, global tech editor of Business Insider, smiles at the camera while wearing a blue and white striped shirt.

By Alistair Barr

Alistair Barr, global tech editor of Business Insider, smiles at the camera while wearing a blue and white striped shirt.

Follow Alistair Barr

Every time Alistair publishes a story, you’ll get an alert straight to your inbox!

By clicking “Sign up”, you agree to receive emails from Business Insider. In addition, you accept Insider’s Terms of Service and Privacy Policy.

Author of the Tech Memo newsletter

Peter Gostev, AI capability lead at Arena.ai

Peter Gostev, AI capability lead at Arena.ai Peter Gostev

I interviewed Peter Gostev, AI capability lead at Arena.ai, recently. He created what I call the defecation test, officially known as BullshitBench. Something else he mentioned caught my attention, though.

It's a striking example of AI agents in the wild. While editing photos in Adobe Lightroom, he had 50 images that needed denoising, a tedious task typically done one-by-one. Instead of doing it manually, or even knowing how to batch it, Gostev let OpenAI's Codex AI coding service figure it out.

"You have to go and click into each one to denoise 50 photos. That sounds like hard work, so I just got Codex to go and work out how to do that," Gostev told me. "It just worked."

What's notable is how Codex pulled this off: not through an official API, plugin, or browser workaround, but by somehow interfacing directly with the desktop app, despite no clear support for this.

Gostev is technically advanced and what he did here is something I probably couldn't do. Still, it's a glimpse of where AI agents are heading: not just assisting, but autonomously navigating and operating software like a human would (or in this case doing it faster and better than a smart human).

Sign up for BI's Tech Memo newsletter here. Reach out to me via email at [email protected].

Read next

Read Entire Article
| Opini Rakyat Politico | | |