Copilot will soon see what you see

Read time: under 4 minutes

Welcome back, Superhuman

Imagine a web without browsers or a smartphone without apps. Microsoft’s Mustafa Suleyman thinks we’ll soon come to rely on AI in much the same way. And: OpenAI unveils new developer tools, including a way to fine-tune its powerful voice-to-voice features.

🎧️ New podcast: Is AI a Threat to Humanity? AI Safety Researcher Judd Rosenblatt Weighs In. Listen now on Apple, Spotify, and YouTube.

Today’s Insights

• Copilot’s AI-first revamp

• Frontier: OpenAI unlocks voice-to-voice API for devs

• Tutorial: How to add subtitles to any video

• Everything else you should know today

• 5 new AI tools to boost your productivity

• AI-Generated Images: Dark Fantasy

NEXT IN AI

Copilot’s AI revamp could change the way we interact with computers

Interacting with a computer is usually a one-way street. But at a preview event Tuesday, Microsoft’s Mustafa Suleyman said he thinks AI will make our devices more malleable, like clay that can be shaped and molded. With that in mind, Microsoft just unveiled a set of brand-new Copilot features. Here’s everything we saw at Tuesday’s sneak peek.

Copilot Voice: An answer to OpenAI’s Advanced Voice mode with a special focus on emotional intelligence. Its four voices can match your mood, make self-deprecating jokes, and reassure you if you’re having a rough day.

Copilot Vision: This feature can see everything on your screen and react accordingly. In one demo, a user asked about movies on Rotten Tomatoes. Copilot told him which ones were available to stream, offered review summaries, and gave custom recommendations.

Recall: A super-powered browsing history that can help you find long-lost webpages and documents (i.e. “Find the chart with the purple arrow from last week”). It now includes biometric safety features and encryption.

What else?

• Think Deeper, powered by a fine-tuned version of o1, will help with complex decisions, like planning a family vacation

• Copilot Daily is an AI-generated daily podcast with news stories tailored to you

• Paint will automatically turn your scribbles into detailed works of art

• AI Search helps you intuitively find settings, files, images, and more

Next up, Suleyman wants to give Copilot a higher “action quotient” — or the ability to proactively reach out to you and make calls or purchases on your behalf.

PRESENTED BY AE STUDIO

From idea to million-user experience

Millions of users, one live event, and an app that just... works.

That's what AE Studio pulled off for Eurovision Latinoamérica. They said, "Build us an app for millions of live users." We said, "Hold our coffee." ☕

Here's the thing: Killer apps aren't just about code. They're about getting inside users' heads and designing experiences that delight.

That's where we shine. 👋 We turn "Wouldn't it be cool if..." into "Oh, it actually exists!"

Got a wild idea? Need a wild idea? Either way, we're your people. Let's chat and cook up some digital magic.

THE AI ACADEMY

How to add subtitles to any video using RunwayML

• Go to runwayML's website and log in to get credits.

• Now click on Subtitles from the list of tools.

• Upload your video, choose your preferred language, and click the Generate button.

• Wait for a few seconds and it will take you to the editor where you can edit AI-generated subtitles if needed.

• Once everything is done, click on the Export button to download your video with subtitles.

🎧️ DECODING THE FUTURE

Is AI a Threat to Humanity? AI Safety Researcher Judd Rosenblatt Weighs In

Judd Rosenblatt is an AI researcher known for his work on AI safety and alignment. We talked with Judd to understand which types of risks AI poses, and how we can deal with them. In our conversation, we discuss:

• The potential risks AI poses to humanity and why top AI experts are concerned

• Different approaches to solving AI alignment issues

• The role of major AI companies in addressing AI safety

• China's stance on AI development and regulation

• Exciting developments in AI over the next 12 months

Listen now on Apple, Spotify, and YouTube.

FROM THE FRONTIER

OpenAI shows off new developer tools, including custom voice bots

A developer just used a modified version of OpenAI’s Advanced Voice mode to order food for an event. He gave it a budget and an address, and off it went to place the order on his behalf. 

That’s just the first glimpse at what’s possible with OpenAI’s expanded API access, which will let 3 million developers build custom, third-party apps with the startup’s industry-leading voice-to-voice technology.

Here’s everything else announced at OpenAI’s DevDay:

• With prompt caching, engineers who reuse the same assets again and again can cut their costs in half

• Developers can now adapt GPT-4o’s vision capabilities for use in everything from autonomous vehicles to medical imaging

• Coders will be able to use OpenAI’s larger models to fine-tune smaller ones — a process known as model distillation

PRESENTED BY SANA AI

Here are tasks you can delegate to an AI Assistant

Sana AI is the most powerful AI assistant on the market. It integrates with your entire stack and saves you hours on tasks like…

• Writing client emails

• Drafting reports

• Comparing invoices

• Analyzing data sets

• Summarizing meetings

Try it for no cost and let us know what you think.

AI & TECH NEWS

Everything else you need to know today

• Scene Stealer: Text-to-video platform Pika launched Pika 1.5, with more realistic movement, cinematic shots, lip-syncing, and custom special effects.

• Game-Changer: Series Entertainment, which is building an AI-powered video game engine, raised $28M in a Series A funding round, with backing from Netflix, Dell, and Andreessen Horowitz.

• New Beginnings: Durk Kingma, one of OpenAI’s co-founders, announced he is joining Anthropic AI and hopes to contribute to “Anthropic’s mission of developing powerful AI systems responsibly.”

• Ctl+Alt+AI: Alphabet announced that Samsung and Lenovo’s new Chromebooks will feature a new button that can be used to quickly access Gemini and other AI tools.

🚀 Out of this World: University of Texas researchers are using AI to peer into the distant past. With $20M in funding, the new CosmicAI Institute will analyze vast amounts of astronomical data to learn more about dark matter, ancient molecules, and even the origins of the universe.

🩺 Health Upgrade: A medtech startup called Lapsi Health has secured FDA approval for a new digital stethoscope that uses AI to detect chronic heart and lung conditions. Next up: A wearable device for pregnant mothers that can be used to track their baby’s movements and alert them to emergencies in advance.

PRODUCTIVITY

5 AI Tools to Supercharge Your Productivity

✅ Uizard: Turn product ideas into concepts, visualize, communicate, and iterate on wireframes and prototypes in minutes.

✅ Slite: Craft any document into the most reader-friendly text using AI.

✅ PitchPower: A simple workflow tool for freelancers, agencies, and service firms who prospect, pitch, or propose.

✅ Flipner: Pocket-sized writing assistant that captures your ideas and craft texts with AI's touch.

✅ Playform: Generate creative AI art without learning new technical terminology or coding.

^{* indicates a promoted tool, if any}

PROMPT OF THE DAY

Affiliate Marketing

Prompt: Design a landing page optimized for our affiliate traffic. The main goal is to convert visitors coming from [specific affiliate partner or platform] for our [specific product or service]. Include suggestions for the headline, call-to-action, and visual elements.

_{Source: Weam}

AI-GENERATED IMAGES

Dark Fantasy

Midjourney Prompt: 1970s dark fantasy book illustration art Frazetta- style drawing of subject

Acquire new customers and drive revenue by partnering with us

Superhuman is the world’s biggest AI newsletter for businesses and professionals with 600,000+ readers and 1.5 Million followers on socials working at the world’s leading startups and enterprises. Companies like Amazon, Hubspot, and Salesforce feature their products in Superhuman. You can learn more about partnering with us here.

🧞Your wish is my command

Got more feedback or just want to get in touch? Reply to this email and we’ll get back to you.

Thanks for reading.

Until next time!

Zain & the Superhuman AI team