Google’s Gemini Pro 1.5 shows impressive recall in early tests

Read time: under 4 minutes

Welcome back, Superhuman

Chatbots are great at saying things that sound about right, but they’re not very good at finding or remembering information — even when the text is right in front of them. But exciting early tests show Google’s new Gemini Pro 1.5 finding needles in haystacks of text with perfect accuracy.

_{First time reading? Sign up to get this newsletter here}

TODAY’S MENU

• Google’s Gemini Pro 1.5 shows impressive recall in early tests

• How to convert text into speech with ChatGPT

• Chart: AI productivity tools market map

• AI is already having a significant impact on freelance jobs

• 5 new AI tools to boost your productivity

• AI Generated Images: The Simpsons as K-Drama

NEWS

Today in AI & Tech

ChatPDF: Adobe releases AI Assistant for Acrobat, which lets users do things like summarize PDFs or ask questions about it.

Rising Dragon: Chinese startup Moonshot AI raises US$1 billion in funding from tech giant Alibaba and others.

Grokking Along: Elon Musk says his ChatGPT rival Grok is getting upgraded to Grok 1.5 soon, and a potential partnership with image generator Midjourney is also in the works.

Fan Favorite: AI chip manufacturer Nvidia dethrones Tesla to become the most traded stock on Wall Street.

Safe Swiping: Dating app Tinder is implementing ID checks amid rise in AI scams.

NEXT IN AI

Google’s Gemini Pro 1.5 shows impressive recall in early tests

What’s the problem? If you’ve ever uploaded a document or pasted long text into ChatGPT, you’ve probably noticed that it struggles with finding specific facts and often glides over import details when prompted.

Why does it happen? That’s because most major AI models struggle with the “needle in a haystack“ challenge of identifying specific details in large texts or datasets.

What’s changed? Early tests from independent users strongly suggest that Google’s new Gemini Pro 1.5 model has figured out the problem and performs almost flawlessly when you give it large files.

So what? Not only can Gemini Pro 1.5 ingest up to roughly 8x more data than GPT-4 — giving it the ability to process up to 700,000 words, 11 hours of audio, or 1 hour of video — it can also identify very specific details in these files to give you more accurate answers.

Some early use cases we’ve found:

• Wharton Professor Ethan Mollick gave Gemini Pro 1.5 The Great Gatsby but changed 2 details in the book. Gemini Pro was able to catch both inaccuracies.

• Tester Mckay Wrigley gave Gemini Pro an entire biology book and asked 3 questions — and got correct answers for all of them.

• Another tester Sully Omar uploaded an entire codebase and Gemini Pro was able to identify issues with the code and implement fixes.

TOGETHER WITH SUBSTRATA

Sell Smarter with Substrata's Social Signal Intelligence

Substrata is your invisible confidant in the high stakes realms of dealmaking and sales.

Its Real-Time, Socially-Aware AI is trained to help you understand the subtle "social dance" between sellers and prospects, helping you navigate the intricate maze of office politics, hierarchies, perceptions, emotions, biases, attitudes, sentiments and power dynamics. Learn More

AI AT WORK

How to convert text into speech with ChatGPT

• Log in to ChatGPT.

• Enable the ElevenLabs Text to Speech GPT or access it directly here.

• Insert your text to convert it into speech and press enter.

• ChatGPT will give you several options for voice.

• Select one and then wait for a few seconds, ChatGPT will give you a link to your audio.

• Click on the link to listen to the audio. You can also download the file or set the playback speed as required.

CHART

AI productivity tools market map

TOGETHER WITH GALILEO

Join AI leaders for GenAI Productionize 2024

Announcing GenAI Productionize 2024 – a virtual industry-first summit focused on productionizing generative AI within the enterprise!

Join AI experts from Coinbase, LinkedIn, Roblox, Databricks, JPMorgan Chase, Comcast, Fidelity and more for insights and actionable strategies on generative AI governance, frameworks, and practical techniques for evaluation and observability. Register now!

AI & THE LABOR MARKET

New research finds AI is already having a significant impact on freelance jobs

AI is having a major impact on freelance jobs — but the impact is unevenly distributed. That’s the key takeaway from a new piece of research from Bloomberry, a publication that analyzes labor market trends.

The study looked at 5 million jobs across the 12 most popular job categories on freelancing website Upwork in the past 84 days and found the following trends:

• Writing jobs have seen a 33% decline, experiencing the biggest drop in demand.

• Translation and customer service jobs also saw a 19% and 16% decline. Both roles have been a major target for generative AI tools launched over the last year.

• Translation jobs also saw a 20%+ drop in hourly rates.

• Other roles seem to be safe from AI, and some like video editing and sales are seeing a big increase in demand despite the emergence of AI tools in these categories.

Among AI jobs, those related to chatbots have seen the biggest increase, growing 2,000% over the last 2 years. Other AI related roles like AI content creation and ChatGPT API integration have also seen an uptick.

PRODUCTIVITY

5 AI Tools to Supercharge Your Productivity

Prompt Hunt: Craft top-quality visuals with incredible speed, control, and detail with AI.

​​GoatStack AI: An AI Agent that reads scientific papers and sends you personalized insights daily.

Gamma AI*: Use AI to create high quality presentations, documents and webpages in minutes that wow your team and get the job done every time — no design skills required. Try Gamma for free

Jamworks: Empowers students to generate perfect notes, interactive flashcards, and AI chatbots for every class.

Delibr: Go from ideation and feedback to crisp product documents with AI.

^{* indicates a promoted tool, if any}

AI GENERATED IMAGES

The Simpsons as K-Drama

Acquire new customers and drive revenue by partnering with us

Superhuman is the world’s biggest AI newsletter for businesses and professionals with 600,000+ readers working at the world’s leading startups and enterprises. Companies like Amazon, Calendly, and Notion feature their products in Superhuman. Main ads are typically sold out 4 weeks in advance. You can book future ad spots here.  

🧞 Your wish is my command

Reviews of the day

Thanks for reading.

Until next time!

Zain

p.s. if you want to sign up for this newsletter or share it with a friend or colleague, you can find us here. For questions and feedback, email us at [email protected]. We always listen and respond.