Tech

Day 94 of 100 Days of AI

Michael Tefula

27 Jun 2024 — 1 min read

Just 18 months ago, OpenAI released GPT-3.5 Turbo which had double the input token context window of its predecessor, GPT-3. We went from 2048 tokens to 4096 tokens and that felt like a significant leap. But today, we are enjoying context windows of 128,000 tokens with GPT4o.

How much further can we go? Today, I was perusing this Google paper and it turns out that their research team can achieve a 10 million token context window Gemini 1.5! Not just that, but as you can see in the charts below from the June 2024 update of the paper, the model achieves almost perfect recall across the equivalent of 7 million words or up to 107 hours of audio or 10 hours of video. These are incredibly impressive results!

A Goldilocks Introduction to AI Agents: Opportunities, Challenges, and Everyday Impact

AI agents have quickly evolved from obscure technical experiments to mainstream buzz. In the last 18 months, new automation capabilities have captured the imagination of entrepreneurs and established organizations alike. While it’s possible that we’re in another AI bubble, the early adopters of AI agents are reporting impressive

Open Problems (& Opportunities) for AI: Summary Notes from the Conference

Last week I attended the Algorithmic Innovation & Entrepreneurship Summit on Open Problems for AI. That’s a bit of a mouthful but in essence, it was a 2-day conference covering the challenges and opportunities for AI over the next 5 years. Day 1 was focussed on algorithms and AI

The Software Engineer is Dead, Long Live the Software Engineer!

An undeniable killer use case for large language models is code generation. It’s already helping software developers write code up to twice as fast and with more delight. As LLM models improve with each release, they can write better software and handle more complex architectures at a fraction of

Day 100 of 100 Days of AI 🎉

AI agents have been getting a lot of attention but they can be expensive to run. This is because they use a lot of tokens and make multiple calls to LLMs. Some AI developers have beat performance benchmarks by using exceptionally expensive agentic runs. However, this is unrealistic because in

Read more

A Goldilocks Introduction to AI Agents: Opportunities, Challenges, and Everyday Impact

Open Problems (& Opportunities) for AI: Summary Notes from the Conference

The Software Engineer is Dead, Long Live the Software Engineer!

Day 100 of 100 Days of AI 🎉