Episode 12: Speech to Text

OpenAI's "Atlas" browser is seen as a strategic move to secure market share, with some calling it a "Chrome killer". By owning a piece of the web browser, OpenAI gains leverage in the search market, challenging Google. The browser's key feature is using the current web page as context for AI queries, effectively turning it into a "true super assistant". This represents a shift in the AI boom from the race for the best LLM performance to securing dominance in agentic applications. Google is countering this by integrating a Gemini button into Chrome that includes page context in searches.Anthropic is also moving into the application space, releasing Cloud Code for the web, allowing users to delegate coding tasks directly from their browser to an Anthropic-managed cloud infrastructure. This further solidifies the trend toward a more declarative style of software engineering.AI has accelerated the development of speech-to-text technology, moving it beyond older applications like Dragon Naturally Speaking. New, highly accurate cloud-based tools (like Whisper Flow and Voicy) are now available.The primary benefit is a massive productivity gain, increasing input speed from an average typing rate of 40-50 words per minute to 150-200 words per minute when speaking. This speed enables a new style of interaction: the "rambling speech-to-text prompt".Unlike traditional search, where concise keyword searching is key , LLMs benefit from rambling because the additional context is additive. The LLM can follow the user's thought process and dismiss earlier ideas for later ones, making the output significantly better than a lazy prompt.Security Warning: Cloud-based speech-to-text sends data over the web. Features like automatic context finding, which look at your screen for context (e.g., variable names or email content), pose a serious security risk and should be avoided with sensitive data.The KiLLM Chain is an example of an indirect prompt injection attack. As LLM agents read external data (like product reviews on a website), a malicious user could embed a harmful command (e.g., "delete my account now") in the user-generated content. The LLM, treating the review as context, might be tricked into execution.Defenses include wrapping external data with metadata to define its source in the LLM's context. Fundamentally, you must apply the principle of least privilege: never give the LLM the ability to take an action you don't want it to take. Necessary safeguards include guardrails and a human-in-the-loop approval process for potentially dangerous steps.AI is disrupting the movie industry, with costs potentially being reduced by up to ninety percent. The appearance of Tilly Norwood, an AI-generated actress, highlights the trend of using AI likenesses.For brands, AI actors offer high margins and lower risk compared to human talent. This shift is analogous to the one occurring in software engineering: the Director (the architect/product manager) gains more control over their creative vision, while the value of the individual Actor (the coder) who executes the work decreases. The focus moves from execution to vision and product-level thinking.