System Prompt podcast artwork

PODCAST · business

System Prompt

System Prompt is a podcast about what’s actually happening in AI.Not hype. Not surface-level takes.We break down how AI is changing software, SaaS, infrastructure, and the way systems are built focusing on real-world tradeoffs, architecture decisions, and where the value is actually shifting.If you’re building, deploying, or thinking seriously about AI, this is for you.

Publisher-supplied feed metadata · PodParley refreshed Sep 18, 2026 · Source feed

  1. 26

    The Reality of Physical AI w/ Hiten Sonpal

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/the-reality-of-physical-ai-with-hiten-sonpalPhysical AI gets a lot more serious when a bad answer can move thousands of pounds of machinery. In Episode 25 of System Prompt, Peter and Val sit down with Hiten Sonpal, CEO of RISE Robotics and a robotics veteran whose career spans iRobot, defense robotics, autonomous lawn care, Electric Sheep, and heavy industrial machinery.The conversation gets into what changes when probabilistic AI meets deterministic machines, why safety envelopes matter, and why Hiten believes the future of robotics is more likely to be specialized machines that amplify people than general-purpose humanoid replacements.Hiten also breaks down RISE Robotics’ Beltdraulic technology, the SuperJammer robotic arm that lifted more than 7,000 pounds, where AI is actually useful in engineering today, and why impressive technology still does not become a business until customers want it and will pay for it.• What changes when AI starts moving physical machines• Human-in-the-loop robotics and deterministic safety systems• Why AI should not have unrestricted control of heavy equipment• RISE Robotics’ Beltdraulic alternative to hydraulics• The SuperJammer arm and its 7,000+ pound world-record lift• What Beltdraulics does better — and worse — than hydraulics• How RISE uses AI for software, sourcing, and calculations• Why robotics has a harder training-data problem than language models• Desirability, viability, and feasibility as tests for real innovation• Why Hiten is skeptical of humanoid-robot hype• Specialized robots versus general-purpose human replacements• What software engineers misunderstand about hardware• What robotics engineers underestimate about modern AI• Which jobs robotics is most likely to automate firstKEY TAKEAWAYSPHYSICAL AI NEEDS DETERMINISTIC BOUNDARIESA model can make high-level decisions, but safety-critical machinery still needs hard constraints. The system has to know when the answer is simply “no.”SPECIALIZATION BEATS HUMAN REPLACEMENTA robot does not need arms, legs, hands, and twenty degrees of freedom if the task can be solved with wheels and a purpose-built mechanism. Complexity has to earn its place.HARDWARE CHANGES THE FAILURE MODELSoftware bugs can often be patched quickly. Hardware failures involve parts, lead times, prototypes, shipping, installation, and sometimes redesigning the machine itself.NOVELTY IS NOT A BUSINESSA technically impressive product still has to solve a problem customers care about, at a price they will pay, with economics that work.AI IS ALREADY HELPING ENGINEERING — WITH CHECKSRISE is using AI to accelerate software work, research components, and assist with calculations, but Hiten is clear that engineering outputs still need human verification.CHAPTERS00:00 Physical AI Gets Real02:21 What Is Different About Robotics Now?03:18 Failure, Safety, and Human Control06:22 Should AI Directly Control Heavy Machinery?09:03 Robots, Jobs, and Human Amplification12:11 Why Robotics Needs a Hardware Revolution13:05 The Origin of Beltdraulics14:46 What Beltdraulics Does Worse Than Hydraulics18:05 Building a 7,000-Pound-Lift Robotic Arm20:42 How RISE Uses AI24:11 The Robotics Training-Data Problem27:01 Novel Technology vs. Real Business28:52 The Problem With Humanoid Robots36:06 The iRobot Lawn-Mower Story39:58 Which Jobs Robotics Takes First41:57 What AI People Misunderstand About Robotics44:26 What Robotics Engineers Underestimate About AI46:04 The Robotics Problem That Still Is Not Solved

  2. 25

    NVIDIA, Asana, and New Models

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/nvidia-asana-and-new-modelsNVIDIA agreeing to acquire Hugging Face changes more than who owns the biggest model repository in open-source AI. It may also make the open ecosystem harder to push around.In Episode 24 of System Prompt, Peter and Val break down NVIDIA’s $12.9 billion Hugging Face deal, Asana’s claim that Codex compressed years of engineering work into weeks, and a wave of open models getting harder to dismiss.The conversation moves past the headlines into the systems underneath them: why NVIDIA benefits from open models thriving, why AI productivity claims need methodology and labor context, and why better local models are changing how developers think about cost, privacy, and infrastructure.Peter also walks through a one-shot AI Signal dashboard built with GLM 5.3 Flash and explains why improving open models are forcing him to rethink how much scaffolding smaller models need.WHAT WE DISCUSS• NVIDIA’s $12.9 billion Hugging Face acquisition• Why NVIDIA may become a powerful defender of open-source AI• Whether Hugging Face can stay neutral across CUDA, AMD, MLX, and other runtimes• Why open models may become harder to marginalize• AI-assisted hacking, agency, and tool access• Anthropic’s pricing problem as open models improve• Why model quality alone may not protect a frontier-model moat• Asana compressing years of engineering work into weeks with Codex• Why AI productivity claims need labor and methodology context• GLM 5.3 Flash and the rise of stronger open-weight models• Building an AI news dashboard from one ambiguous prompt• Qwen, GLM, and model routing for planning, execution, and review• Why assumptions about smaller models may already be outdatedKEY TAKEAWAYSNVIDIA CHANGES THE OPEN-SOURCE POWER BALANCELobbying against a smaller open-model company is one thing. Doing it when NVIDIA has billions invested in the ecosystem is another. If open models grow, NVIDIA is positioned to benefit.HEADLINES NEED SYSTEM CONTEXTCompressing five years of work into two weeks sounds incredible, but the model is only part of the system. Domain expertise, testing, review, infrastructure, labor, and methodology shape the result.MODEL MOATS ARE GETTING THINNERAnthropic still produces excellent models, but quality is no longer the only variable. Cost, usage limits, privacy, local deployment, and capable open models all affect where workloads go.OPEN MODELS NEED LESS HAND-HOLDINGSmaller models once needed heavy scaffolding to produce reliable results. That assumption is eroding as newer models improve at reasoning, coding, review, and ambiguous product decisions.ARCHITECTURE HAS TO FOLLOW THE MODELSSystems built around yesterday’s models may not make sense for tomorrow’s. Better models change where guardrails belong, which tasks need frontier models, and how much infrastructure is necessary.CHAPTERS00:00 NVIDIA Buys Hugging Face05:47 Does NVIDIA Protect Open Source?11:34 Open Models, Hacking, and Agency18:17 Anthropic’s Shrinking Moat22:04 The Asana Codex Story27:16 What AI Productivity Headlines Leave Out31:13 GLM 5.3 Flash Arrives34:00 Building AI Signal with an Open Model40:50 One Prompt, Better Product Decisions43:42 Price, Privacy, and Frontier Models49:44 Rethinking Smaller Open Models

  3. 24

    AI, Accountants, and the Future of the Profession

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-accountants-and-the-future-of-the-professionAI is not just changing the tools accountants use. It is changing the work itself.In Episode 23 of System Prompt, Peter and Val are joined by Peter McCarroll, founder of Fuel Accountants and creator of The AI Accountant, to talk about what AI means for accounting firms, their teams, and the future of the profession.The conversation moves past prompt training and AI hype into the harder questions: which work should be automated, what still requires human judgment, how firms should handle sensitive client data, and what happens when AI starts taking over work that used to require years of experience.Peter McCarroll also shares a real AI failure that cost his firm roughly 10 hours of rework, why accountants should train on the work instead of the tools, and why he believes firms may have only a couple of busy seasons left before the profession looks very different.WHAT WE DISCUSS• Why AI training often fails to change how people work• Training on workflows instead of individual AI tools• Why the billable hour may become a weaker measure of productivity• Where automation should stop in professional services• Human accountability for AI-generated work• What happens when AI gets accounting work wrong• Using deterministic tools like Python for calculations• Choosing between Claude, ChatGPT, Gemini, and open models• Token cost and model selection for agentic workflows• Protecting sensitive client and financial data• Shadow AI, retention, and business risk• Whether AI will reduce accounting jobs• Why professional judgment may not be the moat accountants think it is• Context engineering for client-specific financial analysis• How accounting moves from the rearview mirror to the dashboardKEY TAKEAWAYSTRAIN ON THE WORK, NOT THE TOOLTeaching someone how to use ChatGPT or Claude does not automatically change a workflow. Start with the work, redesign the process, then teach the team how AI fits into it.ACCOUNTABILITY DOES NOT GET AUTOMATEDAI can perform more of the work, but the accountant still has to stand behind what reaches the client. Professional services cannot outsource responsibility to a model.AI NEEDS CHECKPOINTSA model can appear to follow instructions while quietly dropping part of the work. Verification, review, and deterministic steps matter when the output affects financial decisions.PROFESSIONAL JUDGMENT IS CHANGINGMuch of what experts call judgment comes from years of internalized rules and pattern recognition. AI is increasingly capable of applying those rules, which pushes human value toward context, relationships, verification, and advice.ACCOUNTING MOVES FORWARDThe profession has historically reported what already happened. AI makes it possible for accountants to move closer to real-time financial insight and become a co-pilot for what the business should do next.CHAPTERS00:00 Meet Peter McCarroll02:41 Train on the Work, Not the Tools04:52 AI Workflows at Fuel Accountants07:31 What Should Never Be Automated10:45 When AI Fails in Accounting13:02 Making AI More Deterministic14:28 Choosing Models and Managing Cost19:02 Client Data, Privacy, and AI23:46 Accountability for AI-Generated Work26:51 Is AI Taking Accounting Jobs?30:10 Filtering AI Noise for Accountants32:19 Professional Judgment Is Changing38:45 Hallucinations and Context Engineering42:31 What Accounting Firms Should Do Now45:42 Accounting Five Years From Now

  4. 23

    Why China is winning the AI race (Qwen3.8:27B is amazing)

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/why-china-is-winning-the-ai-raceA 27 billion parameter model should not be competing with frontier AI.But Qwen3.8:27B is making that comparison a lot less ridiculous.In Episode 22 of System Prompt, Peter and Val look at what a model this size can actually do in practical use.Instead of just discussing benchmarks, Peter runs Qwen3.8:27B locally inside Pi Code and gives it a real task during the episode: build a comparative analysis workflow, create test data, work through failures, validate the results, and produce a usable report.It finishes before the episode ends.The bigger question is not whether Qwen replaces frontier models.It is how much work no longer needs a frontier model at all.WHAT WE DISCUSS• Why Qwen3.8:27B matters• Running capable AI locally• Coding and long-running tasks• Tool use and agent workflows• Using local AI for business work• Where smaller models still fall short• Executor models vs heavy reasoning models• Routing harder work to frontier AI• Dense models vs mixture-of-experts• How local AI changes cost and infrastructureKEY TAKEAWAYS27B MODELS CAN DO REAL WORKQwen3.8:27B is small enough to run on prosumer hardware while still being capable of coding, tool use, structured analysis, and longer-running tasks.THE HARNESS MATTERSThe model does not work alone.Inside Pi Code, Qwen can inspect its environment, create tools, write code, run tests, find problems, and continue working toward a finished result.BUSINESS WORK IS A REAL USE CASEDuring the episode, Qwen builds a comparative analysis capability from scratch.It creates test data, cleans and normalizes information, performs the analysis, and generates graphs from the results.The output still needs human review, but the model can take meaningful execution work off someone's plate.LOCAL DOES NOT HAVE TO REPLACE FRONTIERThe goal is not to eliminate Claude, ChatGPT, or other frontier models.A local model can handle well-defined execution while more ambiguous or difficult work routes to a frontier model when necessary.GOOD SPECS MATTERQwen performs best when the task is clear.A human or stronger model can define the plan and requirements, then hand execution to the smaller model.That makes routing and task design increasingly important.THE FUTURE IS HYBRIDLocal models will not win every task, and frontier models are not going away.But as smaller models improve, more work can happen locally while frontier models become the escalation path instead of the default.CHAPTERS00:00 Episode 2201:12 Why Qwen3.8:27B?03:35 Comparing 27B to Frontier AI05:37 What Can You Actually Do With It?07:50 Building a Workflow Live14:09 What Smaller Models Mean17:11 Local AI Economics20:26 Internal Business Assistants23:02 Routing to Frontier Models26:21 Where Qwen Falls Short28:36 Do You Need the Best Model?38:56 Why the Future Is Hybrid41:55 The Finished Analysis43:44 Dense vs Mixture-of-Experts46:36 What Local AI Can Replace51:01 What 27B Enables Today

  5. 22

    Evals: How Do You Know Which AI Model to Trust?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/how-to-know-which-ai-model-to-trustThe AI model at the top of a leaderboard may not be the best model for your system.Because the leaderboard is not testing your system.In Episode 21 of System Prompt, Peter and Val break down AI evals: what benchmarks measure, why the harness matters, and how to test models against the work you actually expect them to do.Peter walks through a custom eval across more than 20 local and open models covering tool calling, extraction, instruction following, and real-world coding tasks.The results were surprising. Smaller models matched or beat much larger ones. Turning reasoning on sometimes made performance worse.The bigger lesson: an eval measures more than the model. Quantization, runtime, token budgets, reasoning settings, parsers, and timeouts can all affect the result.WHAT WE DISCUSS• What AI evals actually measure• Why leaderboards only tell part of the story• How the harness changes model performance• Quantization, runtimes, and configuration• Building evals around real workloads• Tool calling, extraction, instruction following, and coding• Why repetition and consistency matter• Thinking vs non-thinking configurations• Routing tasks to different models• Finding problems in your own systemKEY TAKEAWAYSTHE BEST MODEL DEPENDS ON THE JOBA benchmark measures performance on a particular test. It does not automatically tell you which model is best for your application.A coding agent, extraction pipeline, chatbot, and tool-using agent all need different things. Start with the workload, then choose the eval.THE HARNESS IS PART OF THE RESULTModels do not operate alone.The harness creates prompts, exposes tools, manages token limits, parses responses, and decides whether a task succeeded.Change the harness, configuration, quantization, or runtime and you can change the result.TEST THE MODEL YOU ARE ACTUALLY RUNNINGA full-precision benchmark is useful reference data, but it is not the same experiment as running a Q4 model through a local runtime.Your production configuration is part of the evaluation.REPETITION MATTERSOne successful run does not prove reliability.Running tasks multiple times exposes models that score well once but behave inconsistently.For production systems, stability matters.REASONING IS NOT ALWAYS BETTERThinking modes helped some models and hurt others.In some cases reasoning increased token use, hit time or output budgets, or reduced consistency.The right configuration has to be measured against the task.EVALS ENABLE ROUTINGThe best architecture may not use one model for everything.A smaller model may handle chat, extraction, or tool calling while another handles coding or harder reasoning.Once you know where each model succeeds and fails, routing stops being guesswork.EVALS TEST YOUR SYSTEM TOOThe eval process also exposed problems in Peter's own gateway and harness.Some apparent model failures were really token limits, timeouts, parsing issues, or infrastructure problems.CHAPTERS00:00 Episode 21 and the 1%00:48 What Are AI Evals?02:48 Model Capability and Benchmarks05:07 Why the Harness Matters09:48 Quantization and Fair Comparisons11:30 Building a Custom Eval Suite19:04 Repetition and Reliability20:50 The Model Results23:17 When Thinking Hurts Performance29:55 Accuracy Versus Token Cost30:55 Routing Tasks to Different Models37:00 Evals Finding Bugs in the System40:36 Closing Thoughts

  6. 21

    Conversation about Quantization(Also about hosting DeepSeekv4:Flash)

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/how-a-284-billion-parameter-model-fits-on-one-machineA 284-billion-parameter AI model should not fit on one local machine.DeepSeek V4 Flash does.In Episode 20 of System Prompt, Peter and Val explore how quantization, mixed precision, importance-aware compression, and speculative decoding make it possible to run a massive mixture-of-experts model on hardware such as a single DGX Spark.Peter breaks down how Antirez compressed DeepSeek V4 Flash to about 81 GB while preserving enough reasoning, coding, and tool-use ability to remain useful.Most parameters sit inside routed experts using roughly two-bit quantization. More sensitive components remain at Q8, FP16, or FP32. An importance matrix helps identify which compression errors are most likely to damage the model's behavior.Peter also demonstrates the model running live through his local agent infrastructure at roughly 20 to 30 tokens per second.WHAT WE DISCUSS• Running DeepSeek V4 Flash on one machine• Quantization and model compression• Mixture-of-experts architecture• Importance matrices and mixed precision• Speculative decoding, dSpark, and Dwarf Star• Continuous local inference• Local models for coding, validation, and automation• Human oversight and self-improving systemsKEY TAKEAWAYSQUANTIZATION PRESERVES USEFUL BEHAVIORQuantization lowers the precision used to represent model weights. That reduces memory use but introduces approximation errors.The goal is not to preserve every original value. It is to preserve the behavior that makes the model useful.NOT EVERY PART SHOULD BE COMPRESSED EQUALLYThe routed experts contain most of the model's parameters and receive the most aggressive compression. Sensitive components stay at higher precision because errors there can affect the model more broadly.IMPORTANCE MATRICES HELP PROTECT QUALITYAn importance matrix uses real model activations to estimate which weight dimensions matter most during inference.Calibration matters because a model tuned only for conversation may become less reliable during coding, tool use, structured output, reasoning, or long-context retrieval.FITTING THE MODEL IS ONLY THE FIRST PROBLEMA model fitting into memory does not automatically make it fast, scalable, or production-ready. This implementation is mainly suited to one user with low concurrency.SPECULATIVE DECODING IMPROVES SPEEDA draft mechanism proposes several future tokens. The full model verifies them, accepts the longest valid sequence, and rejects the rest.Using dSpark and Dwarf Star, Peter reports about 20 to 30 generated tokens per second on a single DGX Spark.LOCAL INFERENCE CHANGES THE ECONOMICSLocal models can support research, validation, coding, monitoring, and automation without creating an API charge for every generated token.The hardware still has costs, but inference becomes owned capacity instead of a metered service.CHAPTERS00:00 Celebrating Episode 2001:10 Committing to 100 Episodes01:59 Introduction to Quantization03:31 Comparing Agents and Live Demos04:06 DeepSeek V4 Flash05:23 Quantization and Model Compression09:07 Importance Matrices10:12 Q Weights and Mixed Precision13:36 Maximizing Local Model Output16:59 Speculative Decoding17:52 Live Model Demonstration20:06 dSpark and Dwarf Star21:39 Future of Quantization24:37 Practical Local Model Applications29:04 Continuous Inference and Validation32:29 Self-Improving Models36:00 Fear, Competition, and Market Share37:06 Hope for Local AI

  7. 20

    This Is Why Copilot Adoption Is Failing

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/why-businesses-dont-trust-ai-agents-yetAI agents do not earn trust because they work once.They earn trust by working consistently, recovering from failure, and completing the workflows employees depend on.In Episode 19 of System Prompt, Peter and Val explore building business agents with Microsoft 365 and Copilot Studio.Peter demonstrates a COO-style agent grounded in SharePoint data. It reviews operational information, identifies risks, and hands report creation to a specialized subagent.Then the report-writing agent fails.The episode becomes a real-time look at what happens when an agent that worked previously suddenly stops, returns a generic system error, and gives the user no clear recovery path.WHAT WE DISCUSS• Building agents with Microsoft 365• Grounding agents in SharePoint data• Using subagents for specialized tasks• Limiting tool surfaces• Running evaluations and reviewing traces• Troubleshooting failed agent handoffs• Comparing Copilot Studio with Claude Cowork• Why reliability affects adoptionKEY TAKEAWAYSMICROSOFT OFFERS A PRACTICAL STARTING POINTFor businesses already using Microsoft 365, Copilot Studio reduces some of the work around authentication, permissions, distribution, and access to business data.The opportunity is not just another AI model. It is an agent operating inside the environment employees already use.AGENTS NEED REAL RESPONSIBILITIESThe COO Coach reviews operational information, identifies risks, prepares weekly summaries, and delegates report creation.That connects the agent to a real business process instead of using it as a general chatbot.SEPARATION OF DUTIES MATTERSThe main agent handles analysis. The report-writing agent creates the final document.Smaller tool surfaces make workflows easier to understand, test, and troubleshoot.AI SHOULD SUPPORT HUMAN DECISIONSThe agent identifies overdue invoices, missed milestones, declining margins, and other risks.It provides information and options without making executive decisions for the user.CONSISTENCY CREATES TRUSTThe workflow had worked several times before the episode.Nothing meaningful changed, but it began returning a generic system error during the live demo.It eventually worked again after settings were changed, saved, changed back, and saved again.That is not a dependable recovery process.When a three-minute workflow suddenly requires 25 minutes of troubleshooting, the value disappears.Consistency creates trust. Trust creates adoption.RELIABILITY IS THE USER EXPERIENCEEmployees will not depend on an agent that works unpredictably before a meeting, review, or deadline.The manual process may be slower, but users will return to it when it is more dependable.A capable agent is not enough. It also has to work when people need it.CHAPTERS00:00 — Introduction01:04 — Building Agents with Microsoft 36503:40 — Creating the COO Coach11:37 — Live Copilot Studio Demo18:45 — Troubleshooting and Evaluations31:59 — Copilot Studio vs. Claude Cowork34:24 — Consistency and Reliability40:06 — Impact on Real Workflows47:49 — Loss of Confidence50:14 — Why Trust Drives Adoption59:41 — Call for Better ReliabilityABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, enterprise platforms, training, and practical implementation.

  8. 19

    Your Company Bought AI. Why Isn’t Anyone Using It?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/why-no-one-uses-your-aiBuying AI tools does not create adoption.Employees need to understand why the tools matter, how they connect to their work, and what success is supposed to look like.In Episode 18 of System Prompt, Peter and Val are joined by Jonny Havey of E-Learning Partners to discuss AI adoption, employee education, training ROI, and the role of clear KPIs.The conversation examines why training programs fail when they are disconnected from business outcomes and how organizations can measure whether AI education is actually improving performance.WHAT WE DISCUSS• Why buying AI tools does not guarantee adoption• The role of education in successful implementation• Why training must connect to business outcomes• How KPIs measure training effectiveness• Why ROI is broader than direct financial return• How AI is changing workplace education• Why employees need role-specific training• The difference between intelligence and wisdomKEY TAKEAWAYSAI ADOPTION REQUIRES MORE THAN ACCESSGiving employees an AI license does not mean they will use it effectively.They need to understand which problems it can solve, when it should be used, what data is appropriate to provide, and how outputs should be evaluated.TRAINING NEEDS CLEAR KPISA training program should be tied to a measurable outcome.That could include faster task completion, fewer errors, reduced onboarding time, higher adoption, stronger confidence, or improved customer experience.The KPI should be defined before the training is created.ROI IS NOT ONLY FINANCIALTraining may create value through saved time, reduced risk, stronger consistency, better retention, and improved decision-making.Those outcomes may affect revenue or cost later, even when the return is not immediately financial.TRAINING SHOULD ALIGN WITH ORGANIZATIONAL GOALSGeneric AI workshops often fail because they are disconnected from the work employees actually perform.Different teams have different workflows, risks, and responsibilities.Training becomes more useful when it is built around real business processes and expected outcomes.AI SHOULD SUPPORT WISDOM, NOT JUST OUTPUTAI can generate information quickly, but information alone does not create good judgment.Employees still need the experience and context required to evaluate recommendations and understand consequences.CHAPTERS00:00 — The Importance of ROI and KPIs05:16 — Aligning Training Programs with KPIs08:36 — The Evolution of E-Learning Partners24:19 — The Impact of AI Adoption on Education45:42 — The Role of E-Learning PartnersABOUT JONNY HAVEYJonny Havey is the co-founder of E-Learning Partners and host of the Learning Transformed podcast.https://elearningpartners.comWATCH THE EPISODEhttps://youtu.be/M3iRj99gy7YABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, enterprise platforms, training, and practical implementation.

  9. 18

    How AI is Transforming Food Discovery with Stupid Good AI

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/food-discovery-stupid-good-aiRestaurant discovery is still dominated by ratings, generic lists, and search results that often fail to reflect what a person actually wants.In Episode 17 of System Prompt, Peter and Val are joined by David Leibner, founder of Stupid Good AI, to discuss how artificial intelligence could create a more personalized way to discover food, restaurants, and local experiences.The conversation explores how Stupid Good AI combines community feedback, data science, and AI to move beyond static reviews and broad “best of” lists.David also discusses building a vertical AI product, the changing software-development process, open models, and how user behavior can improve recommendations over time.WHAT WE DISCUSS• Why restaurant discovery still feels broken• How AI can personalize food recommendations• Why ratings alone do not capture individual preferences• How community feedback improves discovery• Building a vertical AI product around a specific problem• The role of data science and open models• How AI is changing software development• Turning local restaurant data into useful recommendationsKEY TAKEAWAYSFOOD DISCOVERY NEEDS MORE CONTEXTA highly rated restaurant is not automatically the right recommendation for every person.Useful discovery should consider taste, location, occasion, dietary needs, budget, atmosphere, and previous preferences.COMMUNITY DATA CAN IMPROVE RECOMMENDATIONSUser feedback gives the system more than a single star rating.Over time, patterns across reviews, preferences, and behavior can help produce recommendations that are more relevant to each user.VERTICAL AI PRODUCTS CAN GO DEEPERStupid Good AI focuses on one specific problem rather than trying to become a general-purpose assistant.That narrower scope creates an opportunity to build better data, workflows, and experiences around food discovery.AI DOES NOT REPLACE PRODUCT THINKINGModels can support recommendations, classification, search, and personalization.The product still needs strong data, useful interfaces, reliable feedback loops, and a clear understanding of the user’s problem.ABOUT DAVID LEIBNERDavid Leibner is the founder of Stupid Good AI, a platform focused on improving how people discover restaurants and local food experiences.Learn more:https://stupidgood.aiEarly-access users can mention System Prompt when contacting the Stupid Good AI team.ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  10. 17

    Enterprise AI Training Is Failing Because Tool Training Is Not Enough

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/enterprise-ai-trainingEnterprise AI training is often reduced to showing employees how to use a chatbot or write better prompts.That is not enough for real implementation.In Episode 16 of System Prompt, Peter and Val examine why businesses need a deeper understanding of AI tools, ecosystems, workflows, memory, data, and operational responsibility.The conversation explores the role of a head of AI, forward-deployed engineers, and internal leaders who can connect business problems with practical systems.AI education should not be treated as a one-time workshop. Models, tools, risks, and capabilities change continuously, which means organizations need an ongoing process for learning, testing, and implementation.WHAT WE DISCUSS• Why basic prompt training is not enough• Starting with business problems instead of tools• Understanding AI ecosystems and integrations• The role of memory and context• Why employees need role-specific training• What a head of AI should own• How forward-deployed engineers support implementation• The gap between experimentation and productionKEY TAKEAWAYSTOOL TRAINING IS NOT AI EDUCATIONTeaching employees how to open a chatbot may create familiarity, but it does not explain how AI fits into workflows, where the risks are, what data can be used, or how outputs should be verified.START WITH THE BUSINESS PROBLEMOrganizations should identify slow, expensive, repetitive, or error-prone processes before selecting an AI tool.The goal is to improve an outcome, not simply add AI.ECOSYSTEM UNDERSTANDING MATTERSAI tools interact with data, identity systems, permissions, applications, APIs, memory, retrieval, and existing workflows.Businesses need people who understand how those components connect and where failures may appear.THE HEAD OF AI IS AN OWNERSHIP ROLEA head of AI should connect business priorities, education, governance, implementation, measurement, and technical teams.Without clear ownership, adoption becomes fragmented across departments.FORWARD-DEPLOYED ENGINEERS CLOSE THE GAPThese engineers work closely with users, processes, and existing infrastructure to turn business problems into working systems.Their value comes from combining technical execution with operational understanding.AI EDUCATION MUST CONTINUEOrganizations need ongoing training, testing, documentation, and feedback.The goal is not to make every employee an AI expert. It is to make each employee competent within the boundaries of their role.CHAPTERS00:00 — The Current State of Enterprise AI Education07:27 — Identifying Problems and Solutions19:01 — The Need for Deep Understanding25:09 — The Role of Forward-Deployed Engineers36:21 — The Challenge of AI ImplementationWATCH THE EPISODEhttps://youtu.be/HdcDCQS1aREABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, enterprise platforms, training, and practical implementation.

  11. 16

    What Fable 5’s Removal Reveals About AI Model Dependence

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/fable-5-removal-model-dependenceWhat happens when a model your workflow depends on is suddenly removed, restricted, or made more expensive?In Episode 15 of System Prompt, Peter and Val discuss what Fable 5’s removal reveals about dependence on a single AI provider or model.The conversation explores alternative models, open models, operating costs, and the mistaken belief that openly available models are automatically free to use.A model may be downloadable without a per-token fee, but running it still requires hardware, hosting, power, engineering, maintenance, and monitoring.The broader lesson is that businesses should evaluate AI systems based on sustainable economics, portability, and the cost of completing real work.WHAT WE DISCUSS• The impact of Fable 5’s removal• The risks of depending on one model provider• Why businesses need model alternatives• Open models compared with proprietary frontier models• Why openly available models are not free to operate• Hardware, hosting, and maintenance costs• Sustainable economics for AI products• How open models can support proprietary productsKEY TAKEAWAYSMODEL ACCESS CAN CHANGEProviders can remove models, alter subscription access, introduce limits, change pricing, or replace one model with another.Production workflows need fallback options and a clear migration path.ALTERNATIVE MODELS CREATE RESILIENCETeams should understand which tasks require frontier capability and which can be handled by smaller, local, or openly available models.Routing and evaluation make it easier to move workloads when access or economics change.OPEN MODELS ARE NOT FREE TO OPERATEOrganizations still need to account for hardware, cloud hosting, energy, storage, engineering, updates, security, monitoring, and support.The correct comparison is total cost per completed task.ECONOMICS SHOULD DRIVE MODEL SELECTIONThe most capable model is not always the most efficient model.Businesses should compare output quality, retries, latency, human review, integration effort, and operating cost.OPEN MODELS CAN POWER PROPRIETARY PRODUCTSA company can build commercial value around an open model through its data, workflow, integrations, evaluations, user experience, and operational system.The model may be open while the complete product remains differentiated.WATCH THE EPISODEhttps://youtu.be/xQ3RtLr3_t4ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  12. 15

    AI Security Goes Beyond Prompt Injection

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-security-beyond-prompt-injectionAI security involves more than filtering bad prompts.In Episode 14 of System Prompt, Peter and Val examine the expanding attack surface created by large language models, AI agents, tools, retrieval systems, and external integrations.The discussion covers prompt injection, jailbreaks, system prompt extraction, context poisoning, supply-chain attacks, MCP and tool poisoning, sensitive information disclosure, and the defensive controls needed to reduce risk.The central point is simple: no system prompt or single filter can secure an AI application by itself.WHAT WE DISCUSS• Direct and indirect prompt injection• Skeleton key and crescendo jailbreaks• Context compliance attacks• System prompt extraction• Context and retrieval poisoning• Supply-chain attacks• Tool and MCP poisoning• Sensitive information disclosure• Instruction hierarchy and policy enforcement• Observability, testing, and defensive frameworksKEY TAKEAWAYSPROMPT INJECTION IS ONLY ONE ATTACK PATHMalicious instructions can enter through user input, retrieved documents, webpages, emails, tool responses, memory, or external integrations.Security must cover the entire pipeline, not only the chat interface.UNTRUSTED DATA SHOULD NOT BECOME INSTRUCTIONSAI systems combine system rules, user requests, retrieved content, and tool output.The system must distinguish trusted instructions from untrusted information.Retrieved documents should be treated as data, not authority.TOOLS INCREASE THE CONSEQUENCES OF FAILUREA compromised model response becomes more dangerous when the system can access files, send messages, modify records, execute commands, or call outside services.Tools need least-privilege permissions, strict schemas, validation, and approval boundaries outside the model.OBSERVABILITY IS A SECURITY REQUIREMENTTeams need visibility into prompts, retrieved context, routing, tool calls, permissions, outputs, and failures.Without tracing, it may be impossible to determine whether a bad result came from the model, poisoned context, or an unsafe integration.SECURITY REQUIRES LAYERSUseful defenses include access controls, input handling, output validation, sandboxing, allowlists, retrieval filtering, rate limits, testing, monitoring, and human approval for high-risk actions.No single control will stop every attack.CHAPTERS00:00 — Celebrating Episode 1405:14 — Prompt Injection and Defense12:47 — Crescendo Jailbreak17:51 — Context Compliance Attacks34:24 — System Prompt Extraction41:27 — Supply-Chain Attacks48:20 — Sensitive Information DisclosureWATCH THE EPISODEhttps://youtu.be/X2UCeQQVWtcABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, security, and practical implementation.

  13. 14

    Model Routing Is the Hidden System Behind Reliable AI Applications

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/model-routingMost AI applications are not powered by one model handling every request the same way.Behind the interface, routing logic decides which model, tool, workflow, or fallback should handle each task.In Episode 13 of System Prompt, Peter and Val examine model routing and why it has such a large impact on reliability, cost, consistency, security, and user experience.The conversation covers deterministic routing, regular expressions, model selection, tracing, silent reroutes, fallback behavior, and the small improvements that turn a basic AI workflow into a dependable product.WHAT WE DISCUSS• What model routing is• Why AI applications use multiple routes• Deterministic routing compared with model-based routing• Using regular expressions and rules to classify requests• Routing work to different models and tools• Why tracing and observability matter• How silent reroutes affect the user experience• The relationship between routing and output qualityKEY TAKEAWAYSROUTING DETERMINES WHAT HAPPENS NEXTA system may send simple work to a smaller model, complex work to a frontier model, sensitive work to a local model, or structured tasks to deterministic software.The route affects quality, speed, privacy, and cost.DETERMINISTIC ROUTING CREATES CONTROLNot every routing decision needs another AI model.Rules, keywords, regular expressions, permissions, and workflow state can provide predictable routing for clearly defined requests.MODEL-BASED ROUTING HANDLES AMBIGUITYSome requests cannot be classified reliably through fixed rules.A model can evaluate intent, complexity, or required capability and select an appropriate route.That flexibility still needs testing and clear boundaries.OBSERVABILITY IS ESSENTIALTeams need to know which route was selected, what tools were called, how long the request took, and whether the result succeeded.Without tracing, routing failures can look like model failures.ROUTING IMPROVES INCREMENTALLYReliable routing is rarely designed perfectly at the beginning.Small changes to rules, thresholds, fallbacks, and model selection can improve the full AI experience over time.CHAPTERS00:00 — Introduction to Model Routing08:14 — Types of Routing Systems18:28 — Tracing and Observability26:21 — Key Aspects of Routing LogicWATCH THE EPISODEhttps://youtu.be/DBcnHlZaM9QABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  14. 13

    The AI Hardware Shift: When Local Inference Starts Making Business Sense

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-hardware-shiftAI capability is not determined by models alone.Hardware, memory, power, software support, and inference costs all shape what businesses can realistically deploy.In Episode 12 of System Prompt, Peter and Val examine the shift from cloud-based AI toward device-level and locally hosted inference.The conversation covers NVIDIA DGX Spark, CUDA, Apple silicon, RTX-class laptops, AMD Strix Halo, and the growing range of hardware available to small teams and mid-sized businesses.The central question is not whether local AI is better than cloud AI.It is when owning the hardware becomes more efficient than paying for every model call.WHAT WE DISCUSS• How hardware affects AI workloads• The shift from cloud inference to local processing• NVIDIA DGX Spark and the CUDA ecosystem• Apple silicon compared with NVIDIA-powered laptops• AMD Strix Halo and Gorgon Halo• Local inference for small teams• API costs and metered model usage• Routing work between local and cloud models• When hardware investment makes financial senseKEY TAKEAWAYSHARDWARE SHAPES WHAT AI SYSTEMS CAN DOMemory capacity, bandwidth, power use, software compatibility, and throughput determine which models can run and how quickly they complete work.LOCAL INFERENCE CHANGES THE COST MODELCloud AI turns infrastructure into a recurring operating expense.Local inference requires a larger upfront investment, but repeated workloads may become cheaper once the hardware is already owned.The useful comparison is total cost per completed task over time.CLOUD AND LOCAL CAN WORK TOGETHERBusinesses do not need one environment for every workload.Routine, private, or high-volume tasks may run locally, while more complex work is routed to frontier APIs.NVIDIA’S SOFTWARE ECOSYSTEM STILL MATTERSNVIDIA benefits from broad support across AI frameworks and tooling.That reduces deployment friction, but it can also create vendor dependence and higher hardware costs.AMD COULD EXPAND LOCAL AI OPTIONSAMD systems with large unified-memory configurations may make larger models available on smaller devices.Adoption still depends on drivers, framework compatibility, inference tools, and developer support.BUY HARDWARE FOR A WORKLOADBusinesses should estimate workload volume, model size, performance needs, expected lifespan, electricity, support, and cloud alternatives before investing.The most powerful device is not automatically the most efficient choice.CHAPTERS00:00 — The Future of AI Workers12:12 — Apple M5 and NVIDIA RTX Spark Laptops21:10 — AMD Strix Halo and Gorgon Halo26:12 — Small Teams and Local Device Optimization33:25 — Hardware Investment at Scale40:21 — Inference Cost and CapabilityWATCH THE EPISODEhttps://youtu.be/wogixf6S_64ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  15. 12

    AI in Regulated Industries: Compliance, Liability, and Innovation with Joe Ewing

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-regulated-industriesWhat changes when AI enters an industry where mistakes can create legal, financial, or regulatory consequences?In Episode 11 of System Prompt, Peter and Val are joined by Joe Ewing to discuss AI in regulated industries.The conversation examines how organizations can unlock value from AI without ignoring compliance, legal responsibility, model bias, data sensitivity, and human oversight.AI can accelerate research, discovery, analysis, and operational work. But regulated organizations must understand what the system is allowed to do, who remains accountable for its output, and what happens when the model is wrong.WHAT WE DISCUSS• The challenges of deploying AI in regulated industries• Balancing innovation with legal and compliance requirements• Why organizations can overestimate AI capability• Legal responsibility for AI-assisted decisions• How AI may affect legal research and discovery• Training and internal accountability• Whether junior employees should manage AI systems• Legal liability and model bias in fintech• The role of government in AI regulation• Why experimentation still needs legal oversightKEY TAKEAWAYSCOMPLIANCE CANNOT BE ADDED LATERData access, permissions, output review, documentation, and legal responsibility should be considered during system design.AI CAN SUPPORT DECISIONS WITHOUT OWNING THEMAI can review information, identify patterns, summarize records, and prepare possible actions.That does not mean the model should make final legal, financial, employment, or compliance decisions.OVERESTIMATING AI CREATES RISKAI systems can produce confident responses even when the underlying information is incomplete or incorrect.In regulated environments, a convincing mistake can create legal exposure, financial harm, or damage to customers.TRAINING MUST MATCH RESPONSIBILITYEmployees need to understand which tools are approved, what data can be entered, how outputs should be validated, and when results must be escalated.Responsibility should not be assigned to junior workers simply because they are comfortable using AI.MODEL BIAS CAN BECOME BUSINESS LIABILITYBias in data or model behavior can affect lending, hiring, insurance, and other regulated decisions.Organizations need testing, documentation, monitoring, and human review to identify unsupported or unequal outcomes.CHAPTERS00:00 — AI in Regulated Industries06:36 — Ethical and Legal Implications16:27 — AI and Legal Responsibility23:49 — Unlocking Opportunities with AI33:00 — Government AI and Regulation40:08 — ChatGPT and Regulatory ImplicationsWATCH THE EPISODEhttps://youtu.be/2RNvDAIafoYABOUT JOE EWINGJoe Ewing joins System Prompt to discuss AI regulation, legal responsibility, compliance, fintech, and practical oversight.ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  16. 11

    AI-Native Products Still Need Traditional Software Engineering

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-native-productsWhat actually makes a product AI-native?In Episode 10 of System Prompt, Peter and Val examine the growing use of the term and the misconceptions surrounding AI-native products and builders.AI can accelerate research, planning, development, testing, and iteration. But a product does not become reliable simply because an AI model sits at the center of it.Production systems still require deterministic processes, structured data, validation, security, observability, fallback behavior, and clear boundaries around what the model is allowed to do.The discussion also explores why AI-native builders increasingly operate like systems architects, deciding which parts of a product should use probabilistic models and which parts should remain deterministic.WHAT WE DISCUSS• What “AI-native” actually means• The difference between using AI and building around AI• Why deterministic structures still matter• Where traditional software engineering remains essential• How AI accelerates product development• Why model output must be validated• The role of planning and research• Why AI-native builders often function as systems architects• Why “AI-native” is often used as marketing languageKEY TAKEAWAYSAI-NATIVE DOES NOT MEAN AI CONTROLS EVERYTHINGAuthentication, permissions, calculations, transactions, and business rules are often better handled through deterministic software.AI is most useful where interpretation, generation, classification, or flexible language understanding creates value.DETERMINISTIC STRUCTURES CREATE RELIABILITYModel outputs can vary even when the input appears similar.AI-native products need workflows, validation rules, schemas, tool boundaries, and fallback behavior to produce credible results.TRADITIONAL SOFTWARE ENGINEERING STILL MATTERSAI does not remove the need for architecture, testing, version control, security, monitoring, documentation, or maintainable code.AI can accelerate development, but responsibility for the product remains with the people building and operating it.AI-NATIVE BUILDERS ARE SYSTEMS ARCHITECTSBuilding an AI-native product requires more than connecting an application to a model API.Builders must design the relationship between models, data, tools, interfaces, business rules, infrastructure, and human oversight.THE TERM IS OFTEN OVERHYPED“AI-native” can describe a useful architectural approach, but it is also frequently used as marketing language.The real question is whether AI materially improves the product and whether the surrounding system makes that capability reliable.WATCH THE EPISODEhttps://youtu.be/RB3cwQYBpigABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  17. 10

    Before You Add AI, Make Sure It Solves the Right Business Problem

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/right-business-problemBusinesses are being encouraged to add AI everywhere.But not every problem needs an AI solution.In Episode 9 of System Prompt, Peter and Val examine how businesses should evaluate AI opportunities through real operational needs, including inventory management, point-of-sale systems, customer-facing chatbots, and data preparation.The central principle is simple: the value created by an AI system must exceed the cost and complexity required to build, operate, and maintain it.The conversation also explores why successful implementation requires trust, empathy, clean data, and a clear understanding of the people affected by the system.WHAT WE DISCUSS• Why businesses should start with the problem• When existing software may work better than AI• Point-of-sale systems compared with AI-driven inventory tools• How tailored AI solutions can support specific workflows• The risks of customer-facing chatbots• Why chatbot quality affects trust• The importance of empathy during implementation• How poor data limits AI performance• How to compare implementation cost with business valueKEY TAKEAWAYSSTART WITH THE BUSINESS PROBLEMThe first questions should focus on the workflow, current pain, affected users, expected outcome, and cost of the existing problem.Only then can a business decide whether AI is the right solution.AI MUST CREATE MORE VALUE THAN IT COSTSThe cost of an AI system includes development, integration, data preparation, testing, training, monitoring, maintenance, and human oversight.An impressive system is still a poor investment when it costs more than the problem it solves.EXISTING SOFTWARE MAY ALREADY BE ENOUGHInventory and point-of-sale platforms already solve many common business problems.AI is useful only when it improves forecasting, identifies patterns, reduces manual work, or supports decisions the existing system cannot handle well.CUSTOMER-FACING AI REQUIRES TRUSTA chatbot represents the business directly to customers.Poor answers, weak escalation, or missing context can damage trust quickly.Customer-facing AI needs clear limits, accurate information, and a reliable path to a human.CLEAN DATA COMES FIRSTAI cannot reliably compensate for incomplete, duplicated, outdated, or inconsistent business data.Data cleaning and organization are foundational implementation steps.CHAPTERS00:00 — Leveraging AI in Business06:46 — Point-of-Sale Systems vs. AI13:36 — Tailored AI Solutions19:18 — Customer-Facing Chatbots30:20 — Data Cleaning for AI ImplementationWATCH THE EPISODEhttps://youtu.be/iJdHI470QuAABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  18. 9

    Everyone Says “Just Use RAG.” Here’s Why That’s Not Enough

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/rag-not-enoughRetrieval-Augmented Generation is often treated as the default answer whenever an AI system needs access to business data.But adding a vector database does not automatically create a reliable system.In Episode 8 of System Prompt, Peter and Val examine what actually goes into useful RAG pipelines: prompting, keyword search, data quality, canonicalization, storage, retrieval, cost, testing, and human review.The episode also explores where fine-tuning fits, why it solves a different problem from RAG, and why AI systems should be developed iteratively rather than treated as one-time implementations.WHAT WE DISCUSS• Why prompting still affects model performance• The difference between keyword and semantic search• What RAG actually does• Why RAG does not guarantee accurate answers• How data quality affects retrieval quality• Canonicalization and normalization• Reducing unnecessary embeddings and storage costs• Using MariaDB for vector and operational data• The role of human evaluation• What fine-tuning changesKEY TAKEAWAYSPROMPTING STILL MATTERSRetrieval gives the model information, but the model still needs clear instructions about how to use it, handle uncertainty, and format the result.KEYWORD SEARCH IS STILL USEFULVector search can find semantically similar information, but keyword search may work better for exact names, identifiers, error codes, and uncommon terms.Many systems benefit from combining both approaches.RAG DEPENDS ON THE DATA PIPELINEDuplicate, outdated, inconsistent, or poorly structured records create noisy retrieval and unnecessary cost.Data preparation is part of the AI system, not a separate cleanup task.CANONICALIZATION REDUCES WASTECanonicalization and normalization can combine records representing the same event or concept.In the example discussed, this reduced embedded logs by roughly 70 percent, lowering storage and repeated context.FINE-TUNING SOLVES A DIFFERENT PROBLEMRAG gives a model access to external information.Fine-tuning changes how the model behaves or produces outputs.It works best when the desired behavior, style, or format is clearly defined and supported by strong examples.AI DEVELOPMENT IS ITERATIVEUseful AI systems require testing, failure review, prompt refinement, retrieval changes, and ongoing evaluation.The first working version is only the beginning.CHAPTERS00:00 — Introduction to Prompt Engineering07:15 — Using Keyword Search13:00 — Introduction to RAG24:59 — Data Storage and Canonicalization33:10 — Understanding Fine-Tuning40:18 — Iterative AI Development49:54 — Edge Technologies and the Future of AIWATCH THE EPISODEhttps://youtu.be/9Z9rD6ZehoAABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  19. 8

    Are AI Models Getting Worse, or Are the Economics Catching Up?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/model-economicsAI models continue to improve on benchmarks, yet many users still feel that the products are becoming less reliable.In Episode 7 of System Prompt, Peter and Val examine whether model quality is actually declining, how API costs shape product decisions, and what growing competition means for businesses building on top of frontier providers.The conversation explores the pressures facing companies such as OpenAI and Anthropic as they balance model performance, infrastructure costs, subscription limits, reliability, and market growth.For enterprise users, the issue is larger than which model ranks highest. Businesses need to understand the cost of each completed task, the risk of depending on one provider, and what happens when pricing, rate limits, model behavior, or product access changes.WHAT WE DISCUSS• Why users may feel model quality is declining• The difference between benchmark performance and real-world reliability• How inference and API costs affect AI products• Why providers optimize for speed, cost, and capacity• The challenges facing frontier AI companies• The risks of building around one model provider• Why competition does not always create stable pricing• What market pressure means for enterprise adoptionKEY TAKEAWAYSMODEL QUALITY IS NOT ONLY A BENCHMARK SCOREA model may improve on published evaluations while becoming less useful for a specific workflow.Changes in reasoning behavior, response style, context handling, latency, and tool use can all affect the user experience.AI ECONOMICS SHAPE MODEL BEHAVIORFrontier models are expensive to train and operate.Providers must balance capability against inference cost, response speed, capacity, and pricing.API PRICE IS NOT THE FULL COSTBusinesses should evaluate the total cost of completing a task, including retries, failures, human review, tool calls, latency, and integration overhead.A cheaper model is not efficient when it requires more work to reach an acceptable result.PROVIDER DEPENDENCE CREATES RISKPricing, rate limits, model access, and behavior can change.Routing, evaluation, fallback options, and model abstraction reduce that dependency.ENTERPRISES NEED FLEXIBILITYThe strongest model is not always the right model for every task.Businesses can route work based on complexity, sensitivity, cost, latency, and reliability.WATCH THE EPISODEhttps://youtu.be/wUgVBCphkGIABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  20. 7

    AI Ethics Is Not Just About the Model, It Is About How We Use It

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-ethicsAI ethics is often discussed as if it begins and ends with the model.In practice, many of the most important ethical decisions happen during implementation.In Episode 6 of System Prompt, Peter and Val examine how artificial intelligence is introduced into workplaces, schools, and decision-making processes—and what responsible use should look like.AI can improve productivity, reduce repetitive work, and help people access information more quickly. It can also weaken critical thinking, reinforce poor decisions, or create unnecessary risk when organizations deploy it without clear boundaries.The conversation explores AI literacy, workplace training, education, human oversight, and the difference between using AI to support a decision and allowing it to make the decision itself.WHAT WE DISCUSS• What responsible AI implementation looks like• Why AI ethics extends beyond model behavior• How AI affects workplace productivity• How automation may reshape jobs• The role of humans in AI-supported decisions• The effect of AI on critical thinking• How schools should respond to generative AI• Why employees need clear training and usage policiesKEY TAKEAWAYSETHICS BEGINS WITH IMPLEMENTATIONOrganizations must decide what data an AI system can access, which tasks it may perform, how outputs are reviewed, and who remains responsible for the result.AI SHOULD SUPPORT DECISIONS, NOT OWN THEMAI can summarize information, identify patterns, and generate options.It should not become the final authority for decisions involving employment, education, finances, safety, or other meaningful outcomes.CRITICAL THINKING STILL MATTERSAI can produce convincing answers that are incomplete or incorrect.Users need enough knowledge to question outputs, verify important claims, and recognize when the system is operating outside its limits.EDUCATION MUST ADAPTBanning AI does not prepare students or employees to use it responsibly.AI literacy should include verification, data protection, appropriate use, and an understanding of when independent judgment is necessary.TRAINING IS PART OF RESPONSIBLE ADOPTIONOrganizations need approved tools, practical examples, data-handling rules, and training tailored to actual job responsibilities.Responsible adoption requires more than purchasing licenses and making tools available.WATCH THE EPISODEhttps://youtu.be/jli-jCf_QeEABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  21. 6

    Physical AI Is Coming, but It Still Struggles Outside Controlled Environments

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/physical-aiPhysical AI brings artificial intelligence out of software and into machines that can see, move, and act in the real world.That creates enormous potential, but it also introduces a harder problem: the physical world is unpredictable.In Episode 5 of System Prompt, Peter and Val examine how physical AI works, where it is useful today, and why controlled environments remain so important.Robots and autonomous systems perform best when the environment, objects, and expected actions are tightly defined. The challenge grows when they encounter unfamiliar spaces, changing conditions, unexpected behavior, or situations not represented in training.The conversation also explores computer vision, human-robot interaction, ethics, implementation costs, and the future of physical AI.WHAT WE DISCUSS• What physical AI is• Why controlled environments are easier for robots• How vision, sensors, models, and movement work together• Why unfamiliar scenarios remain difficult• The role of computer vision• Human trust and interaction with robots• Ethical and safety concerns• The cost of deployment and maintenanceKEY TAKEAWAYSPHYSICAL AI WORKS BEST IN CONTROLLED ENVIRONMENTSFactories, warehouses, laboratories, and other structured spaces reduce the number of unexpected situations a system must handle.That makes physical AI easier to train, test, and operate safely.NOVEL SCENARIOS ARE THE REAL CHALLENGEA robot may perform the same task successfully thousands of times and still fail when something unusual happens.Lighting changes, objects move, people behave unpredictably, and environments may contain situations the system has never seen.VISION IS CENTRAL TO PHYSICAL AICameras and sensors help systems identify objects, estimate distance, track movement, and understand where they can safely operate.Vision systems can still struggle with poor lighting, blocked views, and unfamiliar objects.HUMAN-ROBOT INTERACTION CREATES NEW RISKSPeople may assume a robot understands more than it actually does.Clear boundaries are necessary so users understand what the system can do, where it may fail, and when human judgment is still required.PHYSICAL AI IS EXPENSIVEThe cost extends beyond the model.Organizations must account for hardware, sensors, testing, maintenance, repairs, energy, safety systems, and human oversight.CHAPTERS00:00 — The Rise of Physical AI05:39 — Under the Hood: How Physical AI Works10:55 — The Role of Vision in AI20:19 — The Future of Physical AI26:06 — The Cost of Physical AIWATCH THE EPISODEhttps://youtu.be/HcKsSDHNrB8ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  22. 5

    AGENTIC CODING IS NOT A TOOL UPGRADE, IT CHANGES THE DEVELOPMENT WORKFLOW

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/agentic-codingAgentic coding changes more than how quickly developers write code.It changes how software is planned, delegated, reviewed, tested, and maintained.In Episode 4 of System Prompt, Peter and Val examine the shift from using AI as a coding assistant to using coding agents as active participants in the development workflow.A coding assistant may suggest a function or complete a line of code. A coding agent can inspect a repository, create a plan, modify multiple files, run tests, identify failures, and continue working toward a defined outcome.That makes agentic coding less like autocomplete and more like a workflow change.WHAT WE DISCUSS• The difference between AI-assisted and agentic coding• Why coding agents change the development workflow• How planning affects agent-generated software• Why vague instructions create weak implementations• How the role of the developer is changing• Why architecture, testing, and review still matter• The risks of giving agents unclear boundaries• How easier software creation affects user experienceKEY TAKEAWAYSAGENTIC CODING CHANGES THE UNIT OF WORKDevelopers are moving from writing every implementation detail toward defining tasks, constraints, expected behavior, and completed outcomes.PLANNING BECOMES MORE IMPORTANTCoding agents can produce large amounts of work quickly, but speed does not guarantee correctness.A weak plan allows an agent to move quickly in the wrong direction.DEVELOPERS STILL NEED TO UNDERSTAND THE SYSTEMAI does not remove the need to evaluate architecture, security, performance, dependencies, maintainability, and failure conditions.The agent may produce the code, but responsibility for the system remains with the people building it.THE DEVELOPER ROLE IS EXPANDINGDevelopers may spend more time defining requirements, breaking work into tasks, reviewing changes, testing behavior, and managing system boundaries.The valuable skill becomes directing the workflow and recognizing when the result is wrong.USER EXPERIENCE STILL MATTERSAs software becomes easier to generate, a working application is not enough.Products still compete on usability, reliability, trust, integration, support, and how well they solve a real problem.WATCH THE EPISODEhttps://youtu.be/5uJbd0e1ip8ABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  23. 4

    Are AI Agents Really Taking Jobs, or Changing the Work?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/ai-agents-jobsAre AI agents replacing entire jobs, or changing the tasks and responsibilities inside them?In Episode 3 of System Prompt, Peter and Val examine how AI is affecting employment, software engineering, junior positions, small agencies, translation services, and the broader structure of work.Most jobs contain many different responsibilities. AI may automate some tasks, accelerate others, and increase the value of workers who can supervise systems, validate outputs, handle exceptions, and remain accountable for results.The discussion also looks at the cost of AI implementation. Automating part of a job still requires infrastructure, integration, maintenance, oversight, and capital.WHAT WE DISCUSS• Whether AI replaces jobs or individual tasks• How AI is changing software engineering• Why junior roles may face greater pressure• The relationship between investment and job stability• Opportunities for small agencies and independent businesses• AI’s impact on translation and language services• How ServiceNow reflects the evolution of IT work• The costs and benefits of workplace automationKEY TAKEAWAYSAI AFFECTS TASKS BEFORE ENTIRE JOBSAI may remove or accelerate specific responsibilities without eliminating the full role.The result could be fewer people completing the same amount of work, or existing employees taking on broader responsibilities.JUNIOR ROLES MAY FACE MORE PRESSUREEntry-level jobs often include repeatable tasks that help workers gain experience.If those tasks are automated, businesses may create fewer junior opportunities while still needing experienced workers later.ROLES WILL BE REDEFINEDWorkers may spend less time producing routine output and more time reviewing results, handling exceptions, communicating with customers, and taking responsibility for outcomes.The valuable skill is not simply using AI. It is understanding where AI fits and where its boundaries should be.AI IMPLEMENTATION HAS REAL COSTSOrganizations must account for software, infrastructure, integration, security, monitoring, maintenance, training, and human oversight.Automation only makes business sense when the value of the completed work justifies the total cost.CHAPTERS00:00 — ServiceNow and the Evolution of IT31:59 — The Future of AI and Job Displacement39:25 — Costs and Benefits of AI Implementation45:21 — Societal and Economic ImplicationsWATCH THE EPISODEhttps://youtu.be/eRaKEh0LsXAABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  24. 3

    LOCAL VS. FRONTIER AI MODELS: WHAT SHOULD BUSINESSES ACTUALLY USE?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/local-vs-frontier-modelsBusinesses evaluating AI are often pushed toward a false choice: use a frontier model or run everything locally.In Episode 2 of System Prompt, Peter and Val compare local and frontier AI models through the realities of privacy, cost, security, infrastructure, ownership, and performance.Frontier models offer strong general capabilities without requiring businesses to operate specialized hardware. Local models provide more control over data and infrastructure, but that control also creates responsibility for deployment, maintenance, security, monitoring, and availability.The episode also explores why model choice is only part of the system. Prompts, retrieval, tools, routing, data quality, and orchestration can have a major effect on results.WHAT WE DISCUSS• Local models compared with frontier models• Security, privacy, and ownership• Infrastructure and operating costs• When local deployment makes sense• When frontier APIs are more efficient• Why orchestration affects model performance• How compliance requirements influence model selectionKEY TAKEAWAYSLOCAL AND FRONTIER MODELS SOLVE DIFFERENT PROBLEMSFrontier models reduce infrastructure burden and provide strong general performance.Local models provide greater control over data, deployment, and customization.The right choice depends on the task, budget, privacy requirements, risk, and technical environment.CURATION SHAPES PERFORMANCEA model does not operate alone.Its results are influenced by prompts, context, retrieval, tools, data quality, configuration, and routing.A smaller model inside a strong pipeline may outperform a larger general model on a narrow task.LOCAL AI CREATES RESPONSIBILITYRunning models locally means managing hardware, updates, security, monitoring, capacity, and failures.Local deployment is not automatically cheaper or safer simply because the model runs internally.ORCHESTRATION MATTERSBusinesses do not need to use one model for every task.Work can be routed between local models, frontier APIs, tools, and deterministic software based on cost, sensitivity, speed, and complexity.CHAPTERS00:00 — Local vs. Frontier LLM Models08:38 — The Future of Local Models17:00 — Security and Ownership23:03 — Business Decision: Frontier or Local?32:03 — Orchestration and Pipeline Curation42:38 — Privacy and CostWATCH THE EPISODEhttps://youtu.be/7TiU8To37AIABOUT SYSTEM PROMPTSystem Prompt covers AI infrastructure, automation, agents, local models, enterprise platforms, and practical implementation.

  25. 2

    Will AI Agents Replace SaaS, or Change Who Builds Software?

    READ THE FULL EPISODE PAGEhttps://devmesh.tech/podcast/saas-vs-ai-agentsAI agents may change more than how businesses use software. They may also change where software gets built, who owns it, and what companies are still willing to buy from traditional SaaS vendors.In Episode 1 of System Prompt, Peter and Val examine the changing relationship between artificial intelligence, Software as a Service, and internally built business tools.AI makes it easier to generate applications, automate workflows, and connect systems. That gives businesses more opportunities to build capabilities internally instead of buying another standalone platform.But generating an application is not the same as operating one.Internal tools still require ownership, maintenance, security, infrastructure, support, and clear responsibility when something breaks.WHAT WE DISCUSS• Whether AI agents will replace SaaS products or become part of them• How value may shift from software interfaces to completed outcomes• Why generating an internal application is easier than maintaining one• Who owns an AI-generated tool after it enters production• The operational costs hidden behind internal development• How AI may change developers and product teams• Why businesses still need a clear problem before implementing AIKEY TAKEAWAYSAI IS CHANGING WHERE SOFTWARE VALUE LIVESTraditional SaaS products package workflows, interfaces, infrastructure, and support into a subscription.AI agents may perform parts of those workflows without requiring users to navigate the original software interface.That does not necessarily eliminate SaaS. It may force SaaS companies to reconsider whether their value comes from the interface, data, workflow, infrastructure, or completed business outcome.BUILDING SOFTWARE IS BECOMING EASIERAI-assisted development lowers the barrier to creating internal tools, automations, and small applications.However, easier development does not eliminate the responsibilities that come after deployment.INTERNAL TOOLS STILL REQUIRE OWNERSHIPEvery production system needs someone responsible for access control, updates, integrations, monitoring, security, and failures.A business may generate an application quickly, but it still needs to decide who owns it and what happens when the original builder is no longer available.AI ADOPTION IS AN OPERATIONAL DECISIONAdding AI affects business processes, employee responsibilities, infrastructure, governance, and customer expectations.Successful adoption requires more than choosing a model. Organizations must understand the problem being solved and the boundaries within which the system should operate.CHAPTERS00:00 — AI vs. Software as a Service06:22 — Ownership and Responsibility11:55 — AI Implementation and Adoption19:29 — The Future of Software as a Service32:43 — Building Internal Tools and InfrastructureWATCH THE EPISODEhttps://youtu.be/0Z5YLB2OSooABOUT SYSTEM PROMPTSystem Prompt is a podcast about AI infrastructure, automation, agents, local models, enterprise platforms, implementation strategy, and deploying AI responsibly.

Type above to search every episode's transcript for a word or phrase. Matches are scoped to this podcast.

Searching…

We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.

No matches for "" in this podcast's transcripts.

Showing of matches

No topics indexed yet for this podcast.

Loading reviews...

ABOUT THIS SHOW

System Prompt is a podcast about what’s actually happening in AI.Not hype. Not surface-level takes.We break down how AI is changing software, SaaS, infrastructure, and the way systems are built focusing on real-world tradeoffs, architecture decisions, and where the value is actually shifting.If you’re building, deploying, or thinking seriously about AI, this is for you.

HOSTED BY

Peter

CATEGORIES

Frequently Asked Questions

How many episodes does System Prompt have?

System Prompt currently has 25 episodes available on PodParley. New episodes are automatically indexed when they're published to the podcast feed.

What is System Prompt about?

System Prompt is a podcast about what’s actually happening in AI.Not hype. Not surface-level takes.We break down how AI is changing software, SaaS, infrastructure, and the way systems are built focusing on real-world tradeoffs, architecture decisions, and where the value is actually shifting.If...

How often does System Prompt release new episodes?

System Prompt has 25 episodes. Check the episode list to see recent publication dates and frequency.

Where can I listen to System Prompt?

You can listen to System Prompt on PodParley by clicking any episode. We provide an embedded audio player for direct listening, and you can also subscribe via your preferred podcast app using the RSS feed.

Who hosts System Prompt?

System Prompt is created and hosted by Peter.
URL copied to clipboard!