EPISODE · Jun 27, 2025 · 36 MIN
AI Development, Streaming, and Scaling with AWS Lambda
from Code and Cognition · host Olio Apps
Olio Apps can help you build your app: https://www.olioapps.com/contact-usHey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.--Show Notes:(0:00) Intro(0:35) Welcome(0:52) Zach’s Background(2:22) Working with LLMs vs ML Models(6:02) Applying AI to Backrs - Hyper Personalization(9:01) From prototype to scale(12:57) Streaming with Lambda(17:34) Python streaming lambda wrapper(22:17) Journey to get to 100 concurrent users - db connections - database pool via proxy(25:21) Lifting LLM provider quota limits(27:29) Lambda rate limits(31:17) Backrs UI(33:49) Backrs Streaming Example(36:11) Conclusion
What this episode covers
Olio Apps can help you build your app: https://www.olioapps.com/contact-usHey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.--Show Notes:(0:00) Intro(0:35) Welcome(0:52) Zach’s Background(2:22) Working with LLMs vs ML Models(6:02) Applying AI to Backrs - Hyper Personalization(9:01) From prototype to scale(12:57) Streaming with Lambda(17:34) Python streaming lambda wrapper(22:17) Journey to get to 100 concurrent users - db connections - database pool via proxy(25:21) Lifting LLM provider quota limits(27:29) Lambda rate limits(31:17) Backrs UI(33:49) Backrs Streaming Example(36:11) Conclusion
NOW PLAYING
AI Development, Streaming, and Scaling with AWS Lambda
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m