Generative AI, Tech Innovations, & Evolving Perspectives with Randall Hunt

In this episode, we chat with Randall Hunt, the VP of Technology at Caylent, about the world of generative AI and how it's changing industries. Randall talks about his journey from being an AWS critic to leading tech projects at Caylent. He shares cool insights into the latest tech innovations, the challenges and opportunities in AI, and his vision for the future. Randall also explains how AI is used in healthcare, finance, and more, and gives advice for those interested in tech. Show Highlights: (00:00) - Introduction (00:28) - Randall talks about his job at Caylent and the projects he's working on (01:35) - Randall explains his honest and evolving perspective on Amazon Bedrock after working with it hands-on (03:35) - Randall breaks down the components and improvements of AWS Bedrock (06:08) - Improvements in AWS Bedrock's preview announcements and API functionality (08:05) - Randall's predictions on the future of generative AI models and their cost efficiency (10:00) - Randall shares practical use cases using distilled models and older GPUs (12:12) - Corey shares his experience with GPT-4 and the importance of prompt engineering (17:21) - Bedrock console features for comparing and contrasting AI models (21:02) - enterprise applications of generative AI and building reliable AI infrastructures (28:13) - Randall and Corey delve into the costs of training large AI models (36:37) - Randall talks about real-world applications of Bedrock in industries like HVAC management (39:40) - Closing thoughts and where to connect with Randall About Randall Hunt: Randall Hunt is a Software Engineer and Open Source Developer Advocate at Facebook. Previously of AWS, SpaceX, MongoDB, and NASA., Randall Hunt, VP of Cloud Strategy and Solutions at Caylent, is a technology leader, investor, and hands-on-keyboard coder based in Los Angeles, CA. Previously, Randall led software and developer relations teams at Facebook, SpaceX, AWS, MongoDB, and NASA. Randall spends most of his time listening to customers, building demos, writing blog posts, and mentoring junior engineers. Python and C++ are his favorite programming languages, but he begrudgingly admits that Javascript rules the world. Outside of work, Randall loves to read science fiction, advise startups, travel, and ski., Randall is the coder in the boardroom. Links referenced: Randall Hunt on LinkedIn: https://www.linkedin.com/in/ranman/ Caylent: https://caylent.com/ Caylent on Linkedin: https://www.linkedin.com/company/caylent/ * Sponsor Prowler: https://prowler.com