Skip to content
Enterprise LLM Integration: Bridging Java and AI in Business Applications episode artwork

Mar 30, 2025 1 hr 5 min

Enterprise LLM Integration: Bridging Java and AI in Business Applications

from airhacks.fm podcast with adam bien Hosted by adam-bien.com

An airhacks.fm conversation with Burr Sutter (@burrsutter) about: discussion about integrating LLMs into enterprise Java applications, challenges with non-deterministic LLM outputs in deterministic code environments, limitations of chat interfaces for power users in enterprise settings, preference for form-based applications with prompts running behind the scenes, using LLMs to understand unstructured data while providing structured interfaces, maintaining existing CRUD systems while using LLMs for unstructured data like emails and support tickets, practical examples of using LLMs to generate code from business requirements, creating assistants with system messages and short user prompts, potential for embeddings to replace text prompts in the future, developer journey in learning LLM integration including prompts, tools, RAG, and agentic workflows, benefits of specialized agents over one general agent, using LLMs for code generation with limitations for complex use cases, hybrid approaches combining LLMs with human oversight, using LLMs for email routing and support case classification, potential for extracting knowledge from enterprise data sources like Confluence and SharePoint, quality assurance with LLM judges, discussion of small language models versus large ones, model distillation and fine-tuning for specific enterprise use cases, cost considerations for model training versus using off-the-shelf models with better tool invocation, prediction that models will become more efficient and run on commodity hardware in the future, focus on post-training inference and reliable results Burr Sutter on twitter: @burrsutter

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Enterprise LLM Integration: Bridging Java and AI in Business Applications

0:00 1:05:08

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of airhacks.fm podcast with adam bien?

This episode is 1 hour and 5 minutes long.

When was this airhacks.fm podcast with adam bien episode published?

This episode was published on March 30, 2025.

Can I download this airhacks.fm podcast with adam bien episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.