Skip to content
TornadoVM: The Need for GPU Speed episode artwork

Jul 6, 2025 59 min

TornadoVM: The Need for GPU Speed

from airhacks.fm podcast with adam bien Hosted by adam-bien.com

An airhacks.fm conversation with Michalis Papadimitriou (@mikepapadim) about: starting with Java 8, first computer experiences with Pentium 2, doom 2 and Microsoft Paint, university introduction to Object-oriented programming using Objects First and bluej IDE, Monte Carlo simulations for financial portfolio optimization in Java, porting Java applications to OpenCL for GPU acceleration achieving 20x speedup, working at Huawei on GPU hardware, writing unit tests as introduction to TornadoVM, working on FPGA integration and Graal compiler optimizations, experience at OctoAI startup doing AI compiler optimizations for TensorFlow and PyTorch models, understanding model formats evolution from ONNX to GGUF, standardization of LLM inference through Llama models, implementing GPU-accelerated Llama 3 inference in pure Java using TornadoVM, achieving 3-6x speedup over CPU implementations, supporting multiple models including Mistral and working on qwen 3 and deepseek, differences between models mainly in normalization layers, GGUF becoming quasi-standard for LLM model distribution, TornadoVM's Consume and Persist API for optimizing GPU data transfers, challenges with OpenCL deprecation on macOS and plans for Metal backend, importance of developer experience and avoiding python dependencies for Java projects, runtime and compiler optimizations for GPU inference, kernel fusion techniques, upcoming integration with langchain4j, potential of Java ecosystem with Graal VM and Project Panama FFM for high-performance inference, advantages of Java's multi-threading capabilities for inference workloads Michalis Papadimitriou on twitter: @mikepapadim

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

TornadoVM: The Need for GPU Speed

0:00 59:41

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of airhacks.fm podcast with adam bien?

This episode is 59 minutes long.

When was this airhacks.fm podcast with adam bien episode published?

This episode was published on July 6, 2025.

Can I download this airhacks.fm podcast with adam bien episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.