Installing Open-WebUI and exploring local LLMs on CF: Cloud Foundry Weekly: Episode 46
from Cloud Foundry Weekly Hosted by Nick Kuhn, Nicky Pike, Darin Zook, and Keith Lee
We are kicking off our "How-To" mini-series with this episode! We will show a deep dive on deploying the popular open-webui application on Cloud Foundry! Open-WebUI is a great tool to explore and experiment with GenAI on your locally deployed LLMs running on the GenAI for Tanzu Platform tile. We will also deep dive into different model variants and inference engines such as Ollama and vLLM. Open-WebUI: https://openwebui.com/ GenAI for tPCF Samples: https://github.com/nkuhn-vmw/GenAI-for-TPCF-Samples Cloud Foundry Podcast: https://cloudfoundryweekly.com/episodes Cloud Foundry Weekly LinkedIn: https://www.linkedin.com/in/cloud-foundry-weekly Cloud Foundry Weekly X: https://x.com/cf_weekly Nick Kuhn LinkedIn: https://www.linkedin.com/in/nick-kuhn-aa72a39/ Nick Kuhn X: https://x.com/tehkuhnz Nick Kuhn Blog: https://tehkuhnz.io/ Nicky Pike LinkedIn: https://www.linkedin.com/in/nicky-pike/ Nicky Pike X: https://x.com/bearded_bytes Nicky Pike Blog: https://nickypike.dev
Embed this episode
No transcript yet.