Unleashing the Power of GenAI with Edge Ecosystem Analytics and Kubernetes Orchestration (osc24)

The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** about this event: https://c3voc.de