PODCAST · technology
KnowledgeDB.ai
by KnowledgeDB
KnowledgeDB.ai is your go-to podcast for diving deep into the infrastructure that powers Generative AI. Each episode explores groundbreaking papers, insightful publications, and emerging technologies shaping the future of AI systems. From distributed computing and graph databases to hardware accelerators and model optimization, we decode the research behind the tech.Whether you're a developer, researcher, or just curious about the mechanics behind GenAI, KnowledgeDB.ai provides a blend of technical depth and practical insights to keep you informed and inspired. Tune in and stay ahead of the
Episodes
-
Active Graph: Event-Sourced Runtime for Agentic Systems
ActiveGraph is an event-sourced reactive graph runtime designed to build long-running, auditable AI agents. Unlike traditional frameworks that focus on the model call, this system treats an immutable event log as the primary source of truth, where the working state is a deterministic projection…
more -
The Graph Engineering Guide 2026
These sources trace the technological shift from basic prompting toward sophisticated graph engineering for managing complex AI agent systems. The first two guides establish a hierarchy of development, moving from single-agent loops—where one model repeats a cycle of planning and acting—to...
-
The Context Tax: Rethinking Database Awareness
Ref: https://inferal.com/blog/databases-dont-know-why/ The provided text explores a fundamental limitation in modern database architecture, specifically how these systems operate in isolation without understanding the purpose of a query. Because traditional databases lack contextual awareness…
more -
Benchmarking and Techniques for LLM Text-to-SQL Systems
These sources provide an extensive overview of Large Language Model (LLM)-based Text-to-SQL (NL2SQL) systems, focusing on techniques like prompt engineering, supervised fine-tuning (SFT), and Retrieval-Augmented Generation (RAG) to enhance performance. Researchers evaluate models using benchmark...
-
Beyond RAG: Giving AI Agents Persistent Memory with Open Source Tools
Mem0, Graphiti, Cognee, and LangMem are open-source libraries that provide persistent memory for AI agents. Mem0 uses a hybrid database to optimize personalization and reduce token costs. Graphiti creates temporal knowledge graphs for dynamic data, while Cognee builds multi-modal graphs and uses...
-
Large Language Models for Text-to-SQL: Challenges, Advancements, and Evaluation
Text-to-SQL, translating natural language to SQL, has seen significant advancements due to Large Language Models (LLMs). However, challenges remain in handling complex database schemas, diverse SQL operations beyond simple queries, and natural language ambiguity. To address this, new approaches...
-
LLM Agent Memory Systems: MemGPT, Zep, MEM1 and more...
This briefing document synthesizes information from several recent academic papers and a commercial announcement, highlighting cutting-edge developments in enhancing Large Language Models (LLMs) with robust memory and retrieval capabilities. Key themes include the use of hierarchical memory…
more -
MEM1: Synergizing Memory and Reasoning for Agents
https://arxiv.org/abs/2506.15841 The research introduces MEM1, a novel reinforcement learning framework designed to enhance language agents' efficiency and performance in complex, multi-turn interactions. Unlike traditional models that accumulate information, MEM1 uses a constant-memory approach…
more -
Zep: Temporal Knowledge Graphs for AI Agent Memory
https://arxiv.org/abs/2501.13956 The research introduces Zep, a novel memory service for AI agents, designed to overcome the limitations of current retrieval-augmented generation (RAG) frameworks, which struggle with dynamic and continuously evolving data. Zep utilizes Graphiti, a…
more -
The Illusion of Thinking in Large Reasoning Models
https://machinelearning.apple.com/research/illusion-of-thinking The document investigates the capabilities and limitations of Large Reasoning Models (LRMs), a new generation of language models designed for complex problem-solving. It critiques current evaluation methods, which often rely on...
-
ROGRAG: A Robust GraphRAG Framework
Ref: https://arxiv.org/html/2503.06474v2 The document introduces ROGRAG, a novel GraphRAG framework designed to improve large language models' (LLMs) performance on specialized and emerging topics. It addresses the limitations of traditional RAG methods by structuring domain knowledge as a graph...
-
The Unprecedented Pace of AI Transformation
The provided sources offer a comprehensive overview of the rapid and transformative evolution of Artificial Intelligence. They highlight that AI user adoption, usage, and capital expenditures are experiencing unprecedented growth, driven by declining inference costs and a surge in accessible AI...
-
Common Sense is All AI Needs
https://arxiv.org/abs/2501.06642 This manuscript argues that achieving true artificial intelligence (AI) autonomy requires integrating **common sense**, a fundamental ability observed in all animals, which current systems often lack. The text critiques existing benchmarks like the Turing Test and...
-
Universal RAG for Diverse Modalities and Granularities
https://arxiv.org/abs/2504.20734 These sources introduce and describe **UniversalRAG**, a novel framework designed to enhance Retrieval-Augmented Generation (RAG) by incorporating knowledge from **multiple corpora with diverse modalities and granularities**, moving beyond traditional text-only…
more -
What is the Model Context Protocol (MCP)?
Model Context Protocol (MCP) is presented as a crucial emerging specification for managing how AI models access enterprise data across multiple applications. It addresses the security and permission challenges arising from AI's ability to interact with diverse data sources by ensuring models...
-
Text2SQL: The Art of Teaching Machines to Speak Database
Ref: https://aiwithmike.substack.com/p/text2sql-the-art-of-teaching-machines Mike Erlihson's Substack post explores the complexities of Text2SQL, the process of enabling machines to translate natural language questions into SQL queries. The author highlights that this task involves more than just...
-
Wiz Security GraphDB vs. DeepTempo LogLM: Cloud Defense
https://securityboulevard.com/2025/04/wizs-security-graphdb-vs-deeptempos-loglm/ This Security Boulevard article from April 2025 contrasts Wiz's Security GraphDB, a system that identifies known cloud security risks by mapping resources and their relationships, with DeepTempo's LogLM, which uses...
-
An Algebraic Foundation for Knowledge Graph Construction
https://arxiv.org/abs/2503.10385 The provided document introduces a language-agnostic algebraic foundation for constructing knowledge graphs from diverse data sources. This formal system aims to address the current lack of a solid theoretical basis for declarative mapping languages like RML…
more -
G-Retriever: Graph Understanding and Question Answering via Retrieval
https://arxiv.org/abs/2402.07630 The paper "G-Retriever" introduces a new method for question answering on textual graphs. It addresses the challenge of enabling users to interact with graphs through a conversational interface. The core innovation is a retrieval-augmented generation (RAG)…
more -
LLM Post-Training: Reinforcement Learning, Scaling, and Fine-Tuning
Ref: https://arxiv.org/abs/2502.21321 This document provides a comprehensive survey of post-training methodologies for Large Language Models (LLMs), focusing on refining reasoning capabilities and aligning models with user preferences and ethical standards. It categorizes these methodologies into...
-
State of Play on LLM and RAG: Preparing your Knowledge Organization for Generative AI
https://graphwise.ai/resources/white-paper/knowledge-organization-llm-rag/ This Unisphere Research report, sponsored by Semantic Web Company, examines the current state of Large Language Model (LLM) and Retrieval-Augmented Generation (RAG) adoption among 382 knowledge management executives. The...
-
LEGO-GraphRAG: Modularizing Graph-based RAG for Design Space Exploration
https://arxiv.org/abs/2411.05844 This research paper introduces LEGO-GraphRAG, a modular framework for improving Retrieval-Augmented Generation (RAG) systems that use knowledge graphs. The framework systematically categorizes existing RAG techniques and facilitates the creation of new, more...
-
Knowledge Graphs for Trustworthy LLM Question Answering
https://www.sciencedirect.com/science/article/pii/S1570826824000441 This pre-print research paper investigates the use of knowledge graphs to improve the accuracy and trustworthiness of Large Language Model (LLM)-powered question answering systems in enterprise settings. The authors argue that...
-
Large Language Models, Knowledge Graphs and Search Engines: A Crossroads for Answering Users' Questions
https://arxiv.org/abs/2501.06699 This research paper examines the interplay between large language models (LLMs), knowledge graphs (KGs), and search engines (SEs) in fulfilling user information needs. The authors analyze the strengths and weaknesses of each technology across various dimensions,...
-
Seven Failure Points in Retrieval Augmented Generation Systems
This research paper examines the challenges of building robust Retrieval Augmented Generation (RAG) systems, which combine information retrieval with large language models. The authors identify seven common failure points in RAG system design based on three case studies from diverse domains. Key...
-
A Retrieval-Augmented Generation Based Large Language Model Benchmarked on a Novel Dataset
Modular RAG: Optimizing LLMs for Indigenous Knowledge Preservation This research paper explores a Retrieval-Augmented Generation (RAG) framework for large language models (LLMs). The study uses a novel dataset of interviews with Amazon rainforest natives and biologists to assess the impact of...
-
A Survey on Large Language Models with some Insights on their Capabilities and Limitations
https://arxiv.org/abs/2501.04040 The paper explores the foundations, capabilities, and limitations of Large Language Models (LLMs). It examines various training methodologies (unsupervised, supervised, semi-supervised), data preprocessing techniques, and model adaptation strategies like…
more -
Large Concept Models: Training, Inference, and Applications
This research paper introduces Large Concept Models (LCMs), a novel approach to language modeling that operates on sentence embeddings instead of individual tokens. LCMs aim to mimic human-like abstract reasoning by processing higher-level semantic representations, improving long-form text...
-
FLAVA: A Foundational Language And Vision Alignment Model
Ref: https://arxiv.org/abs/2112.04482 The document introduces FLAVA, a foundational vision and language model that excels in vision, language, and multimodal tasks. Unlike previous models often focusing on specific modalities or employing either contrastive or multi-modal approaches but not both,...
-
Longformer: The Long-Document Transformer
Ref: https://arxiv.org/abs/2004.05150 The paper introduces Longformer, a Transformer model designed to efficiently process long sequences. It addresses the quadratic complexity of standard self-attention by using a linear-scaling mechanism combining local windowed attention and task-motivated...
-
CLIP: Learning Transferable Visual Models From Natural Language Supervision
Ref: https://arxiv.org/abs/2103.00020 This research paper explores CLIP, a novel approach to image representation learning that leverages natural language supervision. CLIP's efficiency and effectiveness in zero-shot transfer learning are demonstrated through comparisons with existing models on...
-
Scaling Laws for Neural Language Models
Ref: https://arxiv.org/abs/2001.08361 This research paper empirically investigates scaling laws for Transformer-based language models. The authors find that performance improves predictably with increases in model size, dataset size, and training compute, following power-law relationships across...
-
Reformer: The Efficient Transformer
Ref: https://arxiv.org/abs/2001.04451 The paper introduces the Reformer, a more efficient Transformer model. It achieves this through three key improvements: replacing dot-product attention with locality-sensitive hashing for faster computation on long sequences, utilizing reversible residual...
-
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
Ref: https://arxiv.org/abs/1901.02860 The paper introduces Transformer-XL, a novel neural architecture for language modeling that overcomes the limitations of fixed-length contexts in standard Transformer models. It achieves this through a segment-level recurrence mechanism and a novel relative...
-
Language Models are Few-Shot Learners
Ref: https://arxiv.org/abs/2005.14165 This research paper introduces GPT-3, a large language model developed by OpenAI and Johns Hopkins University. The paper details GPT-3's architecture, training data, and performance across numerous natural language processing tasks, focusing on its ability to...
-
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
ref: https://arxiv.org/abs/1910.10683 This research paper introduces T5, a text-to-text transfer transformer model that achieves state-of-the-art results on various natural language processing benchmarks. The authors present a unified framework converting diverse NLP tasks into a text-to-text...
-
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Ref: https://arxiv.org/abs/1810.04805 This research paper introduces BERT, a novel language representation model using bidirectional Transformer encoders. Unlike previous unidirectional models, BERT pre-trains deep bidirectional representations by jointly conditioning on both left and right...
-
Improving language understanding with unsupervised learning
Ref: https://openai.com/index/language-unsupervised/ This research paper explores a semi-supervised approach to improving language understanding using a two-stage process. First, a large language model is pre-trained on a massive unlabeled text corpus. Second, this pre-trained model is fine-tuned...
-
At the beginning there was: "Attention Is All You Need"
Ref: https://arxiv.org/abs/1706.03762 This classic research paper introduces the Transformer, a novel neural network architecture for sequence transduction tasks like machine translation. Unlike previous models relying on recurrent or convolutional layers, the Transformer uses solely attention...
We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.
No matches for "" in this podcast's transcripts.
No topics indexed yet for this podcast.
Loading reviews...
ABOUT THIS SHOW
KnowledgeDB.ai is your go-to podcast for diving deep into the infrastructure that powers Generative AI. Each episode explores groundbreaking papers, insightful publications, and emerging technologies shaping the future of AI systems. From distributed computing and graph databases to hardware accelerators and model optimization, we decode the research behind the tech.Whether you're a developer, researcher, or just curious about the mechanics behind GenAI, KnowledgeDB.ai provides a blend of technical depth and practical insights to keep you informed and inspired. Tune in and stay ahead of the
HOSTED BY
KnowledgeDB
CATEGORIES
Loading similar podcasts...