EPISODE · Aug 14, 2026 · 2 MIN
“Features that current AIs don’t have that future AIs will have” by Alexander Gietelink Oldenziel
Features that current AIs don't have that future AIs will have: Continual Learning [& long-term memory] Every second humans update their brain weights. The brain autonomously decides what to update on. Humans can also consciously decide to curate their data sets - eg by deciding to go to college. Current LLMs do not continually update their weights. Instead, they occasionally get a large update based on datasets curated by a team of humans. This is alleviated somewhat by the ability of AIs to do in-context learning but nevertheless it seems to be a major limitation. Note that this is an especially large limitation in domains with sparse data. In domains where all of humanity has an enormous amount of data eg math, programming, physics, anime trivia, trials and tribulations of English kings - AIs dominate. In areas where there is little data: the weird idiosyncracies of a particular job, boss, people, colleagues etc it can struggle. Note that this restrictions also interferes with AIs from effectively 'learning to learn' & caps its long-term memory. Neuralese Current AI's CoT is (mostly) English. But it plausible this is not the most efficient way to structure thoughts. Instead of english [...] ---Outline:(00:16) Continual Learning \[& long-term memory\](01:24) Neuralese(01:41) Telepathy(02:01) ClaudeGlobal --- First published: August 13th, 2026 Source: https://www.lesswrong.com/posts/NyEM3FtgL7XkbfCXy/features-that-current-ais-don-t-have-that-future-ais-will --- Narrated by TYPE III AUDIO.
Embed this episode
NOW PLAYING
“Features that current AIs don’t have that future AIs will have” by Alexander Gietelink Oldenziel
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.