Skip to content
Alexander Ilin: Hierarchical Imitation Learning with Vector Quantized Models episode artwork

Oct 22, 2023 51 min

Alexander Ilin: Hierarchical Imitation Learning with Vector Quantized Models

from Finnish Center for Artificial Intelligence FCAI Hosted by DASER

Abstract: The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve complex tasks effectively. However, learning the models for both low and high-level planning from demonstrations has proven challenging, especially with higher-dimensional inputs. To address this problem, we propose to use reinforcement learning to identify subgoals in expert trajectories by associating the magnitude of the rewards with the predictability of low-level actions given the state and the chosen subgoal. We build a vector-quantized generative model for the identified subgoals to perform subgoal-level planning. In experiments, the algorithm excels at solving complex, long-horizon decision-making problems outperforming state-of-the-art. Because of its ability to plan, our algorithm can find better trajectories than the ones in the training set. Speaker: Alexander Ilin is a Professor of Practice in the Department of Computer Science of Aalto University. He was a research scientist at Curious AI, Amazon and Analyse2. He obtained his PhD degree from Helsinki University of Technology in 2006 under the supervision of Prof. Erkki Oja and Dr. Harri Valpola. His research interests focus on deep representation learning and model-based reinforcement learning.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Alexander Ilin: Hierarchical Imitation Learning with Vector Quantized Models

0:00 51:11

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Finnish Center for Artificial Intelligence FCAI?

This episode is 51 minutes long.

When was this Finnish Center for Artificial Intelligence FCAI episode published?

This episode was published on October 22, 2023.

Can I download this Finnish Center for Artificial Intelligence FCAI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.