Model-Value Self-Consistent Updates and Applications

Priberam Labs

Instituto Superior Técnico, Anfiteatro PA2

Abstract:Learned models of the environment provide reinforcement learning agents with flexible ways of making predictions about the environment. Models enable planning, i.e. using more computation to improve value functions or policies, without requiring additional environment interactions. In this talk, we investigate a way of augmenting model-based RL, by additionally encouraging a learned model and value function to be jointly self-consistent. This work covers possible ways to use self-consistency updates both for policy evaluation and control (Farquhar et al 20), as well as a proxy for epistemic uncertainty in exploration (Filos et al. 22).Bio:Zita Marinho is a Research Scientist at Deepmind, where she is currently working on reinforcement learning. She holds a dual PhD/MSc in Robotics from the Robotics Institute, and from IST University of Lisbon as part of the CMU/Portugal program. She graduated from her MSc. degree in Physics Engineering from Instituto Superior Técnico, Universidade de Lisboa in 2010. Her research interests lie in the intersection of machine learning algorithms and Natural Language Processing. She is particularly interested in studying how agents can interact and learn more effectively from those interactions. She studied during her PhD spectral algorithms for sequence prediction and planning. She was jointly advised by Prof. André Martins at Unbabel/IST, Prof. Geoffrey Gordon at the Machine Learning Department/CMU and Prof. Siddhartha Srinivasa from University of Washington.<a href="https://www.priberam.com/" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">www.priberam.com</a>

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Model-Value Self-Consistent Updates and Applications

More events from Priberam Labs

Discover more events from Priberam Labs, from Science & Tech to other experiences you might love.

Model-Value Self-Consistent Updates and Applications

More events from Priberam Labs

Discover more events from Priberam Labs, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.