David Silver @ RCL 2024

08/26/24 • 11 min

TalkRL: The Reinforcement Learning Podcast

David Silver is a principal research scientist at DeepMind and a professor at University College London.

This interview was recorded at UMass Amherst during RLC 2024.

References

Discovering Reinforcement Learning Algorithms, Oh et al -- His keynote at RLC 2024 referred to more recent update to this work, yet to be published
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm, Silver et al 2017 -- the AlphaZero algo was used in his recent work on AlphaProof
AlphaProof on the DeepMind blog
AlphaFold on the DeepMind blog
Reinforcement Learning Conference 2024
David Silver on Google Scholar

David Silver is a principal research scientist at DeepMind and a professor at University College London.

This interview was recorded at UMass Amherst during RLC 2024.

References

Discovering Reinforcement Learning Algorithms, Oh et al -- His keynote at RLC 2024 referred to more recent update to this work, yet to be published
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm, Silver et al 2017 -- the AlphaZero algo was used in his recent work on AlphaProof
AlphaProof on the DeepMind blog
AlphaFold on the DeepMind blog
Reinforcement Learning Conference 2024
David Silver on Google Scholar

Previous Episode

Vincent Moens on TorchRL

Dr. Vincent Moens is an Applied Machine Learning Research Scientist at Meta, and an author of TorchRL and TensorDict in pytorch.

Featured References

TorchRL: A data-driven decision-making library for PyTorch
Albert Bou, Matteo Bettini, Sebastian Dittert, Vikash Kumar, Shagun Sodhani, Xiaomeng Yang, Gianni De Fabritiis, Vincent Moens

Additional References

Next Episode

David Silver 2 - Discussion after Keynote @ RCL 2024

Thanks to Professor Silver for permission to record this discussion after his RLC 2024 keynote lecture.

Recorded at UMass Amherst during RCL 2024.

Due to the live recording environment, audio quality varies. We publish this audio in its raw form to preserve the authenticity and immediacy of the discussion.

References

AlphaProof announcement on DeepMind's blog
Discovering Reinforcement Learning Algorithms, Oh et al -- His keynote at RLC 2024 referred to more recent update to this work, yet to be published
Reinforcement Learning Conference 2024
David Silver on Google Scholar

TalkRL: The Reinforcement Learning Podcast - David Silver @ RCL 2024

Transcript

Robin00:00:00.719

I'm here with professor David Silver, of DeepMind, at RLC. Professor Silver, in today's talk, you showed, a result of discovering better RL algorithms, also using RL. And at these RL conferences, there's a major focus on new methods, new algorithms. How far away is the day when human RL researchers, improving algorithms themselves is not really practical and the focus becomes purely on meta RL, which presumably just the big labs can participate in? L