Towards Artificial Intelligence in Accelerator Operation

Hirländer, S. (Speaker)

Activity: Talk or presentationOral presentationscience to science / art to art


Artificial intelligence found its entrance to the control room. In this seminar, we will present the application of reinforcement learning (RL) at particle accelerators and the advances within the last two years after its start at the CERN accelerator complex. In the 2018 ion run, numerical optimizations were applied to achieve the highest reliable and stable performance. Particularly in the Low Energy Ion Ring (LEIR), where optimizers rapidly corrected drifts and recovered the performance, typical in the low energy regime. Shortly after, the first successful deep RL experiment was applied to LEIR. This lead to the development of new applications of RL on the CERN accelerators, which will be addressed. An introduction to the RL state of the art methods will be given with emphasis on the challenges in real-world accelerator applications. Finally, the latest results from successful experiments at the FERMI FEL of highly sample efficient, uncertainty aware model-based RL methods are presented.
Period5 Nov 2020
Held atGSI Helmholtz Centre for Heavy Ion Research, Germany
Degree of RecognitionInternational


  • Reinforcement learning
  • Artificial intelligence
  • control theory

Fields of Science and Technology Classification 2012

  • 101 Mathematics
  • 103 Physics, Astronomy
  • 107 Other Natural Sciences