I am trying to solve the following question from the textbook : Introduction to Multi-Armed Bandits by Aleksandrs Slivkins.
Question:
"Pr
