Algorithms for Contextual Bandits (a.k.a. where is UCB?)

Question

Hello and let me start by saying I haven\'t really worked with contextual bandits before; I\'ve worked a lot with multi-armed bandits, as well as with Monte