For a new course that I am teaching together with Thomas Rost we just launched a practical assignment which involves, for all the groups participating in the course, solving an online contextual bandit problem. For more info see: http://krabspin.uci.ru.nl.
Once we get some results in we will share some of the solutions that the students came up with!