WPF: Binding to ListBoxItem.IsSelected doesn't work for off-screen items

Question

In my program I have a set of view-model objects to represent items in a ListBox (multi-select is allowed). The viewmodel has an IsSelected property that I would like to bind t