Best Performing lookup in a List for later comparisons

Question

i have following situation:

I have 2 Lists, one filled with HitObject objects, one filled with ReplayFrames. Structure of the relevant objects below.