Data structures to throttle/limit 2D physics collision testing to only nearby objects?

Question

I have a 2D world with a positive coordinate system. (0,0) is the top-left of the map and every object has positive co-ordinates.

Fo