After doing optical flow (lk) on a video what\'s the best way to find the objects based on this data and track them?
This probably sounds very noobish, but I would
You can use TLD or CLM for doing object tracking (it is loosely based on the the idea of optical flow tracking and model learning at the same time). You can find following links useful https://www.gnebehay.com/tld/ https://www.gnebehay.com/cmt/