set_property could not find TARGET pybind11::pybind11. Perhaps it has not yet been created

Question

I am trying to build real time tools for my project and pybind11 was one essential requirements. I cloned the repo from https://github.com/pybind/pybind11 and executed $catk