I encountered the same issue and adding the --with-boost-libdir=XXX did not work, however when I switched to gcc v9.3 everything compiled and the boost libraries linked in.
Check what version your boost library was compiled with and match the compiler version.. might help.