python-hdfs

How do i set the path of libhdfs.so for pyarrow?

雨燕双飞 提交于 2021-02-11 15:21:49
问题 I'm trying to use pyarrow and i keep getting the following error. ImportError: Can not find the shared library: libhdfs3.so so i read some stackoverflow and it says that i need to set enviorment variable for ARROW_LIBHDFS_DIR. The path to libhdfs.so is /usr/local/hadoop/native/ it tried to set it in bashrc but it didn't work the conda installation doesn't seem to work i.e. conda install libhdfs3 pip install libhdfs3 conda install -c clinicalgraphics libgcrypt11 conda install libprotobuf=2.5