Apache Spark — MlLib — Collaborative filtering

Question

I\'m trying to use MlLib for my colloborative filtering.

I encounter the following error in my Scala program when I run it in Apache Spark 1.0.0.

Answer 1

Spark documentation clearly mentions that MLLib uses native libraries, which need to be present on the nodes. (that is it does not come with spark installation)

MLlib uses the jblas linear algebra library, which itself depends on native Fortran routines. You may need to install the gfortran runtime library if it is not already present on your nodes. MLlib will throw a linking error if it cannot detect these libraries automatically.

You have to make sure that libgfortran library exists on all nodes.

for debian/ubuntu use: sudo apt-get install libgfortran3

for centos use: sudo yum install gcc-gfortran