Is it possible to save files in Hadoop without saving them in local file system?

Question

Is it possible to save files in Hadoop without saving them in local file system? I would like to do something like shown below however I would like to save file directly in

Answer 1

Python is installed in your Linux. It can access only local files. It cannot directly access files in HDFS.

In order to save/put the files directly to HDFS, you need to use any of these below:

• Spark: Use Dstream for streaming files

• Kafka: matter of setting up configuration file. Best for streaming data.

• Flume: set up configuration file. Best for static files.