What's the difference between Flume and Sqoop?

前端 未结 7 556
灰色年华
灰色年华 2021-02-05 06:40

Both Flume and Sqoop are meant for data movement, then what is the difference between them? Under what condition should I use Flume or Sqoop?

7条回答
  •  春和景丽
    2021-02-05 07:05

    Flume: A very common use case is collecting log data from one system- a bank of web servers(aggregating it in HDFS for later analysis).

    Sqoop: On the other hand is designed for performing bulk imports of data into HDFS from structured data stores. simple use case will be an organization that runs a nightly sqoop import to load the day's data from a production DB into a Hive data ware house for analysis.

    --From the definitive guide.

提交回复
热议问题