What's the difference between Flume and Sqoop?

前端 未结 7 544
灰色年华
灰色年华 2021-02-05 06:40

Both Flume and Sqoop are meant for data movement, then what is the difference between them? Under what condition should I use Flume or Sqoop?

7条回答
  •  滥情空心
    2021-02-05 07:17

    From http://flume.apache.org/

    Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.

    Flume helps to collect data from a variety of sources, like logs, jms, Directory etc.
    Multiple flume agents can be configured to collect high volume of data.
    It scales horizontally.

    From http://sqoop.apache.org/

    Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.

    Sqoop helps to move data between hadoop and other databases and it can transfer data in parallel for performance.

提交回复
热议问题