Apache Drill vs Spark

Question

I have some expirience with Apache Spark and Spark-SQL. Recently I\'ve found Apache Drill project. Could you describe me what are the most significant advantages/differences bet

Answer 1

Apache Spark-SQL:

• You need to write code (Scala, Java or Python) to access the data and process it.
• SQL queries can be executed against Dataframes.
• Execution can be done in a distributed fashion (cluster).
• Almost every data storage has a Spark driver or connector.
• Used for massive parallel computing/ data analytics.
• Support stream processing.
• Has a bigger support community.

Apache Drill:

• No need to write code, Drill will explore the data source and create its own data catalog.
• Easier to use, just SQL.
• Execution can be done in a distributed fashion (cluster).
• It can be used to read data from many data sources such as MongoDB, Parquet files, MySQL and any JDBC database.
• Used for ad-hoc data exploration.
• It does not support stream processing.
• It has a smaller support community.