Setup Standalone Hive Metastore Service For Presto and AWS S3

前端 未结 4 511
花落未央
花落未央 2021-02-04 11:07

I\'m working in an environment where I have an S3 service being used as a data lake, but not AWS Athena. I\'m trying to setup Presto to be able to query the data in S3 and I kno

4条回答
  •  被撕碎了的回忆
    2021-02-04 11:37

    It's now available standalone /hive-standalone-metastore-3.0.0/ in the Apache Hive distribution.

    Beginning in Hive 3.0, the Metastore is released as a separate package and can be run without the rest of Hive. This is referred to as standalone mode.

    By default the Metastore is configured for use with Hive, so a few configuration parameters have to be changed in this configuration.

    metastore.task.threads.always -> org.apache.hadoop.hive.metastore.events.EventCleanerTask,org.apache.hadoop.hive.metastore.MaterializationsCacheCleanerTask
    metastore.expression.proxy -> org.apache.hadoop.hive.metastore.DefaultPartitionExpressionProxy
    

    Link to Docs

提交回复
热议问题