Amazon AWS Athena S3 and Glacier Mixed Bucket

Question

Amazon Athena Log Analysis Services with S3 Glacier

We have petabytes of data in S3. We are https://www.pubnub.com/ and we store usage data in S3 of our network for b

Answer 1

The documentation from AWS dated May 16 2017 states specifically that Athena does not support the GLACIER storage class:

Athena does not support different storage classes within the bucket specified by the LOCATION clause, does not support the GLACIER storage class, and does not support Requester Pays buckets. For more information, see Storage Classes, Changing the Storage Class of an Object in |S3|, and Requester Pays Buckets in the Amazon Simple Storage Service Developer Guide.

We are also interested in this; if you get it to work, please let us know how. :-)

Answer 2

Since the release of February 18, 2019 Athena will ignore objects with the GLACIER storage class instead of failing the query:

[…] As a result of fixing this issue, Athena ignores objects transitioned to the GLACIER storage class. Athena does not support querying data from the GLACIER storage class.

Answer 3

You must have an S3 bucket to work with. In addition, the AWS account that you use to initiate a S3 Glacier Select job must have write permissions for the S3 bucket. The Amazon S3 bucket must be in the same AWS Region as the vault that contains the archive object that is being queried.

S3 glacier select runs the query and stores in S3 bucket

Bottom line, you must move the data into an S3 buck to use teh S3 glacier select statement. Then use Athena on the 'new' S3 bucket.