amazon-glacier

How does AWS transfer S3 objects to Glacier archives when you use lifecycle archive rules?

家住魔仙堡 提交于 2019-12-18 12:37:12
问题 Amazon Web Services (AWS) S3 allows you to automatically transfer/archive objects from S3 to Glacier. Nowhere that I can find does anybody explain how that transfer happens. What Glacier vault do S3 objects archive to? Does the lifecycle policy set any sort of description on the Glacier archives it creates? Does it create an archive per S3 object? 回答1: Q: Can I use Amazon Glacier APIs to access objects that I’ve archived to Amazon Glacier? Because Amazon S3 maintains the mapping between your

What Glacier vault does S3 default to?

孤者浪人 提交于 2019-12-13 02:01:57
问题 Relating to (or following on from) the question: How does AWS transfer S3 objects to Glacier archives when you use lifecycle archive rules? - where it is explained that S3 is essentially just another multi-tennanted 'customer' of Glacier - does that mean I'm completely unable to configure notification events on the 'default' Glacier vault? In S3, I'm unable to specify a vault to archive to, so are Glacier notifications only of purpose for bespoke apps that use the API's to handle their

Restore a deleted bucket in AWS S3 from AWS Glaicer

跟風遠走 提交于 2019-12-11 12:17:10
问题 I created a bucket just to test the archiving in AWS Glacier using S3. I added a rule using the Lifecycle rules to Permanently Delete 3 days after the object's creation date and I applied this rule to the whole bucket. Now after 3 days, the test bucket is empty as it should be but I don't know how to access my archived bucket in Glacier using S3. I searched on the AWS documentation and came across this link but how can I restore an object if the bucket is empty, kindly help me to restore the

Advantage of Java Pattern where method takes Object as a parameter instead of individual parameters

旧城冷巷雨未停 提交于 2019-12-07 09:07:18
问题 I've been using Amazon Glacier via the Amazon Java SDK. I'm struck that parameters are passed around via an object, rather than as individual parameters. For example, to retrieve the output of a job, where the parameters are Vault, JobId,range, the following technique is used: client.getJobOutput(new GetJobOutputRequest(Vault, JobId, range)); Instead of: client.getJobOutput(Vault, JobId, range); What are the pros and cons of the two approaches? 回答1: Pros: If your method takes many parameters,

Advantage of Java Pattern where method takes Object as a parameter instead of individual parameters

倾然丶 夕夏残阳落幕 提交于 2019-12-05 16:02:56
I've been using Amazon Glacier via the Amazon Java SDK. I'm struck that parameters are passed around via an object, rather than as individual parameters. For example, to retrieve the output of a job, where the parameters are Vault, JobId,range, the following technique is used: client.getJobOutput(new GetJobOutputRequest(Vault, JobId, range)); Instead of: client.getJobOutput(Vault, JobId, range); What are the pros and cons of the two approaches? Pros: If your method takes many parameters, using a parameter object makes the method signature sane. If you want to take additional parameters for the

AWS S3 Glacier - Programmatically Initiate Restore

狂风中的少年 提交于 2019-12-04 23:23:04
问题 I have been writing an web-app using s3 for storage and glacier for backup. So I setup the lifecycle policy to archive it. Now I want to write a webapp that lists the archived files, the user should be able to initiate restore from this and then get an email once their restore is complete. Now the trouble I am running into is I cant find a php sdk command I can issue to initiateRestore. Then it would be nice if it notified SNS when restore was complete, SNS would push the JSON onto SQS and I

AWS S3 Glacier - Programmatically Initiate Restore

一笑奈何 提交于 2019-12-03 14:20:36
I have been writing an web-app using s3 for storage and glacier for backup. So I setup the lifecycle policy to archive it. Now I want to write a webapp that lists the archived files, the user should be able to initiate restore from this and then get an email once their restore is complete. Now the trouble I am running into is I cant find a php sdk command I can issue to initiateRestore. Then it would be nice if it notified SNS when restore was complete, SNS would push the JSON onto SQS and I would poll SQS and finally email the user when polling detected a complete restore. Any help or

Move files between amazon S3 to Glacier and vice versa programmatically using API

*爱你&永不变心* 提交于 2019-12-03 12:04:09
问题 I am creating a PHP based web application using Amazon's S3 and glacier services. Now I want to give my site users a feature that they can choose any file and make it archive (means move file from S3 to Glacier) and unarchive (means move file from Glacier to S3). I have done some research and didn't find any possible way using Amazon's API. PROBLEM How can I move files between S3 and glacier using API? 回答1: You could use the Glacier API to upload a file to a Glacier vault, but I don't

AWS: Ways of keeping cost down while backing up S3 files to Glacier? [closed]

﹥>﹥吖頭↗ 提交于 2019-12-03 06:52:41
As part of our project, we have created quite a bushy folder/file tree on S3 with all the files taking up about 6TB of data. We currently have no backup of this data which is bad. We want to do periodic back ups. Seems like Glacier is the way to go. The question is: what are the ways to keep the total cost of a back up down? Most of our files are text so we can compresses them and upload whole ZIP archives. This will require processing (on EC2) so I am curious whether there is any rule of thumb to compare extra cost of running an EC2 instance for zipping versus just uploading uncompressed

Amazon AWS Athena S3 and Glacier Mixed Bucket

淺唱寂寞╮ 提交于 2019-12-02 19:41:06
Amazon Athena Log Analysis Services with S3 Glacier We have petabytes of data in S3. We are https://www.pubnub.com/ and we store usage data in S3 of our network for billing purposes. We have tab delimited log files stored in an S3 bucket. Athena is giving us a HIVE_CURSOR_ERROR failure. Our S3 bucket is setup to automatically push to AWS Glacier after 6 months. Our bucket has S3 files hot and ready to read in addition to the Glacier backup files. We are getting access errors from Athena because of this. The file referenced in the error is a Glacier backup. My guess is the answer will be: don't