How can I set the destination filename for AWS Firehose on S3?

寵の児 提交于 2019-12-11 01:44:00

问题


I'm processing an XML file added to S3 and writing the results to a firehose, and storing the results on the same S3 bucket, but the destination filename has to be in a specific format. I've examing the documentation and I can't see any way to set the format of the filename. The closest I can find is in the firehose FAQ

Q: What is the naming pattern of the Amazon S3 objects delivered by Amazon Kinesis Data Firehose?

The Amazon S3 object name follows the pattern DeliveryStreamName-DeliveryStreamVersion-YYYY-MM-DD-HH-MM-SS-RandomString, where DeliveryStreamVersion begins with 1 and increases by 1 for every configuration change of the delivery stream. You can change delivery stream configurations (for example, the name of the S3 bucket, buffering hints, compression, and encryption) with the Firehose Console or the UpdateDestination operation.


回答1:


If you are using static naming, you can specify it through Firehose Console or the UpdateDestination operation.

But if you are looking for some dynamic naming, unfortunately, currently it is not possible. Refer to this question for detail answering - Storing Firehose transfered files in S3 under custom directory names



来源:https://stackoverflow.com/questions/49514613/how-can-i-set-the-destination-filename-for-aws-firehose-on-s3

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!