Using a custom AMI (with s3cmd) in a Datapipeline

大憨熊 提交于 2019-12-07 13:35:26

问题


How can I install s3cmd on a AMI that is used in the pipeline? This should be a fairly basic thing to do but I can't seem to get it done: Here's what I've tried:

  • Started a Pipeline without the Image-id option => Everything works fine
  • Navigated to EC2 and created an Image of the running Instance to make sure all the needed stuff to run in the pipeline is installed on my custom AMI
  • Started this AMI manually as an Instance
  • SSH'd into the machine and installed S3cmd
  • Created another Image of the machine, this time with s3cmd installed
  • Shut down the Instance
  • Started the Pipeline again, this time with the newly created AMI as Image-id and S3cmd installed

Now the Resource starts "RUNNING" but my Activity (ShellCommandActivity) is stuck in the WAITING_FOR_RUNNER state and the script never gets executed.

What do I have to do to get the pipeline running with a custom image? Or is there even an easier way to use s3cmd in a pipeline?

Thank you!


回答1:


I figured it out now, by using a "clean" Amazon Linux AMI (from the marketplace for example) and installing S3cmd, rather than creating an AMI out of a running Pipeline Resource. I saw that this AMI has a different Kernel version, so this could have been the problem.



来源:https://stackoverflow.com/questions/20271160/using-a-custom-ami-with-s3cmd-in-a-datapipeline

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!