How to specify AWS Access Key ID and Secret Access Key as part of a amazon s3n URL

Question

I am passing input and output folders as parameters to mapreduce word count program from webpage.

Getting below error:

HTTP Status 500 - Requ

Answer 1

I suggest you use this:

hadoop distcp \
-Dfs.s3n.awsAccessKeyId= \ 
-Dfs.s3n.awsSecretAccessKey= \
s3n://origin hdfs://destinations

It also works as a workaround for the occurrence of slashes in the key. The parameters with the id and access key must be supplied exactly in this order: after disctcp and before origin