aws-java-sdk

问题 I have a glue job that reads directly from redshift, and to do that, one has to provide connection credentials. I have created an embedded glue connection and can extract the credentials with the following pyspark code. Is there a way to do this in Scala ? glue = boto3.client('glue', region_name='us-east-1') response = glue.get_connection( Name='name-of-embedded-connection', HidePassword=False ) table = spark.read.format( 'com.databricks.spark.redshift' ).option( 'url', 'jdbc:redshift://prod

问题 I have a Spring Boot, Spring Cloud AWS service, written to receive messages from an AWS SQS queue. Everything has been working fine within my own personal AWS account services with region set to "us-east-1", but when switching over to AWS GovCloud region "us-gov-east-1", receiving error message "The region 'us-gov-east-1' is not a valid region". Tracked down the problem to be related to pulling a real old version of the aws-java-sdk-core-1.11.415 library that does not contain the new GovCloud

问题 Getting access denied error: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: AEB65D41FEB958C7; S3 Extended Request ID: jhCxO/Mv4MTxMRjvkM3bHVJ3dhb7TBeK0k7qHFUY3Q/RFhF591mRLeIzPXUEF0EdtgX9FNJXSq4=), S3 Extended Request ID: jhCxO/Mv4MTxMRjvkM3bHVJ3dhb7TBeK0k7qHFUY3Q/RFhF591mRLeIzPXUEF0EdtgX9FNJXSq4=File Upload Exception:Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: AEB65D41FEB958C7; when trying to upload the

问题 I'm trying to fetch the files from S3. As usual, my files are organised in the bucket as below: bucket/<prefixes>/files I want to retrieve files having specific file names E.g.: Files starting with a given text (myfile-*) Files having specific extensions (*.csv) File names having specific text ( text ) For the first scenario, I can get away using prefix as below: ObjectListing objectListing = s3Client.listObjects(bucketName, "test/myfile"); But for the other 2 cases, I'm not able to find any

问题 I would like to think that it's a big YES, but I prefer to ask before to suppose. So, do you know if the AWS SDK for Java always uses a secure channel when I download/upload files from/to S3 buckets? Or this is something that should be configured when I write the code or into the S3 buckets itself? 回答1: Amazon S3 end points support both HTTP and HTTPS (http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region) when you're using the Java SDK you will create an AmazonS3Client and if you

问题 I am trying to s3 sdk with very basic test and getting below error. Caused by: java.lang.NoSuchFieldError: SIGNING_REGION at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4227) at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4203) at com.amazonaws.services.s3.AmazonS3Client.listBuckets(AmazonS3Client.java:929) at com.amazonaws.services.s3.AmazonS3Client.listBuckets(AmazonS3Client.java:936) aws-java-sdk-s3 <dependency> <groupId>com

问题 I am trying to s3 sdk with very basic test and getting below error. Caused by: java.lang.NoSuchFieldError: SIGNING_REGION at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4227) at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4203) at com.amazonaws.services.s3.AmazonS3Client.listBuckets(AmazonS3Client.java:929) at com.amazonaws.services.s3.AmazonS3Client.listBuckets(AmazonS3Client.java:936) aws-java-sdk-s3 <dependency> <groupId>com

问题 ArrayList<ResourcePermission> permissions=new ArrayList<>(); ArrayList<String> action= new ArrayList<>(); action.add("quicksight:UpdateDataSourcePermissions"); action.add("quicksight:DescribeDataSource"); action.add("quicksight:DescribeDataSourcePermissions"); action.add("quicksight:PassDataSource"); action.add("quicksight:UpdateDataSource"); action.add("quicksight:DeleteDataSource"); permissions.add(new ResourcePermission().withPrincipal(PrincipalArn).withActions(action)); return(getClient()

问题 I am using AWS Congito User Pools for account management with a Cognito Identity Pool that has this User Pool as the Identity Provider. I'm using this to control access to an API through API Gateway that sends requests to Lambda. My Lambda is implemented with Java 8 using Micronaut. All of this is working fine. In the Lambda, I'm getting the name from the Principal in the HttpRequest : protected String resolveUser( HttpRequest request ){ String ret = null; Optional<Principal> principal =

问题 I am using AWS Congito User Pools for account management with a Cognito Identity Pool that has this User Pool as the Identity Provider. I'm using this to control access to an API through API Gateway that sends requests to Lambda. My Lambda is implemented with Java 8 using Micronaut. All of this is working fine. In the Lambda, I'm getting the name from the Principal in the HttpRequest : protected String resolveUser( HttpRequest request ){ String ret = null; Optional<Principal> principal =