boto3

问题 I am trying to parallelise retrieval of files from a server via SFTP and upload to AWS. I am using python multi-threading, the upload part works fine, however, I noticed that the get operation from paramiko.SFTPClient keeps the program hanging at the end. In fact, all of the files are withdrawn and uploaded but the program doesn't exit. I tried many things from similar posts but nothing work, my pseudo-code is the following, any help would be welcome: def create_sftp_connection(host, port,

问题 I am trying to parallelise retrieval of files from a server via SFTP and upload to AWS. I am using python multi-threading, the upload part works fine, however, I noticed that the get operation from paramiko.SFTPClient keeps the program hanging at the end. In fact, all of the files are withdrawn and uploaded but the program doesn't exit. I tried many things from similar posts but nothing work, my pseudo-code is the following, any help would be welcome: def create_sftp_connection(host, port,

问题 I am getting the following error: [ERROR] SSLError: SSL validation failed for https://data.iot.ap-northeast-2.amazonaws.com/topics/app%2Ftest%2Fresponse?qos=1 [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1124) Traceback (most recent call last): File "/var/task/app.py", line 197, in lambda_handler mqttcli.test('test', '11111', {}, 1, 200) File "/opt/python/lib/python3.8/site-packages/connectors/MQTTClient.py", line 40, in test

问题 Using Boto3 Python SDK , I was able to download files using the method bucket.download_file() Is there a way to download an entire folder? 回答1: quick and dirty but it works: import boto3 import os def downloadDirectoryFroms3(bucketName, remoteDirectoryName): s3_resource = boto3.resource('s3') bucket = s3_resource.Bucket(bucketName) for obj in bucket.objects.filter(Prefix = remoteDirectoryName): if not os.path.exists(os.path.dirname(obj.key)): os.makedirs(os.path.dirname(obj.key)) bucket

问题 Following the documentation, I'm trying to create an update statement that will update or add if not exists only one attribute in a dynamodb table. I'm trying this response = table.update_item( Key={'ReleaseNumber': '1.0.179'}, UpdateExpression='SET', ConditionExpression='Attr(\'ReleaseNumber\').eq(\'1.0.179\')', ExpressionAttributeNames={'attr1': 'val1'}, ExpressionAttributeValues={'val1': 'false'} ) The error I'm getting is: botocore.exceptions.ClientError: An error occurred

问题 Following the documentation, I'm trying to create an update statement that will update or add if not exists only one attribute in a dynamodb table. I'm trying this response = table.update_item( Key={'ReleaseNumber': '1.0.179'}, UpdateExpression='SET', ConditionExpression='Attr(\'ReleaseNumber\').eq(\'1.0.179\')', ExpressionAttributeNames={'attr1': 'val1'}, ExpressionAttributeValues={'val1': 'false'} ) The error I'm getting is: botocore.exceptions.ClientError: An error occurred

问题 According to the boto3 docs, the limit argument in query allows you to to limit the number of evaluated objects in your DynamoDB table/GSI. However, LastEvaluatedKey isn't returned when the desired limit is reached and therefore a client that would like to limit the number of fetched results will fail to do so consider the following code: while True: query_result = self._dynamodb_client.query(**query_kwargs) for dynamodb_formatted_item in query_result["Items"]: yield self._convert_dict_from

问题 According to the boto3 docs, the limit argument in query allows you to to limit the number of evaluated objects in your DynamoDB table/GSI. However, LastEvaluatedKey isn't returned when the desired limit is reached and therefore a client that would like to limit the number of fetched results will fail to do so consider the following code: while True: query_result = self._dynamodb_client.query(**query_kwargs) for dynamodb_formatted_item in query_result["Items"]: yield self._convert_dict_from

问题 According to the boto3 docs, the limit argument in query allows you to to limit the number of evaluated objects in your DynamoDB table/GSI. However, LastEvaluatedKey isn't returned when the desired limit is reached and therefore a client that would like to limit the number of fetched results will fail to do so consider the following code: while True: query_result = self._dynamodb_client.query(**query_kwargs) for dynamodb_formatted_item in query_result["Items"]: yield self._convert_dict_from

问题 I'm an aws python newbie and trying to account for total bucket size shown via metrics tab on UI vs calculating sizes one folder at a time in a give bucket. I tried to fetch it by setting an inventory configuration but it doesn't show what I'm looking for. I have an s3 bucket names my_bucket with versioning enabled. It has 100 Objects and 26 subfolders (will 100000+ objects in each subfolder and atleast two versions for each of the object) WHAT I AM TRYING TO DO: Calculate and display total