aws-elasticsearch

问题 I tried to give permission required to create an ES domain in AWS to an IAM account but I couldn't find any existing policy to attach except AdministratorAccess. Is there a custom policy or something I can assign to the IAM account? I searched the web but couldn't find anything helpful either. 回答1: Amazon ES supports three types of access policies: Resource-based Policies Identity-based Policies IP-based Policies To get detailed information, about how to create your own custom policies you

问题 I'm looking for a solution to insert data to AWS Elastic Search using AWS Glue python or pyspark. I have seen Boto3 SDK for Elastic Search but could not find any function to insert data into Elastic Search. Can anyone help me to find solution ? Any useful links or code ? 回答1: For aws glue you need to add an additional jar to the job. Download the jar from https://repo1.maven.org/maven2/org/elasticsearch/elasticsearch-hadoop/7.8.0/elasticsearch-hadoop-7.8.0.jar Save the jar on s3 and pass it

问题 Not getting the correct score for the elastic search query result. ES Query - { "from": 0, "size": 10, "query": { "bool": { "must": [ { "query_string": { "query": "(emergency) OR (emergency*) OR (*emergency) OR (*emergency*)", "fields": [ "MDMGlobalData.Name1" ] } } ] } } } ES result - { "took": 29, "timed_out": false, "_shards": { "total": 5, "successful": 5, "skipped": 0, "failed": 0 }, "hits": { "total": { "value": 798, "relation": "eq" }, "max_score": 9.169065, "hits": [ { "_index":

来源： https://stackoverflow.com/questions/47229247/validationexception-before-you-can-proceed-you-must-enable-a-service-linked-ro

来源： https://stackoverflow.com/questions/47229247/validationexception-before-you-can-proceed-you-must-enable-a-service-linked-ro

问题 I've created an Elasticsearch domain in AWS. It's added to my VPC inside a public subnet and I've attached a security group which is currently completely open. I have this policy attached also: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "AWS": "*" }, "Action": "es:*", "Resource": "arn:aws:es:eu-central-1:ACCOUNT_ID:domain/DOMAIN_NAME/*" } ] } I am trying to access an endpoint locally but it doesn't seem to be allowed. The Kibana URL for example is: https:/

问题 I have an AWS Elasticsearch domain with the following config: Elasticsearch version: 7.4 Availability zones: 2 Instance type (data): t2.small.elasticsearch Number of nodes: 2 size: 7GB the number of documents: 4000 Memory utilization often reaches 95% When the load is high or when we make a lot of calls to this ES, we noticed it becomes unreachable. What changes I should make so that it can take more load? 回答1: You need to really upgrade the instance type, currently, you are using small t2

问题 I have an AWS Elasticsearch domain with the following config: Elasticsearch version: 7.4 Availability zones: 2 Instance type (data): t2.small.elasticsearch Number of nodes: 2 size: 7GB the number of documents: 4000 Memory utilization often reaches 95% When the load is high or when we make a lot of calls to this ES, we noticed it becomes unreachable. What changes I should make so that it can take more load? 回答1: You need to really upgrade the instance type, currently, you are using small t2

问题 I have create elastic service in AWS with Dev Testing(t2 small) Detials shown below VPCvpc-7620c30b Security Groups sg-7e9b1759 IAM RoleAWSServiceRoleForAmazonElasticsearchService AZs and Subnets us-east-1e: subnet-2f100a11 How to access my VPC endpoint https://vpc-xxx.us-east-1.es.amazonaws.com access from outside. Kibana is below : https://vpc-xx.us-east-1.es.amazonaws.com/_plugin/kibana/ I am not running on Ec2 instance 回答1: From docs: To access the default installation of Kibana for a

问题 I was using aws lambda function in python to stream from DynamoDB to elastic search. This was working for an year but suddenly all lambda function stopped working and the cloudwatch was throwing the below error Unable to import module 'lambda_function': cannot import name BotocoreHTTPSession My Lambda function in python2.7 is pasted below import base64 import datetime import json import logging import os import time import traceback import urllib import urlparse from botocore.auth import