ambari

Which one is best: Apache Ambari cluster on Physical system with 5 Machine or install on virtual machine with diffrent 5 VM?

由 戏子无情 提交于 2020-01-07 04:55:10
问题 Hi I am working on One of my project which I have created VM of 5 Machine and it is working fine in development environment but I have some confusion regarding VM cluster is good or need to go with physical system cluster. 回答1: Hadoop was developed for physical systems but it will function with varying degrees of success in virtual environments, it depends on the specific environment. This is actually quite a common question on the hadoop mailing lists and was specifically addressed by the

Spark History UI not working | Ambari | YARN

由 我只是一个虾纸丫 提交于 2020-01-06 23:45:37
问题 I have a hadoop cluster setup using Ambari which has services like HDFS,YARN,spark running on the hosts. When i run the sample spark pi in cluster mode as master yarn, the application gets successfully executed and I can view the same from resource manager logs. But when i click on the history link, it does not show the spark history UI. How to enable/view the same? 回答1: First, check if your spark-history server is already configured by looking for spark.yarn.historyServer.address in spark

What are the steps to upgrade Spring XD using the Ambari Plugin?

由 依然范特西╮ 提交于 2020-01-06 19:51:20
问题 I successfully installed Spring XD 1.2.0 RC1 on HDP 2.2 using the Ambari plugin. Now that Spring XD 1.2.0 GA is out, how do I go about upgrading my installation? 回答1: Looks like you need to remove the RC1 install and replace it with the 1.2.0 GA. I didn't see an option for updating a service in the Ambari UI. These are the steps I took: 1) stop the Spring XD service from Amabari UI 2) remove old Spring XD plugin: yum remove springxd-plugin-hdp 3) remove Spring XD installation: yum remove

Ambari-java python多用混合

由 泄露秘密 提交于 2019-12-29 15:26:25
由于 Ambari Metrics 存储的是集群运行情况信息，在当前集群运行良好情况下，不是特别重要；所以我们采取删除重建的方式修复。以下为主要步骤: 删除 Ambari Metrics 元数据 Ambari Metrics 使用 hbase 存储数据。hbase 元数据存储在 zookeeper 上。 查看 ams-hbase-site 配置 zookeeper.znode.parent 项，确定其元数据存储路径，然后使用zkClient进行删除。 删除 Ambari Metrics 历史数据 Ambari Metrics 使用 hbase 存储数据。hbase 数据存储在本地目录(单节点)或hdfs中(高可用)。 查看 ams-hbase-site 配置 hbase.rootdir 项，确定数据存储路径，使用命令行进行删除。 删除 Ambari Metrics 临时文件 Ambari Metrics 临时文件包含: a. Aggregator checkpoint 目录：配置在 Metrics Collector 的 Aggregator checkpoint directory 项中。 b. hbase 本地文件：配置在 ams-hbase-site 的 hbase.local.dir 项中。 c. phoenix spool 目录：配置在 ams-hbase-site 的

HIVE LLAP doesn't work with complex types

由 一世执手 提交于 2019-12-25 09:13:26
问题 I turned on LLAP on the Ambari sandbox and my queries aren't working anymore. I have a table that has primitive types and complextypes(structs/arrays). I'm querying against the primitive type and it errors out. select * from test.data where policynumber = '4' Error: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask 来源： https://stackoverflow.com/questions/44315117/hive-llap-doesnt-work-with-complex

why HDP install mysql while I have chose existing mysql

由 ∥☆過路亽．° 提交于 2019-12-25 08:58:53
问题 I am installing HDP 2.6 via Ambari 2.5.0.3,the error shows in Hive client install.the error logs: resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm mysql-client' returned 4. Problem: mysql-community-client-5.7.17-1.sles11.x86_64 conflicts with namespace:otherproviders(mysql-client) provided by mysql-client-5.5.31-0.7.10.x86_64 Solution 1: Following actions will be done: deinstallation of mysql-community

Adding installed elasticsearch service into Ambari Web UI

由 别说谁变了你拦得住时间么 提交于 2019-12-25 07:51:42
问题 I am using HDP2.1、Ambari1.5.1 and I intend to add elasticsearch service into Ambari web ui, which can control the start&stop of elasticsearch.How can i do this? Any advice ? 回答1: Elasticsearch is not a service offered in the default HDP 2.1 stack. So you would need to create a custom service and add it to the HDP 2.1 stack. You can find out more about creating custom services on the Ambari Wiki. 来源： https://stackoverflow.com/questions/36415521/adding-installed-elasticsearch-service-into

YARN job appears to have access to less resources than Ambari YARN manager reports

由 ≯℡__Kan透↙ 提交于 2019-12-24 21:03:41
问题 Getting confused when trying to run a YARN process and getting errors. Looking in ambari UI YARN section, seeing... (note it says 60GB available). Yet, when trying to run an YARN process, getting errors indicating that there are less resources available than is being reported in ambari, see... ➜ h2o-3.26.0.2-hdp3.1 hadoop jar h2odriver.jar -nodes 4 -mapperXmx 5g -output /home/ml1/hdfsOutputDir Determining driver host interface for mapper->driver callback... [Possible callback IP address: 192

Ambari shows service as stopped

由 ￣綄美尐妖づ 提交于 2019-12-24 15:31:08
问题 We are using Hortonworks HDP 2.1 with Ambari 1.6.1 After a crash in our underlying hardware we restarted our cluster some days ago. We got everything back up again, however, Ambari shows that two services are still down, the YARN Resource Manager and the MapReduce History Server. Both of those services are running, verified both by checking running processes on the server as well as checking the provided functionality. Nagios healthchecks are also ok. Still, Ambari shows the services as being

Ambari server setup: OSError: [Errno 2] No such file or directory

由 旧巷老猫 提交于 2019-12-24 15:24:39
问题 I'm trying to setup Hadoop on my EC2 instance using this tutorial. I'm trying to setup the ambari server when I get this error: [root@ip-xxx-xxx-xxx-xxx ec2-user]# ambari-server setup Using python /usr/bin/python2.6 Setup ambari-server Checking SELinux... WARNING: Could not run /usr/sbin/sestatus: OK Ambari-server daemon is configured to run under user 'root'. Change this setting [y/n] (n)? Adjusting ambari-server permissions and ownership... Checking iptables... Checking JDK... JCE Policy
订阅 ambari