dcos

DCOS cluster resource allocation is np-hard

由 时光总嘲笑我的痴心妄想 提交于 2019-12-20 04:57:14
问题 Here in the DCOS documents it is stated that "Deciding where to run processes to best utilize cluster resources is hard, NP-hard in-fact." I don't deny that that sounds right, but is there a proof somewhere? 回答1: Best utilization of resources is variation of bin packaging problem: In the bin packing problem, objects of different volumes must be packed into a finite number of bins or containers each of volume V in a way that minimizes the number of bins used. In computational complexity theory

DC/OS JMX Access

由 微笑、不失礼 提交于 2019-12-12 15:39:58
问题 I have a dc/os cluster deployed to azure. I have deployed to the cluster a container with my java application. But I can't access it via jmx. Let's take the example of deploying a standart tomcat image: 1) I opened a port 8081 according the next instruction: https://docs.microsoft.com/en-us/azure/container-service/container-service-enable-public-access#open-a-port-portal. 2) I deployed service using the next json: { "id": "/tomcat", "instances": 1, "cpus": 1, "mem": 512, "container": { "type"

Why consumer hangs while consuming messages from Kafka on DC/OS using Client API for Java?

由 こ雲淡風輕ζ 提交于 2019-12-12 10:44:36
问题 I installed Kafka on DC/OS (Mesos) cluster on AWS. Enabled three brokers and created a topic called "topic1". dcos kafka topic create topic1 --partitions 3 --replication 3 Then I wrote a Producer class to send messages and a Consumer class to receive them. public class Producer { public static void sendMessage(String msg) throws InterruptedException, ExecutionException { Map<String, Object> producerConfig = new HashMap<>(); System.out.println("setting Producerconfig."); producerConfig.put(

what is a better way to run docker under chronos?

由 梦想与她 提交于 2019-12-12 04:32:39
问题 I have a dockerized spring-boot app, which needs to be scheduled in mesos / chronos (DC/OS). There are 2 places, which (I think) can be used to accomplish Chronos scheduling: 1) by using the "command" tag 2) by using the "container" tag An example of Chronos command tag would be: { "name": "my-dockerized-app", "command": "docker login -u my_username -p my_password -e dev-my_user@my_company.com;docker run -e id=123 my_owner/my_dockerized_app_image:latest", "shell": true, "epsilon": "PT60S",

Running Arango Shell on DC/OS cluster

由 江枫思渺然 提交于 2019-12-11 06:35:23
问题 I have just set up a DC/OS cluster via Microsoft Azure, and installed Arango 3.0 on the cluster using the DC/OS dashboard (via the ssh tunnel). I am able to SSH into the cluster and communicate with the Arango cluster: $ curl --dump - http://localhost:8529/_api/gharial HTTP/1.1 200 OK Content-Type: application/json; charset=utf-8 Server: ArangoDB Connection: Keep-Alive Content-Length: 38 {"error":false,"graphs":[],"code":200} Question #1 : Even after I insert a graph using the POST requested

How to deploy distributed h2o flow cluster with docker?

由 南楼画角 提交于 2019-12-11 05:08:46
问题 I'm able to deploy a h2o cluster with ec2 instances and having the private ip in the flatfile. Doing the same with docker works but I can't figure out what to enter into the flatfile so they can create the cluster. Private IP the container is running on is not working 回答1: Can the containers ping each others ip? When launching h2o are you forcing the interface to use the container ip? java -jar h2o.jar -flatfile flatfile -ip -port Are these docker containers when run exposing the port 54321

Spark on Mesos (DC/OS) loses tasks before doing anything

由 戏子无情 提交于 2019-12-08 05:44:22
问题 I'm experiencing serious problem with DC/OS Apache Spark running in Mesos cluster mode. I'm using GCE instances for DC/OS for testing. Everything was working fine with spark, Spark just suddenly stopped working properly. Before it starts executors it says that some executors are lost and it blacklists nodes leaving very little resources so it runs ~2-3 executors. Then it proceeds to remove non-existing executors but I don't know if it succeeds. I wanted to disable blacklisting but it's

Spark on Mesos (DC/OS) loses tasks before doing anything

由 坚强是说给别人听的谎言 提交于 2019-12-08 04:31:27
I'm experiencing serious problem with DC/OS Apache Spark running in Mesos cluster mode. I'm using GCE instances for DC/OS for testing. Everything was working fine with spark, Spark just suddenly stopped working properly. Before it starts executors it says that some executors are lost and it blacklists nodes leaving very little resources so it runs ~2-3 executors. Then it proceeds to remove non-existing executors but I don't know if it succeeds. I wanted to disable blacklisting but it's hardcoded in Spark mesos files and impossible to disable or change any configuration. This happens mainly

Mesos DCOS doesn't install Kafka

由 拟墨画扇 提交于 2019-12-07 17:11:54
问题 I'm trying to install Kafka on Mesos. Installation seems to have succeeded. vagrant@DevNode:/dcos$ dcos package install kafka This will install Apache Kafka DCOS Service. Continue installing? [yes/no] yes Installing Marathon app for package [kafka] version [0.9.4.0] Installing CLI subcommand for package [kafka] version [0.9.4.0] New command available: dcos kafka The Apache Kafka DCOS Service is installed: docs - https://github.com/mesos/kafka issues - https://github.com/mesos/kafka/issues

DC/OS on GCE Ubuntu

由 空扰寡人 提交于 2019-12-06 15:31:00
Is there any link/documentation available around installing DC/OS on Google Compute Engine where instances are ubuntu 16.04 instances including the bootstrap node instead of CentOS 7? Currently , the documents I find use Ansible and CentOS 7 on GCE as below. https://dcos.io/docs/1.7/administration/installing/cloud/gce/ Short answer : Debian based distributions are currently (at least up to DC/OS 1.10) not supported. Long answer : It's possible, but requires some extra steps. DC/OS doesn't use any RedHat specific features. Most important differences could be solved by symlinks for few system
订阅 dcos