marathon

New to mesos/marathon. How to deploy a new self defined docker?

狂风中的少年 提交于 2019-12-23 01:40:07
问题 I am new to mesos and marathon. I have a set up where in one docker is self defined and another is mysql server instance. These two are linked and pass information. How do I deploy this on mesos? I am using a single node master and slave set up currently. 回答1: To link your Docker containers use Mesos-DNS. I'm using Playa Mesos in the following to explain the setup. Setting up Mesos-DNS on Playa is straightforward: use the mesosphere/mesos-dns image and deploy it on Marathon using the

How to run a one-off task with Apache Mesos/Marathon?

心不动则不痛 提交于 2019-12-21 09:19:34
问题 I'm trying to run a one-off task with Marathon. I'm able to get the task container running, but after the task command completes, marathon runs another task, and so on. How can I prevent Marathon from running more than one task/command? Or, if this is not possible with Marathon, how can I achieve the desired behaviour? 回答1: As a hack you can kill a marathon task at the end, as suggested here: https://github.com/mesosphere/marathon/issues/344#issuecomment-86697361 As rukletsov already

Setup Mesos-DNS dockerized on a mesos cluster

烂漫一生 提交于 2019-12-19 10:16:41
问题 I'm facing some trouble trying to run mesos-dns dockerized on a mesos cluster. I've setup 2 virtual machines with ubuntu trusty on a windows 8.1 host. My VMs are called docker-vm and docker-sl-vm ; where the first one runs mesos-master and the 2nd one runs mesos-slave. The VMs have 2 network cards; one running NAT for accesing internet through the host and the other one is a Host-only adapter for internal communication. The IPs for the VMs are: 192.168.56.101 for docker-vm 192.168.56.102 for

Transport Endpoint Not Connected - Mesos Slave / Master

匆匆过客 提交于 2019-12-18 18:47:31
问题 I'm trying to connect a Mesos slave to its master. Whenver the slave tries to connect to the master, I get the following message: I0806 16:39:59.090845 935 hierarchical.hpp:528] Added slave 20150806-163941-1027506442-5050-921-S3 (debian) with cpus(*):1; mem(*):1938; disk(*):3777; ports(*):[31000-32000] (allocated: ) E0806 16:39:59.091384 940 socket.hpp:107] Shutdown failed on fd=25: Transport endpoint is not connected [107] I0806 16:39:59.091508 940 master.cpp:3395] Registered slave 20150806

Consul not deregistering zombie services

a 夏天 提交于 2019-12-14 03:42:02
问题 I am deploying a simple hello world nginx container with marathon, and everything seems to work well, except that I have 6 containers that will not deregister from consul. docker ps shows none of the containers are running. I tried using the /v1/catalog/deregister endpoint to deregister the services, but they keep coming back. I then killed the registrator container, and tried deregistering again. They came back. I am running registrator with docker run -d --name agent-registrator -v /var/run

Docker mesosphere/chronos container fails immediately after launch

允我心安 提交于 2019-12-13 18:25:31
问题 I am trying to launch Chronos in Docker, using mesosphere/chronos image. From command line Running following command to run the image doesn't work fine. docker run -p 8081:8081 -t mesosphere/chronos:latest /usr/bin/chronos --master zk://<master-hostname>:2181/mesos --zk_hosts <master-hostname>:2181 --http_port 8081 (I am trying with a single ZK node and a single Mesos Master node) It shows following messages soon after a few seconds. And no docker container of Chronos runs. /usr/bin/chronos:

Ephemeral tasks on Marathon

断了今生、忘了曾经 提交于 2019-12-12 21:44:00
问题 Before hand let me say that I'm new to Mesosphere stack. I am trying to migrate an existing Rails application deployment to Mesos and I'm successful so far, but currently I'm on the middle of running migrations and seeds (through Rake tasks) and I don't see a pretty way to get it done since those tasks are ephemeral and they don't match quite Marathon's idea. How should I proceed? 回答1: You could also use Chronos to run a task "Now" that is expected to complete at some point. Marathon is

How does Spark handle exceptions for a spark streaming job?

泄露秘密 提交于 2019-12-12 21:21:42
问题 This question might seem pretty large as is, however I have two specific situations which are better put together than separately. To start with, I'm reading data from Kafka into a dstream using the spark-streaming-kafka API. Assume I have one of the following two situations: // something goes wrong on the driver dstream.transform { rdd => throw new Exception } // something goes wrong on the executors dstream.transform { rdd => rdd.foreachPartition { partition => throw new Exception } } This

Library cannot be resolved

被刻印的时光 ゝ 提交于 2019-12-12 04:38:39
问题 When I package Scala project using SBT, I face the following problem: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0 [info] Loading project definition from D:\marathon-master\project Version '20170916T025229' is not fully supported, please update the git tags. [info] Set current project to marathon (in build file:/D:/marathon-master/) [info] Constructing RAML model java.lang.RuntimeException: Library cannot be resolved: D:\marathon

Docker on Mesos: Volume is placed on which node?

扶醉桌前 提交于 2019-12-11 20:24:55
问题 I will be setting up a Mesos cluster to run single-use docker jobs, e.g. long rapidminer computations. Of course I want to get the result of the computation, so I think I should use Docker volumes for that. Now, when I send a docker job to a cluster, specifying the volume for example in a JSON job file for Marathon or Chronos, where does the result of my computation land? I am guessing that it is put into the respective directory on the slave node, but do I really have to go into the Mesos