How should I manage deployments with kubernetes

Question

I am hoping to find a good way to automate the process of going from code to a deployed application on my kubernetes cluster.

In order to build and deploy my app I need

Answer 1

I suppose I could just write a shell script that runs all of these commands, and run it whenever I want to start up a new deployment, but I am hoping there is a better/industry standard way to solve these problems that I have missed.

The company I work for (Weaveworks) and other folks in the space had been advocating for an approach that we call GitOps, please take a look at our series of blog posts covering the topic:

• GitOps - Operations by Pull Request
• The GitOps Pipeline - Part 2
• GitOps Part 3 - Observability
• Storing Secure Sealed Secrets using GitOps

The gist of it is that you push images from CI, your checked YAML manifests in git (usually different repo from app code). This repo with manifests is then applied to each of your clusters (dev/prod) by a reconciliation operator. You can automate it all yourself quite easily, but also do take a look at what we have built.

---

Disclaimer: I am a Kubernetes contributor and Weaveworks employee. We build open-source and commercial tools that help people to get to production with Kubernetes sooner.

Answer 2

We're working on an open source project called Jenkins X which is a proposed sub project of the Jenkins foundation aimed at automating CI/CD on Kubernetes using Jenkins and GitOps for promotion.

When you merge a change to the master branch, Jenkins X creates a new semantically versioned distribution of your app (pom.xml, jar, docker image, helm chart). The pipeline then automates the generation of Pull Requests to promote your application through all of the Environments via GitOps.

Here's a demo of how to automate CI/CD with multiple environments on Kubernetes using GitOps for promotion between environments and Preview Environments on Pull Requests - using Spring Boot and nodejs apps (but we support many languages + frameworks).

Answer 3

My colleague has a good blog post about this topic:

http://blog.jonparrott.com/building-a-paas-on-kubernetes/

Basically, Kubernetes is not a Platform-as-a-Service, it's a toolkit on which you can build your own Platform-a-as-Service. It's not very opinionated by design, instead it focuses on solving some tricky problems with scheduling, networking, and coordinating containers, and lets you layer in your opinions on top of it.

One of the simplest ways to automate the workflows you're describing is using a Makefile.

A step up from that, you can design your own miniature PaaS, which the author of the first blog post did here:

https://github.com/jonparrott/noel

Or, you could get involved in more sophisticated efforts to build an open source PaaS on Kubernetes, like OpenShift:

https://www.openshift.com/

or Deis, which is building a Heroku-like platform on Kubernetes:

https://deis.com/

or Redspread, which is building "Git for Kubernetes cluster":

https://redspread.com/

and there are many other examples of people building PaaS on top of Kubernetes. But I think it will be a long time, if ever, that there is an "industry standard" way to deploy to Kubernetes, since half the purpose is to enable multiple deployment workflows for different use cases.

I do want to note that as far as building container images, Google Cloud Container Builder can be a useful tool, since you can do things like use it to automatically build an image any time you push to a repository which could then get deployed. Alternatively, Jenkins is a popular way to automate CI/CD flows with Kubernetes.