Intro

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It can run Hadoop, MPI, Hypertable, Spark, and other frameworks on a dynamically shared pool of nodes.

Documentation

• Mesos: https://mesos.apache.org/

• Apache: https://projects.apache.org/project.html?mesos

• 2015 - Apple Rebuilds Siri Backend Services Using Apache Mesos

Tips and Tidbits

• Mesos is built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos kernel runs on every machine and provides applications (e.g., Hadoop, Spark, Kafka, Elasticsearch) with API’s for resource management and scheduling across entire datacenter and cloud environments.

• Native support for launching containers with Docker and AppC images.

• Aurora leverages the Apache Mesos cluster manager, which provides information about the state of the cluster. Aurora uses that knowledge to make scheduling decisions.

  • For example, when a machine experiences failure Aurora automatically reschedules those previously-running services onto a healthy machine in order to keep them running.