Apache Mesos Cookbook

David Blomquist · Tomasz Janiszewski

Aug 2017 · Packt Publishing Ltd

About this ebook

Over 50 recipes on the core features of Apache Mesos and running big data frameworks in MesosAbout This BookLearn to install and configure Mesos to suit the needs of your organizationFollow step-by-step instructions to deploy application frameworks on top of Mesos, saving you many hours of research and trial and errorUse this practical guide packed with powerful recipes to implement Mesos and easily integrate it with other application frameworksWho This Book Is For

This book is for system administrators, engineers, and big data programmers. Basic experience with big data technologies such as Hadoop or Spark would be useful but is not essential. A working knowledge of Apache Mesos is expected.

What You Will LearnSet up Mesos on different operating systemsUse the Marathon and Chronos frameworks to manage multiple applicationsWork with Mesos and DockerIntegrate Mesos with Spark and other big data frameworksUse networking features in Mesos for effective communication between containersConfigure Mesos for high availability using ZookeeperSecure your Mesos clusters with SASL and Authorization ACLsSolve everyday problems and discover the best practicesIn Detail

Apache Mesos is open source cluster sharing and management software. Deploying and managing scalable applications in large-scale clustered environments can be difficult, but Apache Mesos makes it easier with efficient resource isolation and sharing across application frameworks.

The goal of this book is to guide you through the practical implementation of the Mesos core along with a number of Mesos supported frameworks. You will begin by installing Mesos and then learn how to configure clusters and maintain them. You will also see how to deploy a cluster in a production environment with high availability using Zookeeper.

Next, you will get to grips with using Mesos, Marathon, and Docker to build and deploy a PaaS. You will see how to schedule jobs with Chronos. We'll demonstrate how to integrate Mesos with big data frameworks such as Spark, Hadoop, and Storm. Practical solutions backed with clear examples will also show you how to deploy elastic big data jobs.

You will find out how to deploy a scalable continuous integration and delivery system on Mesos with Jenkins. Finally, you will configure and deploy a highly scalable distributed search engine with ElasticSearch.

Throughout the course of this book, you will get to know tips and tricks along with best practices to follow when working with Mesos.

Style and approach

This step-by-step guide is packed with powerful recipes on using Apache Mesos and shows its integration with containers and big data frameworks.

About the author

David Blomquist been working with computers since the 1980s. His first computer was an Apple Macintosh and the first networked computer he managed was a 10 terminal Xenix system. Since that time, David has held positions in virtually every area of IT, including operations, development, and architecture. David now specializes in designing Big Data, HPC, and Grid Computing systems with applications in Health Care and Science. Most recently, he has designed and deployed several large-scale clusters for the Federal Government.

Tomasz Janiszewski is a software engineer passionate about distributed systems. He believes in free and open source philosophy and occasionally contributes to projects on GitHub. He actively participate in Mesos community and spread his knowledge on mailing list and StackOverflow. He is involved in Marathon development and building PaaS on top of Mesos and Marathon.