A book designed for SysAdmins, Operations staff, Developers and DevOps who are interested in deploying a log management solution using the open source Elasticsearch, Logstash & Kibana (ELK) stack.
In this book we will walk you through installing, deploying, managing and extending Logstash. We're going to do that by introducing you to Example.com, where you're going to start a new job as one of its SysAdmins. The first project you'll be in charge of is developing its new log management solution.
We'll teach you how to:
* Install and deploy Logstash.
* Ship events from a Logstash Shipper to a central Logstash server.
* Filter incoming events using a variety of techniques.
* Add structured logging to your applications.
* Output those events to a selection of useful destinations.
* Use Logstash's awesome web interface Kibana.
* Scale out your Logstash implementation as your environment grows.
* Quickly and easily extend Logstash to deliver additional functionality that you might need.
By the end of the book, you should have a functional and effective log management solution that you can deploy into your own environment.
Updated for Logstash and ELK 5.0.0!
James Turnbull is the author of numerous technical books about engineering and infrastructure and is a long-time member of the open source community.
James is currently CTO at Empatico, an education technology start-up in New York. He was previously CTO at Kickstarter, VP of Services at Docker Inc, VP of Engineering at Venmo and at Puppet Labs running Operations and Professional Services.
Docker book designed for SysAdmins, Operations staff, Developers and DevOps who are interested in deploying the open source container service Docker.
In this book, we'll walk you through installing, deploying, managing, and extending Docker. We're going to do that by first introducing you to the basics of Docker and its components. Then we'll start to use Docker to build containers and services to perform a variety of tasks.
We're going to take you through the development life cycle, from testing to production, and see where Docker fits in and how it can make your life easier. We'll make use of Docker to build test environments for new projects, demonstrate how to integrate Docker with continuous integration workflow, and then how to build application services and platforms. Finally, we'll show you how to use Docker's API and how to extend Docker yourself.
We'll teach you how to:
* Install Docker.
* Take your first steps with a Docker container.
* Build Docker images.
* Manage and share Docker images.
* Run and manage more complex Docker containers.
* Deploy Docker containers as part of your testing pipeline.
* Build multi-container applications and environments.
* Learn about orchestration using Compose and Swarm for the orchestration of Docker containers and Consul for service discovery.
* Explore the Docker API.
* Getting Help and Extending Docker.
In this collection of essays and articles, key members of Google’s Site Reliability Team explain how and why their commitment to the entire lifecycle has enabled the company to successfully build, deploy, monitor, and maintain some of the largest software systems in the world. You’ll learn the principles and practices that enable Google engineers to make systems more scalable, reliable, and efficient—lessons directly applicable to your organization.
This book is divided into four sections:Introduction—Learn what site reliability engineering is and why it differs from conventional IT industry practicesPrinciples—Examine the patterns, behaviors, and areas of concern that influence the work of a site reliability engineer (SRE)Practices—Understand the theory and practice of an SRE’s day-to-day work: building and operating large distributed computing systemsManagement—Explore Google's best practices for training, communication, and meetings that your organization can use
In the Guide, you'll learn how to:
-Copy, move, and delete files and directories.
-Create, delete, and manage users.
-Create, delete, and manage groups.
-Use virtual terminals.
-Use the bash shell.
-Safely use the root account with su and sudo.
-Change permissions and ownership of files and directories.
-Create and edit text files from the command line, without using a graphical editor.
-Diagnose network connectivity problems.
-And many other topics.
The books real-world configurations and supporting materials will enable you to deploy Nagios and integrate other tools (like MRTG and Snort) on a helpful step-by-step basis. Integrating Nagios with a variety of other tools can add more functionality to its internal monitoring and alerting capabilities. The book covers additional topics like security, redundancy and failover, and plug-in development. And it shows you how to create your own Nagios plug-ins, to monitor devices for which Nagios may not provide plug-ins.
Gruntwork co-founder Yevgeniy (Jim) Brikman walks you through dozens of code examples that demonstrate how to use Terraform’s simple, declarative programming language to deploy and manage infrastructure with just a few commands. Whether you’re a novice developer, aspiring DevOps engineer, or veteran sysadmin, this book will take you from Terraform basics to running a full tech stack capable of supporting a massive amount of traffic and a large team of developers.Compare Terraform to other IAC tools, such as Chef, Puppet, Ansible, and Salt StackUse Terraform to deploy server clusters, load balancers, and databasesLearn how Terraform manages the state of your infrastructure and how it impacts file layout, isolation, and lockingCreate reusable infrastructure with Terraform modulesTry out advanced Terraform syntax to implement loops, if-statements, and zero-downtime deploymentUse Terraform as a team, including best practices for writing, testing, and versioning Terraform code
In the book we'll deliver:
* An introduction to monitoring, metrics and measurement.
* A scalable framework for monitoring hosts (including Docker and containers), services and applications built on top of the Riemann event stream processor.
* Graphing and metric storage using Graphite and Grafana.
* Logging with Logstash.
* A framework for high quality and useful notifications
* Techniques for developing and building monitorable applications
* A capstone that puts all the pieces together to monitor a multi-tier application.