Moving Hadoop to the Cloud: Harnessing Cloud Features and Flexibility for Hadoop Clusters

"O'Reilly Media, Inc."
Free sample

Until recently, Hadoop deployments existed on hardware owned and run by organizations. Now, of course, you can acquire the computing resources and network connectivity to run Hadoop clusters in the cloud. But there’s a lot more to deploying Hadoop to the public cloud than simply renting machines.

This hands-on guide shows developers and systems administrators familiar with Hadoop how to install, use, and manage cloud-born clusters efficiently. You’ll learn how to architect clusters that work with cloud-provider features—not just to avoid pitfalls, but also to take full advantage of these services. You’ll also compare the Amazon, Google, and Microsoft clouds, and learn how to set up clusters in each of them.

  • Learn how Hadoop clusters run in the cloud, the problems they can help you solve, and their potential drawbacks
  • Examine the common concepts of cloud providers, including compute capabilities, networking and security, and storage
  • Build a functional Hadoop cluster on cloud infrastructure, and learn what the major providers require
  • Explore use cases for high availability, relational data with Hive, and complex analytics with Spark
  • Get patterns and practices for running cloud clusters, from designing for price and security to dealing with maintenance
Read more

About the author

Bill Havanki is a software engineer working for Cloudera, where he has contributed to Hadoop components as well as systems for deploying Hadoop clusters into public Cloud services. Prior to joining Cloudera he worked for 15 years developing software for government contracts, focusing mostly on analytic frameworks and authentication and authorization systems. He earned his B.S. in Electrical Engineering from Rutgers University and his M.S. in Computer Engineering from North Carolina State University. A New Jersey native, he currently lives near Annapolis, Maryland with his family.

Read more



Additional Information

"O'Reilly Media, Inc."
Read more
Published on
Jul 14, 2017
Read more
Read more
Read more
Read more
Computers / Data Processing
Computers / Databases / Servers
Computers / Enterprise Applications / General
Computers / Information Technology
Computers / Management Information Systems
Computers / Systems Architecture / Distributed Systems & Computing
Read more
Content Protection
This content is DRM free.
Read more
Read Aloud
Available on Android devices
Read more
Eligible for Family Library

Reading information

Smartphones and Tablets

Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.

Laptops and Computers

You can read books purchased on Google Play using your computer's web browser.

eReaders and other devices

To read on e-ink devices like the Sony eReader or Barnes & Noble Nook, you'll need to download a file and transfer it to your device. Please follow the detailed Help center instructions to transfer the files to supported eReaders.
Achieve streamlined, rapid production with enterprise-level DevOps

Awarded DevOps 2017 Book of the Year, The DevOps Adoption Playbook provides practical, actionable, real-world guidance on implementing DevOps at enterprise scale. Author Sanjeev Sharma heads the DevOps practice for IBM; in this book, he provides unique guidance and insight on implementing DevOps at large organizations. Most DevOps literature is aimed at startups, but enterprises have unique needs, capabilities, limitations, and challenges; "DevOps for startups" doesn't work at this scale, but the DevOps paradigm can revolutionize enterprise IT. Deliver high-value applications and systems with velocity and agility by adopting the necessary practices, automation tools, and organizational and cultural changes that lead to innovation through rapid experimentation. Speed is an advantage in the face of competition, but it must never come at the expense of quality; DevOps allows your organization to keep both by intersecting development, quality assurance, and operations.

Enterprise-level DevOps comes with its own set of challenges, but this book shows you just how easily they are overcome. With a slight shift in perspective, your organization can stay ahead of the competition while keeping costs, risks, and quality under control.ï¿1⁄2ï¿1⁄2 Grasp the full extent of the DevOps impact on IT organizations Achieve high-value innovation and optimization with low cost and risk Exceed traditional business goals with higher product release efficiency Implement DevOps in large-scale enterprise IT environments

DevOps has been one of IT's hottest trends for the past decade, and plenty of success stories testify to its effectiveness in organizations of any size, industry, or level of IT maturity, all around the world. The DevOps Adoption Playbook shows you how to get your organization on board so you can slip production into the fast lane and innovate your way to the top.

Bring the best out of DevOps and build, deploy, and maintain applications on AWSAbout This BookWork through practical examples and gain DevOps best practices to successfully deploy applications on AWSSuccessfully provision and operate distributed application systems and your AWS infrastructure using DevOpsPerform Continuous Integration and deployment and fine-tune the way you deliver on AWSWho This Book Is For

This book is for system administrators and developers who manage AWS infrastructure and environments and are planning to implement DevOps in their organizations. Those aiming for the AWS Certified DevOps Engineer certification will also find this book useful. Prior experience of operating and managing AWS environments is expected.

What You Will LearnDesign and deploy infrastructure as code within your AWS Virtual Private CloudImplement Continuous Integration using AWS ServicesConfigure EC2 instances using SaltStackImplement Continuous Deployment using Jenkins and the AWS CLICollect important metrics and log data to gain more insight into infrastructure and applicationsTroubleshooting popular issues with some less known techniques using the AWS platformIn Detail

Knowing how to adopt DevOps in your organization is becoming an increasingly important skill for developers, whether you work for a start-up, an SMB, or an enterprise.

This book will help you to drastically reduce the amount of time spent on development and increase the reliability of your software deployments on AWS using popular DevOps methods of automation.

To start, you will get familiar with the concept of IaC and will learn to design, deploy, and maintain AWS infrastructure. Further on, you'll see how to design and deploy a Continuous Integration platform on AWS using either open source or AWS provided tools/services.

Following on from the delivery part of the process, you will learn how to deploy a newly created, tested, and verified artefact to the AWS infrastructure without manual intervention. You will then find out what to consider in order to make the implementation of Configuration Management easier and more effective.

Toward the end of the book, you will learn some tricks and tips to optimize and secure your AWS environment. By the end of the book, you will have mastered the art of implementing DevOps practices onto AWS.

Style and approach

This book is packed full of real-world examples demonstrating use cases that help you deploy DevOps best practices on AWS.

Invoice verification is an important business process in almost every company. In SAP you can verify invoices against purchase orders and goods receipts. SAP provides important functionalities like automatic account determination, financial posting, etc. SAP is powerful software that can meet the needs of any business scenario for any type of business in any part of the world. Its all encompassing nature makes SAP complex. In order to derive maximum benefit for business, SAP must be understood well. Mr. Agrawal attempts to explain SAP completely; a seemingly impossible task. This is his third book on the Materials Management module; his first two books in the Materials Management module are ‘Purchasing’ and ‘Inventory Management’. In this book, like in his earlier books, he explains every screen of SAP MM Invoice Verification. Both the SAP Menu and Customizing Implementation Guide are expanded and the chapter number where they are covered is indicated. This not only creates a direct link between the book and the SAP software, but also ensures that the book is comprehensive. The author has taken care to balance details with overviews that explain linkages between concepts. The book is organized in chapters that are important business activities. Each chapter covers business processes carried out in SAP by the user as well as its related configuration. This book can be used to learn SAP from scratch; it is a learning guide. It is, therefore, useful to persons who are training to be SAP Consultants. Having learnt SAP with the help of this book, the Consultant keeps returning to refer to it. In implementation of SAP, Consultants prepare User Manual. With the availability of this book, their task becomes simpler. In the User Manual, they need to cover only implementation specific points. The user refers to this book as a generic User Manual. As the user gains knowledge he also begins to understand the customizing settings for his implementation. This book can also be used by Business Process Owners and Senior Managers to get an overview of SAP and the important choices it offers.
©2018 GoogleSite Terms of ServicePrivacyDevelopersArtistsAbout Google
By purchasing this item, you are transacting with Google Payments and agreeing to the Google Payments Terms of Service and Privacy Notice.