Data Science on the Google Cloud Platform: Implementing End-to-End Real-Time Data Pipelines: From Ingest to Machine Learning

"O'Reilly Media, Inc."
1
Free sample

Learn how easy it is to apply sophisticated statistical and machine learning methods to real-world problems when you build on top of the Google Cloud Platform (GCP). This hands-on guide shows developers entering the data science field how to implement an end-to-end data pipeline, using statistical and machine learning methods and tools on GCP. Through the course of the book, you’ll work through a sample business decision by employing a variety of data science approaches.

Follow along by implementing these statistical and machine learning solutions in your own project on GCP, and discover how this platform provides a transformative and more collaborative way of doing data science.

You’ll learn how to:

  • Automate and schedule data ingest, using an App Engine application
  • Create and populate a dashboard in Google Data Studio
  • Build a real-time analysis pipeline to carry out streaming analytics
  • Conduct interactive data exploration with Google BigQuery
  • Create a Bayesian model on a Cloud Dataproc cluster
  • Build a logistic regression machine-learning model with Spark
  • Compute time-aggregate features with a Cloud Dataflow pipeline
  • Create a high-performing prediction model with TensorFlow
  • Use your deployed model as a microservice you can access from both batch and real-time pipelines
Read more
Collapse

About the author

Valliappa (Lak) Lakshmanan is currently a Tech Lead for Data and Machine Learning Professional Services for Google Cloud. His mission is to democratize machine learning so that it can be done by anyone anywhere using Google's amazing infrastructure, without deep knowledge of statistics or programming or ownership of a lot of hardware. Before Google, he led a team of data scientists at the Climate Corporation and was a Research Scientist at NOAA National Severe Storms Laboratory, working on machine learning applications for severe weather diagnosis and prediction.

Read more
Collapse
5.0
1 total
Loading...

Additional Information

Publisher
"O'Reilly Media, Inc."
Read more
Collapse
Published on
Dec 12, 2017
Read more
Collapse
Pages
410
Read more
Collapse
ISBN
9781491974513
Read more
Collapse
Read more
Collapse
Read more
Collapse
Language
English
Read more
Collapse
Genres
Computers / Data Modeling & Design
Computers / Data Processing
Computers / Databases / General
Read more
Collapse
Content Protection
This content is DRM free.
Read more
Collapse
Read Aloud
Available on Android devices
Read more
Collapse
Eligible for Family Library

Reading information

Smartphones and Tablets

Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.

Laptops and Computers

You can read books purchased on Google Play using your computer's web browser.

eReaders and other devices

To read on e-ink devices like the Sony eReader or Barnes & Noble Nook, you'll need to download a file and transfer it to your device. Please follow the detailed Help center instructions to transfer the files to supported eReaders.
Start making better business decisions backed by dataAbout This BookPredict new opportunities and risks in a few mouse clicksEliminate complexity with tools that let you plan, analyze, and collaborate in context—in real timeDiscover, visualize, plan, and predict in a single product with agile BI toolsWho This Book Is For

This book targets IT professionals, business analysts, BI developers, managers, newcomers to SAP Analytics Cloud, and ultimately anyone who wants to learn from self-paced, professional guidance and needs a solid foundation in SAP Analytics Cloud.

What You Will LearnA clear understanding of SAP Analytics Cloud platformCreate data models using different data sources, including Excel and text files .Present professional analyses using different types of charts, tables, geo maps, and moreUsing stories, drill up and down instantly to analyze data from various anglesShare completed stories with other team members or compile them in SAP Digital Boardroom agendas for presentation to major stakeholdersExport the results of a story to a PDF fileSave time by planning, analyzing, predicting, and collaborating in contextDiscover, visualize, plan, and predict in one product as opposed to separate solutionsIn Detail

The book starts with the basics of SAP Analytics Cloud (formerly known as SAP BusinessObjects Cloud) and exposes almost every significant feature a beginner needs to master. Packed with illustrations and short, essential, to-the-point descriptions, the book provides a unique learning experience. Your journey of exploration starts with a basic introduction to the SAP Analytics Cloud platform. You will then learn about different segments of the product, such as Models, Stories, Digital Boardroom, and so on. Then, you are introduced to the product's interface: the Home screen, the main menu, and more. Then comes the hands-on aspect of the book, which starts with model creation. Next, you learn how to utilize a model to prepare different types of stories(reports) with the help of charts, tables, Geo Maps, and more. In the final chapters of this book, you will learn about Digital Boardroom, Collaboration, and Administration.

Style and approach

The easy-to-follow visual instructions provided in this book help business users and report developers create simple and complex stories (reports) quickly

A comprehensive guide to design, build and execute effective Big Data strategies using HadoopKey Features-Get an in-depth view of the Apache Hadoop ecosystem and an overview of the architectural patterns pertaining to the popular Big Data platform-Conquer different data processing and analytics challenges using a multitude of tools such as Apache Spark, Elasticsearch, Tableau and more-A comprehensive, step-by-step guide that will teach you everything you need to know, to be an expert Hadoop ArchitectBook Description

The complex structure of data these days requires sophisticated solutions for data transformation, to make the information more accessible to the users.This book empowers you to build such solutions with relative ease with the help of Apache Hadoop, along with a host of other Big Data tools.

This book will give you a complete understanding of the data lifecycle management with Hadoop, followed by modeling of structured and unstructured data in Hadoop. It will also show you how to design real-time streaming pipelines by leveraging tools such as Apache Spark, and build efficient enterprise search solutions using Elasticsearch. You will learn to build enterprise-grade analytics solutions on Hadoop, and how to visualize your data using tools such as Apache Superset. This book also covers techniques for deploying your Big Data solutions on the cloud Apache Ambari, as well as expert techniques for managing and administering your Hadoop cluster.

By the end of this book, you will have all the knowledge you need to build expert Big Data systems.

What you will learn Build an efficient enterprise Big Data strategy centered around Apache Hadoop Gain a thorough understanding of using Hadoop with various Big Data frameworks such as Apache Spark, Elasticsearch and more Set up and deploy your Big Data environment on premises or on the cloud with Apache AmbariDesign effective streaming data pipelines and build your own enterprise search solutions Utilize the historical data to build your analytics solutions and visualize them using popular tools such as Apache Superset Plan, set up and administer your Hadoop cluster efficientlyWho this book is for

This book is for Big Data professionals who want to fast-track their career in the Hadoop industry and become an expert Big Data architect. Project managers and mainframe professionals looking forward to build a career in Big Data Hadoop will also find this book to be useful. Some understanding of Hadoop is required to get the best out of this book.

Combine the power of analytics and cloud computing for faster and efficient insightsKey FeaturesMaster the concept of analytics on the cloud: and how organizations are using itLearn the design considerations and while applying a cloud analytics solutionDesign an end-to-end analytics pipeline on the cloudBook Description

With the ongoing data explosion, more and more organizations all over the world are slowly migrating their infrastructure to the cloud. These cloud platforms also provide their distinct analytics services to help you get faster insights from your data.

This book will give you an introduction to the concept of analytics on the cloud, and the different cloud services popularly used for processing and analyzing data. If you’re planning to adopt the cloud analytics model for your business, this book will help you understand the design and business considerations to be kept in mind, and choose the best tools and alternatives for analytics, based on your requirements. The chapters in this book will take you through the 70+ services available in Google Cloud Platform and their implementation for practical purposes. From ingestion to processing your data, this book contains best practices on building an end-to-end analytics pipeline on the cloud by leveraging popular concepts such as machine learning and deep learning.

By the end of this book, you will have a better understanding of cloud analytics as a concept as well as a practical know-how of its implementation

What you will learn Explore the basics of cloud analytics and the major cloud solutions Learn how organizations are using cloud analytics to improve the ROI Explore the design considerations while adopting cloud services Work with the ingestion and storage tools of GCP such as Cloud Pub/Sub Process your data with tools such as Cloud Dataproc, BigQuery, etcOver 70 GCP tools to build an analytics engine for cloud analytics Implement machine learning and other AI techniques on GCP Who this book is for

This book is targeted at CIOs, CTOs, and even analytics professionals looking for various alternatives to implement their analytics pipeline on the cloud. Data professionals looking to get started with cloud-based analytics will also find this book useful. Some basic exposure to cloud platforms such as GCP will be helpful, but not mandatory.

Develop and manage effective real-time streaming solutions by leveraging the power of Microsoft AzureAbout This BookAnalyze your data from various sources using Microsoft Azure Stream AnalyticsDevelop, manage and automate your stream analytics solution with Microsoft AzureA practical guide to real-time event processing and performing analytics on the cloudWho This Book Is For

If you are looking for a resource that teaches you how to process continuous streams of data in real-time, this book is what you need. A basic understanding of the concepts in analytics is all you need to get started with this book

What You Will LearnPerform real-time event processing with Azure Stream AnalysisIncorporate the features of Big Data Lambda architecture pattern in real-time data processingDesign a streaming pipeline for storage and batch analysisImplement data transformation and computation activities over stream of eventsAutomate your streaming pipeline using Powershell and the .NET SDKIntegrate your streaming pipeline with popular Machine Learning and Predictive Analytics modelling algorithmsMonitor and troubleshoot your Azure Streaming jobs effectivelyIn Detail

Microsoft Azure is a very popular cloud computing service used by many organizations around the world. Its latest analytics offering, Stream Analytics, allows you to process and get actionable insights from different kinds of data in real-time.

This book is your guide to understanding the basics of how Azure Stream Analytics works, and building your own analytics solution using its capabilities. You will start with understanding what Stream Analytics is, and why it is a popular choice for getting real-time insights from data. Then, you will be introduced to Azure Stream Analytics, and see how you can use the tools and functions in Azure to develop your own Streaming Analytics. Over the course of the book, you will be given comparative analytic guidance on using Azure Streaming with other Microsoft Data Platform resources such as Big Data Lambda Architecture integration for real time data analysis and differences of scenarios for architecture designing with Azure HDInsight Hadoop clusters with Storm or Stream Analytics. The book also shows you how you can manage, monitor, and scale your solution for optimal performance.

By the end of this book, you will be well-versed in using Azure Stream Analytics to develop an efficient analytics solution that can work with any type of data.

Style and approach

A comprehensive guidance on developing real-time event processing with Azure Stream Analysis

Information Technology professionals can use this book to move beyond the excitement of web services and service oriented architecture (SOA) and begin the process of finding actionable ideas to innovate and create business value. In Enterprise SOA: Designing IT for Business Innovation, SAP's blueprint for putting SOA to work is analyzed from top to bottom. In addition to design, development, and architecture, vital contextual issues such as governance, security, change management, and culture are also explored. This comprehensive perspective reduces risk as IT departments implement ESA, a sound, flexible architecture for adapting business processes in response to changing market conditions.

This book answers the following questions:

What forces created the need for Enterprise Services Architecture?How does ESA enable business process innovation?How is model-driven development used at all levels of design, configuration, and deployment?How do all the layers of technology that support ESA work together?How will composite applications extend business process automation?How does ESA create new models for IT governance?How can companies manage disruptive change?How can enterprise services be discovered and designed?How will the process of adapting applications be simplified?

Based on extensive research with experts from the German software company SAP, this definitive book is ideal for architects, developers, and other IT professionals who want to understand the technology and business relevance of ESA in a detailed way--especially those who want to move on the technology now, rather than in the next year or two.

A New York Times Bestseller

An audacious, irreverent investigation of human behavior—and a first look at a revolution in the making
 
Our personal data has been used to spy on us, hire and fire us, and sell us stuff we don’t need. In Dataclysm, Christian Rudder uses it to show us who we truly are.
 
For centuries, we’ve relied on polling or small-scale lab experiments to study human behavior. Today, a new approach is possible. As we live more of our lives online, researchers can finally observe us directly, in vast numbers, and without filters. Data scientists have become the new demographers.
 
In this daring and original book, Rudder explains how Facebook "likes" can predict, with surprising accuracy, a person’s sexual orientation and even intelligence; how attractive women receive exponentially more interview requests; and why you must have haters to be hot. He charts the rise and fall of America’s most reviled word through Google Search and examines the new dynamics of collaborative rage on Twitter. He shows how people express themselves, both privately and publicly. What is the least Asian thing you can say? Do people bathe more in Vermont or New Jersey? What do black women think about Simon & Garfunkel? (Hint: they don’t think about Simon & Garfunkel.) Rudder also traces human migration over time, showing how groups of people move from certain small towns to the same big cities across the globe. And he grapples with the challenge of maintaining privacy in a world where these explorations are possible.
 
Visually arresting and full of wit and insight, Dataclysm is a new way of seeing ourselves—a brilliant alchemy, in which math is made human and numbers become the narrative of our time.
©2019 GoogleSite Terms of ServicePrivacyDevelopersArtistsAbout Google|Location: United StatesLanguage: English (United States)
By purchasing this item, you are transacting with Google Payments and agreeing to the Google Payments Terms of Service and Privacy Notice.