Hands-On Big Data Analytics with PySpark: Analyze large datasets and discover techniques for testing, immunizing, and parallelizing Spark jobs 9781838644130, 9781786463708, 9781788835367, 183864413X
Use PySpark to easily crush messy data at-scale and discover proven techniques to create testable, immutable, and easily
1,906 123 5MB
English Pages 182 Year 2019
Table of contents :
Table of ContentsInstalling Pyspark and Setting up Your Development EnvironmentGetting Your Big Data into the Spark Environment Using RDDsBig Data Cleaning and Wrangling with Spark NotebooksAggregating and Summarizing Data into Useful ReportsPowerful Exploratory Data Analysis with MLlibPutting Structure on Your Big Data with SparkSQLTransformations and ActionsImmutable DesignAvoiding Shuffle and Reducing Operational ExpensesSaving Data in the Correct FormatWorking with the Spark Key/Value APITesting Apache Spark JobsLeveraging the Spark GraphX API
Table of ContentsInstalling Pyspark and Setting up Your Development EnvironmentGetting Your Big Data into the Spark Environment Using RDDsBig Data Cleaning and Wrangling with Spark NotebooksAggregating and Summarizing Data into Useful ReportsPowerful Exploratory Data Analysis with MLlibPutting Structure on Your Big Data with SparkSQLTransformations and ActionsImmutable DesignAvoiding Shuffle and Reducing Operational ExpensesSaving Data in the Correct FormatWorking with the Spark Key/Value APITesting Apache Spark JobsLeveraging the Spark GraphX API
- Author / Uploaded
- Lai
- Rudy;Potaczek
- Bartlomiej
![Data Algorithms with Spark: Recipes and Design Patterns for Scaling Up using PySpark [1 ed.]
1492082384, 9781492082385](https://ebin.pub/img/200x200/data-algorithms-with-spark-recipes-and-design-patterns-for-scaling-up-using-pyspark-1nbsped-1492082384-9781492082385.jpg)