根据市场上目前比较流行的几款Hadoop产品综合分析，从部署的便捷性、功能、性能及成本等方面综合考量，推荐使用CDH与HDP。然后再根据我们具体的使用场景来进行选择，如果我们追求功能全面与部署案例参考推荐使用CDH，因为CDH目前是市场上功能最全、部署案例最多的一款产品，如果我们追求部署快捷，易上手使用推荐使用HDP，因为HDP是迄今为止100%纯开源ApacheHadoop的唯一提供商并且是第一家使用了ApacheHCatalog的元数据服务特性的提供商。并且，它们的Stinger开创性地极大地优化了Hive项目。Hortonworks为入门提供了一个非常好的，易于使用的沙盒。

12.1 Spark概述 12.2 Spark生态系统 12.3 Spark运行架构 12.3 Spark SQL 12.3 Spark的部署和应用方式

spark介绍-蘑菇街.pdf

Spark部署中的关键问题解决之道--许鹏.pdf

A Web Application for Interactive Data Analysis with Spark

A Web Application for Interactive Data Analysis with Spark

Interface Design for Spark Community by Reynold Xin.pdf

基于Spark的支持隐私保护的聚类算法.pdf

sparkdemo_202108.7z

We designed this book mainly for data scientists and data engineers looking to use Apache Spark. The two roles have slightly different needs, but in reality, most application development covers a bit of both, so we think the material will be useful in both cases. Specifically, in our minds, the data scientist workload focuses more on interactively querying data to answer questions and build statistical models, while the data engineer job focuses on writing maintainable, repeatable production applications-either to use the data scientist’s models in practice, or just to prepare data for further analysis (e.g., building a data ingest pipeline). However, we often see with Spark that these roles blur. For instance, data scientists are able to package production applications without too much hassle and data engineers use interactive analysis to understand and inspect their data to build and maintain pipelines.