1.Formally, an RDD is a read-only, partitioned collection of records. RDDs can be only created through deterministic operations on either (1) a dataset in stable storage or (2) other existing RDDs.
2.RDD是延迟加载的，就是说直到action被触发，才真正有动作。
3. RDD之间的关系分为narrow dependency 和 wide dependency，看图很好理解
4.spark的scheuler会把程序逻辑和RDD变成DAG图来，分stage执行
相关推荐
Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing matei的论文
Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing.SPARK RDD论文
RDD分区调整、聚合函数、关联函数的算子运用
Resilient Distributed Datasets A Fault-Tolerant Abstraction for In-Memory Cluster Computing.pdf Shark Fast Data Analysis Using Coarse-grained Distributed Memory.pdf Shark SQL and Rich Analytics at ...
使用Spark和Hadoop为大数据领域开发应用程序。 本书还解释了Spark在利用云技术开发可扩展机器学习和分析应用程序中的作用。 从Apache Spark 2开始，向您介绍Apache Spark，并向您展示如何使用它。
Using Hystrix to Build Resilient Distributed Systems 1. Fault-tolerance pattern as a library 2. Provides operational insights in real-time 3. Automatic load-shedding under pressure 4. Initial design/...
spark RDD论文:Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing
Resilient Distributed Datasets(RDDs): 一个可以容错且分布式内存计算的抽象
Beginning Apache Spark 2: With Resilient Distributed Datasets, Spark SQL, Structured Streaming and Spark Machine Learning library
RDD，全称为Resilient Distributed Datasets，是一个容错的、并行的数据结构，可以让用户显式地将数据存储到磁盘和内存中，并能控制数据的分区。同时，RDD还提供了一组丰富的操作来操作这些数据。在这些操作中，诸如...
RDD（Resilient Distributed Datasets弹性分布式数据集）是一个容错的、并行的数据结构，可以简单的把RDD理解成一个提供了许多操作接口的数据集合，和一般数据集不同的是，其实际数据分布存储于一批机器中（内存或...
Along the way, you’ll discover resilient distributed datasets (RDDs); use Spark SQL for structured data; and learn stream processing and build real-time applications with Spark Structured
We also look at how to use Hive with Spark to use a SQL-like query syntax with Shark, as well as manipulating resilient distributed datasets (RDDs). What you will learn from this book Prototype ...
通过LSRP算法解 决数据倾斜问题，采用CRW 算法解决RDD（Resilient Distributed Datasets）重复利用以及缓存数据过多造成内存空 间不足问题．结果表明：与传统DBN相比，DDBN训练速度提高约2.3倍，通过LSRP和CRW大幅...
Analyze large data sets across many CPUs using Spark's Resilient Distributed Datasets Implement machine learning on Spark using the MLlib library Process continuous streams of data in real time using ...
RDD（Resilient Distributed Dataset）叫做弹性分布式数据集，是Spark中最基本的数据（计算）抽象。代码中是一个抽象类，它代表一个不可变、可分区、里面的元素可并行计算的集合。
K-弹性分布式系统 它使用 AWS Elastic Beanstalk 和 UDP 网络来构建分布式、可扩展和容错的会话维护网站。 AWS Elastic Beanstalk 用于创建和维护一组运行 Apache Tomcat 的负载平衡的应用程序服务器。...
Resilient Peer-to-Peer Streaming.
An Ultralow Latency and Failure Resilient Distributed File System for Shared Storage Cloud Database