SUMMARY.adoc

Summary

1. Introduction

2. Spark Streaming

3. StreamingContext

   1. Stream Operators

   2. Windowed Operators

   3. SaveAs Operators

   4. Stateful Operators

   5. PairDStreamFunctions

4. web UI and Streaming Statistics Page

5. Streaming Listeners

6. Checkpointing

7. JobScheduler

   1. InputInfoTracker

8. JobGenerator

9. DStreamGraph

10. Discretized Streams (DStreams)

    1. Input DStreams

    2. ReceiverInputDStreams

    3. ConstantInputDStreams

    4. ForEachDStreams

    5. WindowedDStreams

    6. MapWithStateDStreams

    7. StateDStreams

    8. TransformedDStream

11. Receivers

    1. ReceiverTracker

    2. ReceiverSupervisors

    3. ReceivedBlockHandlers

12. Ingesting Data from Kafka

    1. KafkaUtils — Creating Kafka DStreams and RDDs

    2. DirectKafkaInputDStream — Direct Kafka DStream

    3. ConsumerStrategy — Kafka Consumers' Post-Configuration API

       1. ConsumerStrategies Factory Object

    4. LocationStrategy — Preferred Hosts per Topic Partitions

    5. KafkaRDD

    6. HasOffsetRanges and OffsetRange

13. RecurringTimer

14. Backpressure

15. Dynamic Allocation (Elastic Scaling)

    1. ExecutorAllocationManager

16. StreamingSource

17. Settings