Spark Streaming allows us to process large amounts of live data from multiple sources, in a scalable and fault tolerant manner. It is used widely to process for example live Twitter feeds, consume and process Kafka topic messages or data from Amazon S3, simple TCP sockets or custom input streams/feeds.

In many cases, we are perfectly […]