Skip to content Skip to sidebar Skip to footer
Showing posts with the label Spark Streaming

Slice Function In Dstream Spark Streaming Not Work

Spark streaming providing sliding window function for get rdd for last k. But I want to try use sli… Read more Slice Function In Dstream Spark Streaming Not Work

Spark Stream - 'utf8' Codec Can't Decode Bytes

I'm fairly new to stream programming. We have Kafka stream which use Avro. I want to connect a … Read more Spark Stream - 'utf8' Codec Can't Decode Bytes

Spark Python Avro Kafka Deserialiser

I have created a kafka stream in a python spark app and can parse any text that comes through it. … Read more Spark Python Avro Kafka Deserialiser