Streaming

These articles can help you with Structured Streaming and Spark Streaming (the legacy Apache Spark streaming feature).

• Apache Spark DStream is not supported
• Append output is not supported without a watermark
• Checkpoint files not being deleted when using display()
• Checkpoint files not being deleted when using foreachBatch()
• Conflicting directory structures error
• Get the path of files consumed by Auto Loader
• How to restart a structured streaming query from last written offset
• Kafka error: No resolvable bootstrap urls
• readStream() is not whitelisted error when running a query
• RocksDB fails to acquire a lock
• Streaming job gets stuck writing to checkpoint
• Streaming with File Sink: Problems with recovery if you change checkpoint or output directories