Skip to content
Advertisement

Tag: spark-streaming

Checkpoint with spark file streaming in java

I want to implement checkpoint with spark file streaming application to process all unprocessed files from hadoop if in any case my spark streaming application stop/terminates. I am following this : streaming programming guide, but not found JavaStreamingContextFactory. Please help me what should I do. My Code is Answer You must use Checkpointing For checkpointing use stateful transformations either updateStateByKey

Advertisement