thanks jay. do you think spark is a good fit for handling streaming &
analyzing videos in real time? in this case, we're streaming 30 frames per
second, and each frame is an image (size: roughly 500K - 1MB). we need to
analyze every frame and return the analysis result back instantly in real
ti
a REAL TIME stream, by definition, delivers data every X seconds. you can
easily do this with spark. roughly here is the way to create a stream
gobbler and attach a spark app to read its data every X seconds
- Write a Runnable thread which reads data from a source. Test that it
works indepen