The devices and device messages are retrieved using the APIs provided by company X (not the company's real name), which owns the IoT network. There is the option of setting HTTP POST callbacks for device messages, but we want to be able to run analytics on messages of ALL the devices of the network. Since the devices are owned by clients and we can't force all clients to set callbacks on their devices, our only option remains to use this GET API. In fact, there are other APIs by company X and many of them are paged. Of course, this is a major issue that should be addressed soon.
-- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org