The file being read is coming from S3. Each IgniteCallable is using the S3ObjectInputStream provided by AWS SDK to read their respective block of data and load it to cache using DataStreamer API. It's basically the same way a Map job in Hadoop will read a file from S3.
I'm not sure I understand your statement "reading a line from local file is faster than updating a remote node." Are you saying I should first download the file to a local node's hard disk, and then use one DataStreamer to add it to the cache? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Super-slow-data-loading-performance-when-more-nodes-added-tp1105p1118.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
