Re: TextSocketMicroBatchReader no longer supports nc utility

2018-06-05 Thread Jungtaek Lim
FYI: Filed https://issues.apache.org/jira/browse/SPARK-24466 and provided the patch https://github.com/apache/spark/pull/21497 2018년 6월 5일 (화) 오전 11:30, Jungtaek Lim 님이 작성: > Yeah that's why I initiated this thread, especially socket source is > expected to be used from examples on official docum

Re: TextSocketMicroBatchReader no longer supports nc utility

2018-06-04 Thread Jungtaek Lim
Yeah that's why I initiated this thread, especially socket source is expected to be used from examples on official document or some experiments, which we tend to simply use netcat. I'll file an issue and provide the fix. 2018년 6월 5일 (화) 오전 1:48, Joseph Torres 님이 작성: > I tend to agree that this i

Re: TextSocketMicroBatchReader no longer supports nc utility

2018-06-04 Thread Joseph Torres
I tend to agree that this is a bug. It's kinda silly that nc does this, but a socket connector that doesn't work with netcat will surely seem broken to users. It wouldn't be a huge change to defer opening the socket until a read is actually required. On Sun, Jun 3, 2018 at 9:55 PM, Jungtaek Lim w