HI,
I actually encountered this corner case and I think it is not that uncommon.
In my case, I was writing a write only source which used some library to write
to a database. I didn’t want to have to write a reader, however, even if I
would have written one it wouldn’t have worked. I wouldn’t h
: Hyukjin Kwon [mailto:gurwls...@gmail.com]
Sent: Thursday, October 11, 2018 10:24 AM
To: Mendelson, Assaf; Wenchen Fan
Cc: dev
Subject: Re: Possible bug in DatasourceV2
[EXTERNAL EMAIL]
Please report any suspicious attachments, links, or requests for sensitive
information.
See https://github.com/apache
Hi,
I have started to play around with structured streaming and it seems the
documentation (structured streaming programming guide) does not match the
actual behavior I am seeing.
It says in the documentation that maxFilesPerTrigger (as well as latestFirst)
are options for the File sink. However
would suggest that working without hive should be either a simple
configuration or even the default and that if there is any missing
functionality it should be documented.
Assaf.
From: Reynold Xin [mailto:r...@databricks.com]
Sent: Tuesday, November 15, 2016 9:31 AM
To: Mendelson, Assaf
Cc: dev
questions. It is so easy to get lost in the chatter that
it makes it very hard for people to learn spark internals…
Assaf.
From: Sean Owen [mailto:so...@cloudera.com]
Sent: Wednesday, November 02, 2016 2:07 PM
To: Mendelson, Assaf; dev@spark.apache.org
Subject: Re: Handling questions in the mailing
once the
first condition fails, all would fail.
The problem is I don’t see this in the plan, nor can I find it in the code.
From: Takeshi Yamamuro [mailto:linguin@gmail.com]
Sent: Monday, September 12, 2016 7:12 PM
To: Mendelson, Assaf
Cc: dev@spark.apache.org
Subject: Re: UDF and native funct
