Re: [PYSPARK] Python tests organization

2017-01-14 Thread Saikat Kanjilal
, January 12, 2017 10:44 AM To: dev@spark.apache.org Subject: Re: [PYSPARK] Python tests organization Sounds good, but it looks like JIRA is still down. Personally I can look at sql.tests and see what can be done there. Depending on the resolution of https://issues.apache.org/jira/browse/SPARK-19160

Re: [PYSPARK] Python tests organization

2017-01-12 Thread Maciej Szymkiewicz
ote: > > > > >> >> >> >> >> Hello Maciej, >> >> >> >> If there's a jira available for this I'd like to help get this >> moving, let me know next steps. >> >> >> >> Thanks in advance. >> >> >> >> >> >> >> >> >> >> >&

Re: [PYSPARK] Python tests organization

2017-01-12 Thread Maciej Szymkiewicz
From:* Maciej Szymkiewicz <mailto:mszymkiew...@gmail.com>> > > > > *Sent:* Wednesday, January 11, 2017 10:14 AM > > > *To:* Saikat Kanjilal > > > *Subject:* Re: [PYSPARK] Python tests organization > > > Not yet, I want to see if the

Re: [PYSPARK] Python tests organization

2017-01-12 Thread Saikat Kanjilal
Maciej? LGTM, what do you think? I can create a JIRA and drive this. From: Holden Karau Sent: Thursday, January 12, 2017 10:34 AM To: Saikat Kanjilal; dev@spark.apache.org Subject: Re: [PYSPARK] Python tests organization I'd be happy to help with revi

Re: [PYSPARK] Python tests organization

2017-01-12 Thread Holden Karau
Following up, any thoughts on next steps for this? > > > > > > > > > > > -- > > > *From:* Maciej Szymkiewicz > > > > *Sent:* Wednesday, January 11, 2017 10:14 AM > > > *To:* Saikat Kanjilal > > > *Subject:* Re: [PYSPARK] Python tes

Re: [PYSPARK] Python tests organization

2017-01-12 Thread Saikat Kanjilal
Following up, any thoughts on next steps for this? From: Maciej Szymkiewicz Sent: Wednesday, January 11, 2017 10:14 AM To: Saikat Kanjilal Subject: Re: [PYSPARK] Python tests organization Not yet, I want to see if there is any consensus about it. It is a lot

Re: [PYSPARK] Python tests organization

2017-01-11 Thread Saikat Kanjilal
;d like to help get this moving, let me know next steps. Thanks in advance. From: Maciej Szymkiewicz <mailto:mszymkiew...@gmail.com> Sent: Wednesday, January 11, 2017 4:18 AM To: dev@spark.apache.org<mailto:dev@spark.apache.org> Subject: [PYSPARK] Pyt

Re: [PYSPARK] Python tests organization

2017-01-11 Thread Reynold Xin
- > > > *From:* Reynold Xin > > > *Sent:* Wednesday, January 11, 2017 9:47 AM > > > *To:* Maciej Szymkiewicz; Saikat Kanjilal; dev@spark.apache.org > > > *Subject:* Re: [PYSPARK] Python tests organization > > > > > >

Re: [PYSPARK] Python tests organization

2017-01-11 Thread Saikat Kanjilal
Is it worth to come up with a proposal for this and float to dev? From: Reynold Xin Sent: Wednesday, January 11, 2017 9:47 AM To: Maciej Szymkiewicz; Saikat Kanjilal; dev@spark.apache.org Subject: Re: [PYSPARK] Python tests organization It would be good to

Re: [PYSPARK] Python tests organization

2017-01-11 Thread Reynold Xin
there's a jira available for this I'd like to help get this moving, let > me know next steps. > > > Thanks in advance. > > > > > > > > > > > > > -- > > > *From:* Maciej Szymkiewicz > &

Re: [PYSPARK] Python tests organization

2017-01-11 Thread Saikat Kanjilal
Hello Maciej, If there's a jira available for this I'd like to help get this moving, let me know next steps. Thanks in advance. From: Maciej Szymkiewicz Sent: Wednesday, January 11, 2017 4:18 AM To: dev@spark.apache.org Subject: [PYSPARK] Py

[PYSPARK] Python tests organization

2017-01-11 Thread Maciej Szymkiewicz
Hi, I can't help but wonder if there is any practical reason for keeping monolithic test modules. These things are already pretty large (1500 - 2200 LOCs) and can only grow. Development aside, I assume that many users use tests the same way as me, to check the intended behavior, and largish loosel