Re: lower&upperBound not working/spark 1/3

2015-03-25 Thread alessandro.andrioni
If I'm reading this comment[1] correctly, this is expected behavior: the lower and upper bounds are used to make the partitioning more efficient, not to limit the data returned. >/** > * Given a partitioning schematic (a column of integral type, a number of > * partitions, and upper and lower boun

Re: lower&upperBound not working/spark 1/3

2015-03-23 Thread Marek Wiewiorka
Ok- thanks Michael I will do another series of tests to confirm this and then report an issue. Regards, Marek 2015-03-22 22:19 GMT+01:00 Michael Armbrust : > I have not heard this reported yet, but your invocation looks correct to > me. Can you open a JIRA? > > On Sun, Mar 22, 2015 at 8:39 AM,

Re: lower&upperBound not working/spark 1/3

2015-03-22 Thread Michael Armbrust
I have not heard this reported yet, but your invocation looks correct to me. Can you open a JIRA? On Sun, Mar 22, 2015 at 8:39 AM, Marek Wiewiorka wrote: > Hi All - I try to use the new SQLContext API for populating DataFrame from > jdbc data source. > like this: > > val jdbcDF = sqlContext.jdb