Is there a chance your data is all even or all odd? On Tue, Dec 17, 2019 at 11:01 AM Tzahi File <[email protected]> wrote:
> I have in my spark sql query a calculated field that gets the value if > field1 % 3. > > I'm using this field as a partition so I expected to get 3 partitions in > the mentioned case, and I do get. The issue happened with even numbers > (instead of 3 - 4,2 ... ). > When I tried to use even numbers, for example 4 I got only 2 partitions - > 1 and 3. > Field 1 datatype is bigint. > > Do you have any suggestions? > > > -- > thanks, > Tzahi >
