Github user davies commented on the pull request:
https://github.com/apache/spark/pull/4521#issuecomment-74019151
@dondrake You could run the python sql tests locally, and see many tests
are failing.
The size of int/long in Python is determined by size of machine word, see
sys.maxint. In 32-bit machine, they should be Integer and BigInteger. In 64-bit
machine, they should be Long and BigInteger.
From user's point view, I think Integer is enough for most of cases, the
original patch could help in some cases (nanoseconds and uuid). In the cases
that the inferred type is not correct, user could specify the correct type
manually. I think this is the behavior without surprise to users.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
