Are you talking about the ones that are defined in a dictionary? If yes, that
was actually not that great in hindsight (makes it harder to read & change), so
I'm OK changing it.
E.g.
_functions = {
'lit': _lit_doc,
'col': 'Returns a :class:`Column` based on the given column name.',
'column': 'Returns a :class:`Column` based on the given column name.',
'asc': 'Returns a sort expression based on the ascending order of the given
column name.',
'desc': 'Returns a sort expression based on the descending order of the
given column name.',
}
On Wed, Apr 17, 2019 at 4:35 AM, Sean Owen < [email protected] > wrote:
>
>
>
> I use IntelliJ and have never seen an issue parsing the pyspark
> functions... you're just saying the linter has an optional inspection to
> flag it? just disable that?
> I don't think we want to complicate the Spark code just for this. They are
> declared at runtime for a reason.
>
>
>
> On Wed, Apr 17, 2019 at 6:27 AM educhana@ gmail. com ( [email protected] )
> < educhana@ gmail. com ( [email protected] ) > wrote:
>
>
>>
>>
>> Hi,
>>
>>
>>
>> I'm aware of various workarounds to make this work smoothly in various
>> IDEs, but wouldn't better to solve the root cause?
>>
>>
>>
>> I've seen the code and don't see anything that requires such level of
>> dynamic code, the translation is 99% trivial.
>>
>>
>>
>> On 2019/04/16 12:16:41, 880f0464 < 880f0464@ protonmail. com. INVALID (
>> [email protected] ) > wrote:
>>
>>
>>>
>>>
>>> Hi.
>>>
>>>
>>>
>>> That's a problem with Spark as such and in general can be addressed on IDE
>>> to IDE basis - see for example https:/ / stackoverflow. com/ q/ 40163106 (
>>> https://stackoverflow.com/q/40163106 ) for some hints.
>>>
>>>
>>>
>>> Sent with ProtonMail Secure Email.
>>>
>>>
>>>
>>> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
>>> On Tuesday, April 16, 2019 2:10 PM, educhana < educhana@ gmail. com (
>>> [email protected] ) > wrote:
>>>
>>>
>>>>
>>>>
>>>> Hi,
>>>>
>>>>
>>>>
>>>> Currently using pyspark.sql.functions from an IDE like PyCharm is causing
>>>> the linters complain due to the functions being declared at runtime.
>>>>
>>>>
>>>>
>>>> Would a PR fixing this be welcomed? Is there any problems/difficulties I'm
>>>> unaware?
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>>>
>>>>
>>>>
>>>>
>>>> Sent from: http:/ / apache-spark-developers-list. 1001551. n3. nabble. com/
>>>> ( http://apache-spark-developers-list.1001551.n3.nabble.com/ )
>>>>
>>>>
>>>>
>>>> ----------------------------------------------------------------------
>>>>
>>>>
>>>>
>>>> To unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
>>>> [email protected] )
>>>>
>>>>
>>>
>>>
>>>
>>> --------------------------------------------------------------------- To
>>> unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
>>> [email protected] )
>>>
>>>
>>
>>
>>
>> --------------------------------------------------------------------- To
>> unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
>> [email protected] )
>>
>>
>
>
>
> --------------------------------------------------------------------- To
> unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
> [email protected] )
>
>
>
