Yeah, from the docs
<https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/DataFrameReader.html#parquet(java.lang.String...)>
it
looks like parquet takes a string varargs, rather than just a string. Maybe
that's what the "<>" on the end of "java.lang.String" means?
- James
On 13 May 2016 at 05:52, Sunil S Nandihalli <sunil.nandiha...@gmail.com>
wrote:
> I was able to get over this problem by doing one of the following two ways
> of calling "parquet" function.
>
> (. inp-rdr (parquet (into-array java.lang.String [parq-path])))
> (. inp-rdr (parquet (-> [parq-path] JavaConversions/asScalaBuffer
> .toList)))
>
> On Fri, May 13, 2016 at 10:01 AM, Sunil S Nandihalli <
> sunil.nandiha...@gmail.com> wrote:
>
>> Just to add to the previous email,
>> I have also tried
>>
>> (. inp-rdr-s (parquet (to-array '(parq-path))
>>
>> but got the same error.
>> Thanks
>> Sunil.
>>
>> On Fri, May 13, 2016 at 9:55 AM, Sunil S Nandihalli <
>> sunil.nandiha...@gmail.com> wrote:
>>
>>> Hi everybody,
>>> I am trying to call function "parquet" on the var "inp-rdr-s". From the
>>> following reflection output using clojure.reflect, it is clear that the
>>> method parquet exists. However I am unable to call the function. Can
>>> somebody help?
>>> Thanks and regards,
>>> Sunil
>>>
>>> bidland.core> (def parq-path
>>> "/home/hdfs/sunil/dl4j/bidland/tmp/sunil-bidland-data/part-r-00000.parquet")
>>> #'bidland.core/parq-path
>>> bidland.core> (pp/pprint (filter #(= 'parquet (:name %)) (:members
>>> (r/reflect (class inp-rdr-s)))))
>>> ({:name parquet,
>>> :return-type org.apache.spark.sql.DataFrame,
>>> :declaring-class org.apache.spark.sql.DataFrameReader,
>>> :parameter-types [java.lang.String<>],
>>> :exception-types [],
>>> :flags #{:varargs :public}}
>>> {:name parquet,
>>> :return-type org.apache.spark.sql.DataFrame,
>>> :declaring-class org.apache.spark.sql.DataFrameReader,
>>> :parameter-types [scala.collection.Seq],
>>> :exception-types [],
>>> :flags #{:public}})
>>> nil
>>> bidland.core> (. inp-rdr-s (parquet parq-path))
>>> IllegalArgumentException No matching method found: parquet for class
>>> org.apache.spark.sql.DataFrameReader
>>> clojure.lang.Reflector.invokeMatchingMethod (Reflector.java:80)
>>> bidland.core>
>>>
>>
>>
> --
> You received this message because you are subscribed to the Google
> Groups "Clojure" group.
> To post to this group, send email to clojure@googlegroups.com
> Note that posts from new members are moderated - please be patient with
> your first post.
> To unsubscribe from this group, send email to
> clojure+unsubscr...@googlegroups.com
> For more options, visit this group at
> http://groups.google.com/group/clojure?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Clojure" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to clojure+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clojure@googlegroups.com
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
clojure+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to clojure+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
