It should work. We have tests such as groupby_bigdata.q that run on HoS and work. They use the "add file" command. What are the exact commands you are running? What error are you seeing?
On Thu, Feb 8, 2018 at 6:28 AM, Ray Navarette <ray.navare...@pb.com> wrote: > Hello, > > > > I’m hoping to find some information about using “ADD FILES <PATH>” when > using the spark execution engine. I’ve seen some jira tickets reference > this functionality, but little else. We have written some custom UDFs > which require some external resources. When using the MR execution engine, > we can reference the file paths using a relative path and they are properly > distributed and resolved. When I try to do the same under spark engine, I > receive an error saying the file is unavailable. > > > > Does “ADD FILES <PATH>” work on spark, and if so, how should I properly > reference those files in order to read them in the executors? > > > > Thanks much for your help, > > Ray > -- Sahil Takiar Software Engineer takiar.sa...@gmail.com | (510) 673-0309
