i use multi level wildcard with hadoop fs -ls, which is the exact same glob function call
On Wed, Mar 9, 2016 at 9:24 AM, Ted Yu <[email protected]> wrote: > Hadoop glob pattern doesn't support multi level wildcard. > > Thanks > > On Mar 9, 2016, at 6:15 AM, Koert Kuipers <[email protected]> wrote: > > if its based on HadoopFsRelation shouldn't it support it? HadoopFsRelation > handles globs > > On Wed, Mar 9, 2016 at 8:56 AM, Ted Yu <[email protected]> wrote: > >> This is currently not supported. >> >> On Mar 9, 2016, at 4:38 AM, Jakub Liska <[email protected]> wrote: >> >> Hey, >> >> is something like this possible? >> >> sqlContext.read.json("/mnt/views-p/base/2016/01/*/*-xyz.json") >> >> I switched to DataFrames because my source files changed from TSV to JSON >> but now I'm not able to load the files as I did before. I get this error >> if I try that : >> >> https://github.com/apache/spark/pull/9142#issuecomment-194248531 >> >> >
