Koert: I meant org.apache.hadoop.mapred.FileInputFormat doesn't support multi level wildcard.
Cheers On Wed, Mar 9, 2016 at 8:22 AM, Koert Kuipers <[email protected]> wrote: > i use multi level wildcard with hadoop fs -ls, which is the exact same > glob function call > > On Wed, Mar 9, 2016 at 9:24 AM, Ted Yu <[email protected]> wrote: > >> Hadoop glob pattern doesn't support multi level wildcard. >> >> Thanks >> >> On Mar 9, 2016, at 6:15 AM, Koert Kuipers <[email protected]> wrote: >> >> if its based on HadoopFsRelation shouldn't it support it? >> HadoopFsRelation handles globs >> >> On Wed, Mar 9, 2016 at 8:56 AM, Ted Yu <[email protected]> wrote: >> >>> This is currently not supported. >>> >>> On Mar 9, 2016, at 4:38 AM, Jakub Liska <[email protected]> wrote: >>> >>> Hey, >>> >>> is something like this possible? >>> >>> sqlContext.read.json("/mnt/views-p/base/2016/01/*/*-xyz.json") >>> >>> I switched to DataFrames because my source files changed from TSV to JSON >>> but now I'm not able to load the files as I did before. I get this error >>> if I try that : >>> >>> https://github.com/apache/spark/pull/9142#issuecomment-194248531 >>> >>> >> >
