We are copying files from our upstream system which are in JSON GZ format. They
are following a pattern for very daily slice say YYYYMMDDHH (2018053100) they
are maintianing two folders DATA and METADATA. Where DATA holds actual data and
METADATA holds RowCount of that day's data.We need to create external table on
top of copied data, where it only consider *.json.gz extension files only,
excluding other file extensions. We dont want to copy files into another
location since they are large in size. We also tried INPUT_ FILENAME ....
virtual column, it didn't work. Any suggesstion for this scnearios ?