Textinputformat defines the format of the data, it could be also different from 
text , eg orc, parquet etc

> On 14. Jul 2018, at 19:15, chrisr123 <chris.rueg...@gmail.com> wrote:
> 
> I'm building a streaming app that continuously monitors a directory for new
> files and I'm confused about why I have to specify a TextInputFormat - see
> source code below.  It seems redundant but it is a required parameter.  It
> makes perfect sense to specify the directory I want to monitor, but what
> purpose is the TextInputFormat filling and what should I set it to? Example:
> Simple Word Count App that reads lines of text.  
> 
> 
>    TextInputFormat format = new TextInputFormat(
>            new org.apache.flink.core.fs.Path("file:///tmp/dir/"));
> 
>    DataStream<String> inputStream = env.readFile(
>            format,
>            "file:///tmp/dir/",
>            FileProcessingMode.PROCESS_CONTINUOUSLY,
>            100);
> 
> 
> 
> --
> Sent from: 
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reply via email to