Re: Import Configuration File in Flink Cluster

2016-05-27 Thread simon peyer
Hi I just want to let you know, that I did implement a version for wrapping properties in the cluster: object PropertiesWrapper { def getFromConfig(configFile: String): ParameterTool = { val prop: Properties = new Properties() var input: InputStream = null try { input = Pro

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread Bajaj, Abhinav
I was gonna post the exact question and noticed this thread. It will be great if we can have a method in parameter tool to load from resources. Thanks Simon :) Abhinav Bajaj Senior Engineer HERE Predictive Analytics Office: +12062092767 Mobile: +17083299516 HERE Seattle 701 Pike Street, #2000,

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread simon peyer
Hi Max Thanks a lot for your helpful answer. It now works on the cluster. It would be great to have a method for loading from resources. -Cheers Simon > On 23 May 2016, at 17:52, Maximilian Michels wrote: > > Hi Simon, > > AFAIK this is the way to go. We could add a method to the > Paramete

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread Maximilian Michels
Hi Simon, AFAIK this is the way to go. We could add a method to the ParameterTool which loads from a resource to make it more convenient. Cheers, Max On Mon, May 23, 2016 at 4:42 PM, simon peyer wrote: > Hi > > @Max > So for each file in the src/main/resources folder, I first have to create a >

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread simon peyer
Hi @Max So for each file in the src/main/resources folder, I first have to create a new file, copy the file from the resources folder to this new file and then I'm able to parse it? @Stefano I think the files in src/main/resources are integrated automatically right? Or am I missing something

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread Stefano Baghino
Are you using Maven to package your project? I believe the resources plugin[1] can suit your needs. [1]: http://maven.apache.org/plugins/maven-resources-plugin/examples/include-exclude.html On Mon, May 23, 2016 at 3:56 PM, simon peyer wrote: > Hi together > > Currently I'm using flink on a dock

Re: Import Configuration File in Flink Cluster

2016-05-23 Thread Maximilian Michels
Hi Simon, You'll have to write the property file to disk first to load it using the ParameterTool.fromPropertiesFile method. For example: // copy config from Java resource to a file File configOnDisk = new File("/path/to/config.properties"); Files.copy(getClass.getClassLoader.getResourceAsStream