On Mon, Nov 9, 2015 at 9:59 AM, Brian Chhun
wrote:
> Is there a way to download 0.10 SNAPSHOT package like what' s available
> for 0.9.1? The downloads page on http://flink.apache.org/ seems to only
> have up to 0.9.1, despite having documentation for "0.10 SNAPSHOT" (
Hi All,
Is it possible to include a command line flag for starting job and task
managers in the foreground? Currently, `bin/jobmanager.sh` and
`bin/taskmanager.sh` rely on `bin/flink-daemon.sh`, which starts these
things in the background. I'd like to execute these commands inside a
docker contain
> wrote:
>
>> Hi Brian,
>>
>> as far as I know this is at the moment not possible with our scripts.
>> However it should be relatively easy to add by simply executing the Java
>> command in flink-daemon.sh in the foreground. Do you want to add this?
>>
>>
running
> containers."
>
> Have a look at flink/config-flink.sh.
>
> Cheers,
> Max
>
> On Wed, Dec 2, 2015 at 6:29 PM, Brian Chhun
> wrote:
> > Yep, I think this makes sense. I'm currently patching the flink-daemon.sh
> > script to remove the `&
s goes down
> wait $!
>
> Cheers,
> Max
>
> On Wed, Dec 2, 2015 at 7:16 PM, Brian Chhun
> wrote:
>
>> Thanks, I'm basing the things I'm doing based on what I see there. One
>> thing that's not clear to me in that example is why supervisor is used
Hello,
I'm trying to setup an HA cluster and I'm running into issues using S3 as
the state backend. This is raised during startup:
2015-12-09T19:23:36.430724+00:00 i-1ec317c4
docker/jobmanager01-d3174d6[1207]: java.io.IOException: No file system
found with scheme s3, referenced in file URI 's3://
pconf property and add
>
>
> fs.s3.impl
> org.apache.hadoop.fs.s3native.NativeS3FileSystem
>
>
> to core-site.xml
>
> – Ufuk
>
> > On 09 Dec 2015, at 20:50, Brian Chhun
> wrote:
> >
> > Hello,
> >
> > I'm trying to setup an HA clus
Hello,
Is it possible to set the job manager rpc port when running in HA mode? Or
is there a workaround or solution if we're running task managers with a
firewall?
Thanks,
Brian
For anyone else looking, I was able to use the s3a filesystem which can use
IAM role based authentication as provided by the underlying AWS client
library.
Thanks,
Brian
On Thu, Dec 10, 2015 at 4:28 PM, Brian Chhun
wrote:
> Thanks Ufuk, this did the trick.
>
> Thanks,
> Brian
>
side. obvs in the AWS side, I had my
IAM role setup with readlwrite access to the bucket.
Thanks,
Brian
On Mon, Dec 14, 2015 at 10:39 PM, Thomas Götzinger
wrote:
> Hi Brian
>
> Can you give me short summary how to achieve this.
> Am 14.12.2015 23:20 schrieb "Brian Chhun" :
&
Hi All,
Are certain considerations when using these functions on windowed streams?
>From reading the code, it looks using reduce (or another aggregation
function) on a windowed stream will pre-aggregate the result value as
elements are added to the window, keeping the size of window constant. On
now. It should not be too hard to add the
> pre-aggregation behavior for fold, however.
> > On 30 Dec 2015, at 17:31, Brian Chhun
> wrote:
>
> >
> > Hi All,
> >
> > Are certain considerations when using these functions on windowed
> streams?
> >
>
For what it's worth, we have a trigger that fires once a day for a
recurring calculation. When an element comes in, we set the trigger
context's processing time timer to the exact millisecond of the desired
time. The predefined triggers were useful to look at to achieve this:
https://github.com/apa
production,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
> >
> > From: Brian Chhun [mailto:brian.ch...@getbraintree.com]
> > Se
14 matches
Mail list logo
