[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-13 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 Hi @kl0u, IMO that is the expected behavior. The sink would not know that if the Redis is down or not unless it tries to send the next data to the Redis. When ever a new message reaches the sink i

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-12 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/1813 Hi @subhankarb ! By playing around with the sink during testing, I saw that if Redis goes down in the middle of the execution of a job, the job has to wait until the next element (after the Redis failu

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-07 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 Thanks @subhankarb ! Great work. Thanks @tzulitai for helping with reviewing! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-06 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/1813 This is the build: https://travis-ci.org/rmetzger/flink/builds/142738735 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-06 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/1813 I'm addressing my last comments myself and merge the change once its green. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-06 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @rmetzger LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-06 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax , @rmetzger plz review. IMO it is ready to get merged at last :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-05 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax @subhankarb: the changes look good to me :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-04 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @subhankarb two tiny comments @tzulitai @rmetzger Any more comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-04 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-04 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @subhankarb I think one more pass and we are good to go! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-07-03 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Hi @subhankarb, Thank you for addressing our comments. I have some last nit-pick comments to make the code just a little better, otherwise the changes LGTM :) Perhaps we should also wait for

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 @subhankarb We should also add Redis Sink to the fault tolerance guarantee table for the connectors in the documentation. It can be found at `flink/docs/api/streaming/fault_tolerance.md`. --- If y

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Hi @mjsax @subhankarb, Gave a first run-through on the code, please let me know if you have any questions on the comments. I've also tested the connector again, on a local single-node & cluster

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax I think the failing `JMXReporterTest.testJMXAvailability` was just hotfixed with this commit yesterday: https://github.com/apache/flink/commit/53630da01bcbfe05eda90869b1198b4e1c554a8

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Sure, I'll give a full review now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-29 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @rmetzger What about this failing tests... ``` JMXReporterTest.testJMXAvailability:148 » Runtime Could not start JMX server o... ``` Seems, there is no JIRA -- known issue? -- or no is

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-28 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax , @rmetzger plz review. The changed model is described in the PR description. thanks, subhankar --- If your project is set up for it, you can reply to this email and have you

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-27 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 My two cents: 1) seems to got sorted out (thx @tzulitai for the input!) 2) I personally do not care too much about the name conflict. Reusing the same class for sink and source sounds reasonable

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Hi @subhankarb, Sorry, I just read the code and didn't realize you were using the `additionalKey` as the `setName` for `SORTED_SET`. I think this might be quite confusing for Redis

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-27 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @tzulitai, @mjsax thank you very much for your valuable feedback. 1) `additionalKey` was supposed to one time declaration for `SORTED_SET` and `HASH`. For `HASH` it is the value of hash na

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-25 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Hi @mjsax, Regarding 1): just came to me that for SORTED_SET, a fixed secondary key doesn't make sense, because the secondary key is supposed to define the order of the inserted element in

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-25 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @tzulitai Thank a lot for testing this! Your feedback is really great! 1) I am not a Redis users either -- from my understanding, the second key determined the field that would be updated -- it

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-25 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1813 Hi, I've tested this on a local single node installation & cluster installation. It works and have not come across problems. Have a few other questions on the usage of the connector (I h

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 @rmetzger Thanks :) I did not test with a Redis cluster or similar. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax, did you test the code with a redis installation / on a cluster? (I'm not expecting those tests from a PR review, but I would not do it again if you already did ... and I'm not doing it today

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 Please address last comment. Otherwise, LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-22 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax plz review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-21 Thread subhankarb
Github user subhankarb commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax wow... that's a lot. thanks you very very much for your time. i am fixing ASAP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-19 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/flink/pull/1813 Most comments are nit or minor. Please fix. Otherwise, looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n