Hi,
Thanks for your response.
I am trying to maintain some state in redis, and for each incoming packet,
I try to map the information on redis, and then finally use ES as a sink to
push the data.
But with this flink-connector-redis, I am not sure if the same can be
achieved. Can you please elabor
Jiangjie Qin created FLINK-18680:
Summary: Improve RecordsWithSplitIds API
Key: FLINK-18680
URL: https://issues.apache.org/jira/browse/FLINK-18680
Project: Flink
Issue Type: Sub-task
Hi Israel,
thanks a lot for reaching out! I'm very excited about your efforts to bring
additional Azure support into Flink.
There are ~50 threads on the user@ mailing list mentioning Azure -- that's
good evidence that our users use Flink in Azure.
Regarding your questions:
Do I need to create a
wangtaiyang created FLINK-18681:
---
Summary: The jar package version conflict causes the task to
continue to increase and grab resources
Key: FLINK-18681
URL: https://issues.apache.org/jira/browse/FLINK-18681
Do you need to read the state you maintained from Redis? The
flink-connector-redis only contains sink operator.
Best,
Yangze Guo
On Thu, Jul 23, 2020 at 3:28 PM Ramya Ramamurthy wrote:
>
> Hi,
>
> Thanks for your response.
>
> I am trying to maintain some state in redis, and for each incoming pa
Hi Ramya
I just tried to code the example which is worked in 1.10 which I using a custom
RichFlatMapFunction to connect ,transform data and release the conn in its
override method.
// app.java
public class RedisMapDemo {
public static void main(String[] args) throws Exception {
//
Hi Jark,
thanks for the update. I think the FLIP is in a really good shape now
and ready to be voted. If others have no further comments?
I have one last comment around the methods of the descriptor builders.
When refactoring classes such as `KafkaConnector` or
`ElasticsearchConnector`. We s
Rui Li created FLINK-18682:
--
Summary: Vector orc reader cannot read Hive 2.0.0 table
Key: FLINK-18682
URL: https://issues.apache.org/jira/browse/FLINK-18682
Project: Flink
Issue Type: Bug
Congratulations, Piotr!
On Wed, Jul 22, 2020 at 8:52 AM Forward Xu wrote:
> Congratulations!
>
>
> Best，
>
> Forward
>
> godfrey he 于2020年7月22日周三 上午10:45写道：
>
> > Congratulations!
> >
> > Best,
> > Godfrey
> >
> > Till Rohrmann 于2020年7月21日周二 下午10:46写道：
> >
> > > Congrats, Piotr!
> > >
> > > Ch
Fabian Hueske created FLINK-18683:
-
Summary: Support @DataTypeHint for TableFunction output types
Key: FLINK-18683
URL: https://issues.apache.org/jira/browse/FLINK-18683
Project: Flink
Issue
Hi Jark,
Thanks for the update. I think the FLIP looks really well on the high level.
I have a few comments to the code structure in the FLIP:
1) I really don't like how the TableDescriptor exposes protected fields.
Moreover why do we need to extend from it? I don't think we need
KafkaConnector
Hi all,
I'd like to discuss about the semantic of returning null from
InputFormat#nextRecord.
For now, there is no explicit java doc about this. And there are three ways
to handle
this in Flink:
1. treat null as the end of input
2. skip null
3. assumes that the value from InputFormat#nextRecord c
Roman Khachatryan created FLINK-18684:
-
Summary: Performance regression around 2020.07.22 in serialization
Key: FLINK-18684
URL: https://issues.apache.org/jira/browse/FLINK-18684
Project: Flink
Robert Metzger created FLINK-18685:
--
Summary: JobClient.getAccumulators() blocks until streaming job
has finished in local environment
Key: FLINK-18685
URL: https://issues.apache.org/jira/browse/FLINK-18685
Adding dev@ to get some traction. Any help would be greatly appreciated.
Thanks.
On Thu, Jul 23, 2020 at 11:48 AM Sivaprasanna
wrote:
> +user...@flink.apache.org
>
> A follow up question. I tried taking a savepoint but the job failed
> immediately. It happens everytime I take a savepoint. The
Thanks for being our release managers for the 1.12 release Dian & Robert!
Here are some features I would like to work on for this release:
# Features
## Finishing pipelined region scheduling (
https://issues.apache.org/jira/browse/FLINK-16430)
With the pipelined region scheduler we want to imple
hailong wang created FLINK-18686:
Summary: Getting the emit time when
`table.exec.emit.early-fire.enabled` is true
Key: FLINK-18686
URL: https://issues.apache.org/jira/browse/FLINK-18686
Project: Flin
Caizhi Weng created FLINK-18688:
---
Summary: ProjectionCodeGenerator#generateProjectionExpression
should remove for loop optimization
Key: FLINK-18688
URL: https://issues.apache.org/jira/browse/FLINK-18688
Caizhi Weng created FLINK-18687:
---
Summary: ProjectionCodeGenerator#generateProjectionExpression
should remove for loop optimization
Key: FLINK-18687
URL: https://issues.apache.org/jira/browse/FLINK-18687
Andrey Zagrebin created FLINK-18690:
---
Summary: Implement LocalInputPreferredSlotSharingStrategy
Key: FLINK-18690
URL: https://issues.apache.org/jira/browse/FLINK-18690
Project: Flink
Issue
Andrey Zagrebin created FLINK-18689:
---
Summary: Deterministic Slot Sharing
Key: FLINK-18689
URL: https://issues.apache.org/jira/browse/FLINK-18689
Project: Flink
Issue Type: New Feature
Hi , I can't run the apache flink from command link. Cluster is starting
automatically and shutting down too
--
Thanks & Regards,
Maganti Surya
6462208546
Jun Zhang created FLINK-18691:
-
Summary: add HiveCatalog Construction method with HiveConf
Key: FLINK-18691
URL: https://issues.apache.org/jira/browse/FLINK-18691
Project: Flink
Issue Type: Impro
Hi Timo,
That's a good point I missed in the design. I have updated the FLIP and
added a note under the `KafkaConnector` to mention this.
I will not list all the method names in the FLIP as the design doc is super
long now.
Hi Dawid
Aljoscha Krettek created FLINK-18692:
Summary: AvroSerializationSchema does not work with types
generated by avrohugger
Key: FLINK-18692
URL: https://issues.apache.org/jira/browse/FLINK-18692
Proj
Aljoscha Krettek created FLINK-18693:
Summary: AvroSerializationSchema does not work with types
generated by avrohugger
Key: FLINK-18693
URL: https://issues.apache.org/jira/browse/FLINK-18693
Proj
Kboh created FLINK-18694:
Summary: Add unaligned checkpoint config to web ui
Key: FLINK-18694
URL: https://issues.apache.org/jira/browse/FLINK-18694
Project: Flink
Issue Type: Improvement
C
Chesnay Schepler created FLINK-18695:
Summary: Allow NettyBufferPool to allocate heap buffers
Key: FLINK-18695
URL: https://issues.apache.org/jira/browse/FLINK-18695
Project: Flink
Issue
Robert Metzger created FLINK-18696:
--
Summary: Java 14 Records are not recognized as POJOs
Key: FLINK-18696
URL: https://issues.apache.org/jira/browse/FLINK-18696
Project: Flink
Issue Type: I
Hi devs,
If you use the FsStateBackend (or MemoryStateBackend), and you have ListState,
then you can get an iterator and remove() an entry, and it all works as
expected.
If you use the RocksDBStateBackend, the remove() call doesn’t throw an
exception, but the ListState isn’t updated.
Seems li
Robert Metzger created FLINK-18697:
--
Summary: Adding flink-table-api-java-bridge_2.11 to a Flink job
kills the IDE logging
Key: FLINK-18697
URL: https://issues.apache.org/jira/browse/FLINK-18697
Proj
Hi Flink Community,
I'm new to this community but have been using Flink for a year or so. As a
user, my team built stuff upon Flink stateful stream processing. We used to
have a use case that we need a sorted map data structure to store our
state, something like TreeMap in Java, to query higher/lo
The cause of the issue is all but clear.
Previously I had mentioned that there is no suspect change to the Kinesis
connector and that I had reverted the AWS SDK change to no effect.
https://issues.apache.org/jira/browse/FLINK-17496 actually fixed another
regression in the previous release and is
>From my experience, java profilers are sometimes not accurate enough to
find out the performance regression
root cause. In this case, I would suggest you try out intel vtune amplifier
to watch more detailed metrics.
Best,
Kurt
On Fri, Jul 24, 2020 at 8:51 AM Thomas Weise wrote:
> The cause of
Thanks for the guidance Robert. I appreciate the prompt response and will
share the pull requests for the ADLS support [2] next week.
Regarding the additional, I would like to contribute them to the main
codebase [1] if possible
I initially thought maybe it is better to start outside the core cod
Hi,
In order to better analyze this problem, it would be good to provide:
- The command and config you start flink.
- Logs of JobManager and TaskManager, you could find it in the logs/
directory of your Flink distribution in standalone mode.
Best,
Yangze Guo
On Thu, Jul 23, 2020 at 10:10 PM Sur
毛宗良 created FLINK-18698:
---
Summary: org.apache.flink.sql.parser.utils.ParserResource compile
error
Key: FLINK-18698
URL: https://issues.apache.org/jira/browse/FLINK-18698
Project: Flink
Issue Type: Bug
37 matches
Mail list logo
