ce.
>
> Thanks.
>
> Best,
> Shimin
>
> Dian Fu 于2019年9月6日周五 下午3:17写道：
>
> > Hi Shimin,
> >
> > It can be guaranteed to be an atomic operation. This is ensured by the
> RPC
> > framework. You could take a look at RpcEndpoint for more details.
Hi Tang,
Actually in my case we implement a totally different KeyedStateBackend and
its' factory based on data store other than Heap or RocksDB.
Also for state factory of heap and rocksdb, you've made a quite good point
and I agree with you opinion.
Best,
Shimin
shimin yang 于2019年
e" in JIRA (FLINK-14003), but IMO
> adding a specific interface like below is better than exposing the internal
> one:
> State getCustomizedState(StateDescriptor
> stateProperties);
>
> Finally, I think this is a user-facing and definitely worthwhile
> discussion, and requires
Shimin Yang created FLINK-14003:
---
Summary: Add access to customized state other than built in state
types
Key: FLINK-14003
URL: https://issues.apache.org/jira/browse/FLINK-14003
Project: Flink
Hi Fu,
That'll be nice.
Thanks.
Best,
Shimin
Dian Fu 于2019年9月6日周五 下午3:17写道：
> Hi Shimin,
>
> It can be guaranteed to be an atomic operation. This is ensured by the RPC
> framework. You could take a look at RpcEndpoint for more details.
>
> Regards,
> Dian
>
>
ements. It can be
> got via StreamingRuntimeContext#getGlobalAggregateManager().
>
> Regards,
> Dian
>
> > 在 2019年9月6日，下午1:39，shimin yang 写道：
> >
> > Hi Jingsong,
> >
> > Big fan of this idea. We faced the same problem and resolved by adding a
> >
Hi Jingsong,
Big fan of this idea. We faced the same problem and resolved by adding a
distributed lock. It would be nice to have this feature in JobMaster, which
can replace the lock.
Best,
Shimin
JingsongLee 于2019年9月6日周五 下午12:20写道：
> Hi devs:
>
> I try to implement streaming file sink for tab
Hi every,
I would like to start a discussion on supporting customize state
in customized KeyedStateBackend.
In Flink, users can customize KeyedStateBackend to support different type
of data store. Although we can implement customized StateDescriptors for
different kind of data structrues, we do n
Shimin Yang created FLINK-11705:
---
Summary: remove org.apache.flink.runtime.testingUtils.TestingUtils
Key: FLINK-11705
URL: https://issues.apache.org/jira/browse/FLINK-11705
Project: Flink
Shimin Yang created FLINK-11486:
---
Summary: Remove RecoveryITCase for jobmanager
Key: FLINK-11486
URL: https://issues.apache.org/jira/browse/FLINK-11486
Project: Flink
Issue Type: Sub-task
Shimin Yang created FLINK-11084:
---
Summary: Incorrect ouput after two successive split and select
Key: FLINK-11084
URL: https://issues.apache.org/jira/browse/FLINK-11084
Project: Flink
Issue
Currently, the rescale operation is to stop the whole job and restart it
with different parrellism. But the rescale operation cost a lot and took
lots of time to recover if the state size is quite big.
And a long-time rescale might cause other problems like latency increase
and back pressure. For
Shimin Yang created FLINK-10815:
---
Summary: Rethink the rescale operation, can we do it async
Key: FLINK-10815
URL: https://issues.apache.org/jira/browse/FLINK-10815
Project: Flink
Issue Type
Shimin Yang created FLINK-10703:
---
Summary: Race condition in YarnResourceManager
Key: FLINK-10703
URL: https://issues.apache.org/jira/browse/FLINK-10703
Project: Flink
Issue Type: Bug
Due
> to this, the underlying key could have changed, thus, accessing state which
> can belong to another key. One would have to reset the corresponding key
> before accessing the state. But this is not yet happening.
>
> Cheers,
> Till
>
> On Fri, Oct 19, 2018 at 8:37 AM
Hi all,
Regarding to the RichAsyncFunction, why we cannot access the state through
runtime context like other operators?
Best,
Shimin Yang
Shimin Yang created FLINK-10552:
---
Summary: Provide RichAsyncFunction for scala API
Key: FLINK-10552
URL: https://issues.apache.org/jira/browse/FLINK-10552
Project: Flink
Issue Type: Bug
Shimin Yang created FLINK-10511:
---
Summary: Code duplication of creating RPC service in
ClusterEntrypoint and AkkaRpcServiceUtils
Key: FLINK-10511
URL: https://issues.apache.org/jira/browse/FLINK-10511
-1
Could you merge the FLINK-10243 into release 1.6.1. I think the
configurable latency metrics will be quite useful and not much work to
merge.
Best,
Shimin
vino yang 于2018年9月20日周四 下午2:08写道：
> +1
>
> I checked the new Flink version in the root pom file.
> I checked the announcement blog post
Shimin Yang created FLINK-10330:
---
Summary: Code Compilation failed in local mode
Key: FLINK-10330
URL: https://issues.apache.org/jira/browse/FLINK-10330
Project: Flink
Issue Type: Bug
Shimin Yang created FLINK-10322:
---
Summary: Unused instance variable MetricRegistry in ResourceManager
Key: FLINK-10322
URL: https://issues.apache.org/jira/browse/FLINK-10322
Project: Flink
Shimin Yang created FLINK-10277:
---
Summary: Add AppendStreamTableSink and UpsertStreamTableSink
Key: FLINK-10277
URL: https://issues.apache.org/jira/browse/FLINK-10277
Project: Flink
Issue Type
Shimin Yang created FLINK-10248:
---
Summary: Add HBase Table Sink
Key: FLINK-10248
URL: https://issues.apache.org/jira/browse/FLINK-10248
Project: Flink
Issue Type: Sub-task
Components
Shimin Yang created FLINK-10245:
---
Summary: Add DataStream HBase Sink
Key: FLINK-10245
URL: https://issues.apache.org/jira/browse/FLINK-10245
Project: Flink
Issue Type: Sub-task
Shimin Yang created FLINK-1:
---
Summary: There's a mistake in the comments of CoGroupedStreams.java
Key: FLINK-1
URL: https://issues.apache.org/jira/browse/FLINK-1
Project:
Hi Chesnay,
It's a good idea. And I just created a pull request on Flink-9567. Please
have a look if you had some free time.
Cheers,
Shimin
On Mon, Jul 2, 2018 at 7:17 PM vino yang wrote:
> +1
>
> 2018-07-02 18:19 GMT+08:00 Chesnay Schepler :
>
> > Hello,
> >
> > it has been a little over a mo
Congrats!
On Sat, Jun 23, 2018 at 1:13 AM Chen Qin wrote:
> Congrats!
>
> > On Jun 22, 2018, at 9:48 AM, Ted Yu wrote:
> >
> > Congratulations Sihua!
> >
> >> On Fri, Jun 22, 2018 at 6:42 AM, zhangminglei <18717838...@163.com>
> wrote:
> >>
> >> Congrats! Sihua
> >>
> >> Cheers
> >> Minglei.
>
Shimin Yang created FLINK-9567:
--
Summary: Flink does not release resource in Yarn Cluster mode
Key: FLINK-9567
URL: https://issues.apache.org/jira/browse/FLINK-9567
Project: Flink
Issue Type
28 matches
Mail list logo
