Re: Individual Parallelism support for Flink Runner

2020-06-29 Thread Akshay Iyangar
gt;>> wrote: > > It's an interesting question - this parameter is clearly very > runner specific (e.g. it would be meaningless for the Dataflow > runner, where parallelism is not a static constant). How should > we go about passing run

Individual Parallelism support for Flink Runner

2020-06-26 Thread Akshay Iyangar
Hi beam community, So I had brought this issue in our slack channel but I guess this warrants a deeper discussion and if we do go about what is the POA for it. So basically currently for Flink Runner we don’t support operator level parallelism which native Flink provides OOTB. So I was wonderin

Re: ** Configurable FluentBackoff for IO's **

2020-04-21 Thread Akshay Iyangar
/org/apache/beam/sdk/io/gcp/bigquery/InsertRetryPolicy.java On Thu, Apr 16, 2020 at 9:48 PM Akshay Iyangar mailto:aiyan...@godaddy.com>> wrote: Luke I think for [2] and [3] it would be a fair statement that may be they wanted to add a custom retry configuration. But [2] looks very specific

Re: ** Configurable FluentBackoff for IO's **

2020-04-16 Thread Akshay Iyangar
g/apache/beam/sdk/io/solr/SolrIO.java#L225 On Wed, Apr 15, 2020 at 11:59 AM Akshay Iyangar mailto:aiyan...@godaddy.com>> wrote: Hi I actually wanted a way to configure FluentBackoff at the client side for S3 in that effort I created below PR. But as luke mentioned in the PR FluentBack

** Configurable FluentBackoff for IO's **

2020-04-15 Thread Akshay Iyangar
Hi I actually wanted a way to configure FluentBackoff at the client side for S3 in that effort I created below PR. But as luke mentioned in the PR FluentBackoff is part of util and I can directly expose it to public. So a suggested alternative was to use a Configuration class that is public fa

** Regarding setting configurable S3Options **

2020-03-17 Thread Akshay Iyangar
Hi here, So I was interested in setting some Aws Client Configuraiton options for S3 to tune some of its client parameters according to my liking. I was going through the code and found that there is something called DefaultS3ClientBuilderFactory available and was thinking of using something

**Request to add me as a contributor.**

2019-05-29 Thread Akshay Iyangar
Hello everyone, My name is Akshay Iyangar, using beam repo extensively. There is a small patch that I would like to push through upstream. https://issues.apache.org/jira/browse/BEAM-7442 . I’m working on this issue and hope to become a contributor for Beam's JIRA issue tracker so that