Hi, Parallelism is actually operator level, and each instance of the operator will occupy one slot. In some cases, Flink use chaining to chain multi operators to let them share one single slot, but sometimes it can not be done. If your job contains multiple operators and some of them cannot be chained, it's possible that the job will use more slots than the number of parallelism you configured.
Best, Kurt On Thu, Feb 9, 2017 at 2:19 AM, bwong247 <bw...@247-inc.com> wrote: > When I start my flink application with a -p parallelism value of 24, 29 > slots are used for the application. Is that expected behavior in some > scenarios? > > My application reads in an event stream from Kafka. It does some > filtering > and does a keyBy on the stream. Then it processes the same stream two > different ways. The first does some data extraction and writes to a sink > (it uses rocksdb to manage state). The second does a windowing on the > stream and writes to a different sink. > > > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/parallelism-and- > slots-allocated-tp11534.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >
