Thought it would be something the like đ Jean-Marc, in future, please âreply allâ for your answer such that the community can see it as well đ
Welcome anyway to the community Thias From: Jean-Marc Paulin <j...@uk.ibm.com> Sent: Friday, February 23, 2024 1:14 PM To: Schwalbe Matthias <matthias.schwa...@viseca.ch> Subject: Re: Not all the task slots are used. Are we missing a setting somewhere? â EXTERNAL MESSAGE â CAUTION: Think Before You Click â Ah, found our mistake.. Yes we do set the parallelism as part of the option we pass when we submit the job in the first place. Sorry for the bother Thias. JM ________________________________ From: Schwalbe Matthias <matthias.schwa...@viseca.ch<mailto:matthias.schwa...@viseca.ch>> Sent: Friday, February 23, 2024 10:21 To: Jean-Marc Paulin <j...@uk.ibm.com<mailto:j...@uk.ibm.com>>; user@flink.apache.org<mailto:user@flink.apache.org> <user@flink.apache.org<mailto:user@flink.apache.org>> Subject: [EXTERNAL] RE: Not all the task slots are used. Are we missing a setting somewhere? This Message Is From an External Sender This message came from outside your organization. Report Suspicious<https://us-phishalarm-ewt.proofpoint.com/EWT/v1/PjiDSg!2m-rCPRfAPMaEGU7OIElDv8JfEX3zZcJfO_N_APNRGxACPCSq5QB1T7f3b8qqNTFK8AEsf1J0Y4_Qp0vsX1y4EZ5$> Hi Jean-Marc, In absence of more context, did you adjust the parallelism of you job accordingly? Thias From: Jean-Marc Paulin <j...@uk.ibm.com<mailto:j...@uk.ibm.com>> Sent: Friday, February 23, 2024 11:06 AM To: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Q: Not all the task slots are used. Are we missing a setting somewhere? Hi, We used to run with 3 task managers with numberOfTaskSlots = 2. So all together we had 6 task slots and our application used them all. Trying to increase throughput, we increased the number of task managers to 6. So now we have 12 task slots all together. However our application still only uses 6 task slots, so we have 6 that are unused. Is there a setting I am missing somewhere ? Thanks JM Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU Diese Nachricht ist ausschliesslich fĂŒr den Adressaten bestimmt und beinhaltet unter UmstĂ€nden vertrauliche Mitteilungen. Da die Vertraulichkeit von e-Mail-Nachrichten nicht gewĂ€hrleistet werden kann, ĂŒbernehmen wir keine Haftung fĂŒr die GewĂ€hrung der Vertraulichkeit und Unversehrtheit dieser Mitteilung. Bei irrtĂŒmlicher Zustellung bitten wir Sie um Benachrichtigung per e-Mail und um Löschung dieser Nachricht sowie eventueller AnhĂ€nge. Jegliche unberechtigte Verwendung oder Verbreitung dieser Informationen ist streng verboten. This message is intended only for the named recipient and may contain confidential or privileged information. As the confidentiality of email communication cannot be guaranteed, we do not accept any responsibility for the confidentiality and the intactness of this message. If you have received it in error, please advise the sender by return e-mail and delete this message and any attachments. Any unauthorised use or dissemination of this information is strictly prohibited. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU Diese Nachricht ist ausschliesslich fĂŒr den Adressaten bestimmt und beinhaltet unter UmstĂ€nden vertrauliche Mitteilungen. Da die Vertraulichkeit von e-Mail-Nachrichten nicht gewĂ€hrleistet werden kann, ĂŒbernehmen wir keine Haftung fĂŒr die GewĂ€hrung der Vertraulichkeit und Unversehrtheit dieser Mitteilung. Bei irrtĂŒmlicher Zustellung bitten wir Sie um Benachrichtigung per e-Mail und um Löschung dieser Nachricht sowie eventueller AnhĂ€nge. Jegliche unberechtigte Verwendung oder Verbreitung dieser Informationen ist streng verboten. This message is intended only for the named recipient and may contain confidential or privileged information. As the confidentiality of email communication cannot be guaranteed, we do not accept any responsibility for the confidentiality and the intactness of this message. If you have received it in error, please advise the sender by return e-mail and delete this message and any attachments. Any unauthorised use or dissemination of this information is strictly prohibited.