Hi Jaymik,

This class (MemoryMonitorOptions) was indeed introduced in Beam 2.50.0.

My guess is that somehow dependencies were upgraded only partially (for
example, just the Runner module, but not Core).
A good way to make sure that all dependencies are upgraded correctly is to
use a BOM (Bill of Materials) and omit pinning a specific <version> for
every Beam artifact.

Please take a look at
https://beam.apache.org/blog/managing-beam-dependencies-in-java/ and see if
it helps.

In case it still doesn't work, running "mvn dependency:tree" might help
understanding which dependencies are being pulled.

Best,
Bruno



On Thu, Oct 12, 2023 at 5:50 PM Deliwala, Jaymik H. via dev <
dev@beam.apache.org> wrote:

> Hello Team
>
>
>
> Greetings!!
>
>
>
> As part of upgrading our Dataflow - Apache beam version from 2.46.0 to
> 2.49.0/2.50.0, we are able to compile the mvn package successfully.
>
> However, while running the compile exec command, we are getting an error
> as below - *org.apache.beam.sdk.options.MemoryMonitorOptions -
> NoClassefFoundError*
>
>
>
>
> 2023-10-12T10:39:17.9662373Z java.lang.NoClassDefFoundError: 
> org/apache/beam/sdk/options/MemoryMonitorOptions
>
>
> 2023-10-12T10:39:17.9665631Z     at java.lang.ClassLoader.defineClass1 
> (Native Method)
>
>
> 2023-10-12T10:39:17.9668538Z     at java.lang.ClassLoader.defineClass 
> (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9670605Z     at 
> java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9672586Z     at java.net.URLClassLoader.defineClass 
> (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9674516Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9676939Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9678816Z     at 
> java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9690248Z     at java.net.URLClassLoader.findClass 
> (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9692252Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9694175Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9696026Z     at java.lang.ClassLoader.defineClass1 
> (Native Method)
>
>
> 2023-10-12T10:39:17.9699991Z     at java.lang.ClassLoader.defineClass 
> (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9704965Z     at 
> java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9706908Z     at java.net.URLClassLoader.defineClass 
> (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9708814Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9710696Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9712552Z     at 
> java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9714469Z     at java.net.URLClassLoader.findClass 
> (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9716698Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9718622Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9720635Z     at 
> org.apache.beam.runners.dataflow.DataflowPipelineRegistrar$Options.getPipelineOptions
>  (DataflowPipelineRegistrar.java:40)
>
>
> 2023-10-12T10:39:17.9722611Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.initializeRegistry 
> (PipelineOptionsFactory.java:2090)
>
>
> 2023-10-12T10:39:17.9724487Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> 
> (PipelineOptionsFactory.java:2083)
>
>
> 2023-10-12T10:39:17.9726421Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> 
> (PipelineOptionsFactory.java:2047)
>
>
> 2023-10-12T10:39:17.9728327Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.resetCache 
> (PipelineOptionsFactory.java:581)
>
>
> 2023-10-12T10:39:17.9730230Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.<clinit> 
> (PipelineOptionsFactory.java:547)
>
>
> 2023-10-12T10:39:17.9732113Z     at cio.mmt.PubSubTopicsToBigQuery.main 
> (PubSubTopicsToBigQuery.java:55)
>
>
> 2023-10-12T10:39:17.9734009Z     at org.codehaus.mojo.exec.ExecJavaMojo$1.run 
> (ExecJavaMojo.java:254)
>
> 2023-10-12T10:39:17.9743608Z     at java.lang.Thread.run (Thread.java:829)
>
>
> 2023-10-12T10:39:17.9745720Z Caused by: java.lang.ClassNotFoundException: 
> org.apache.beam.sdk.options.MemoryMonitorOptions
>
>
> 2023-10-12T10:39:17.9748376Z     at java.net.URLClassLoader.findClass 
> (URLClassLoader.java:476)
>
>
> 2023-10-12T10:39:17.9750298Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9752205Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9754041Z     at java.lang.ClassLoader.defineClass1 
> (Native Method)
>
>
> 2023-10-12T10:39:17.9756293Z     at java.lang.ClassLoader.defineClass 
> (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9758225Z     at 
> java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9760115Z     at java.net.URLClassLoader.defineClass 
> (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9761982Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9763915Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9765721Z     at 
> java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9767732Z     at java.net.URLClassLoader.findClass 
> (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9769643Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9771552Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9821607Z     at java.lang.ClassLoader.defineClass1 
> (Native Method)
>
>
> 2023-10-12T10:39:17.9824027Z     at java.lang.ClassLoader.defineClass 
> (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9825945Z     at 
> java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9827873Z     at java.net.URLClassLoader.defineClass 
> (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9829648Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9831550Z     at java.net.URLClassLoader$1.run 
> (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9833326Z     at 
> java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9835504Z     at java.net.URLClassLoader.findClass 
> (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9837376Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9839129Z     at java.lang.ClassLoader.loadClass 
> (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9840848Z     at 
> org.apache.beam.runners.dataflow.DataflowPipelineRegistrar$Options.getPipelineOptions
>  (DataflowPipelineRegistrar.java:40)
>
>
> 2023-10-12T10:39:17.9846061Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.initializeRegistry 
> (PipelineOptionsFactory.java:2090)
>
>
> 2023-10-12T10:39:17.9847894Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> 
> (PipelineOptionsFactory.java:2083)
>
>
> 2023-10-12T10:39:17.9849601Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> 
> (PipelineOptionsFactory.java:2047)
>
>
> 2023-10-12T10:39:17.9851239Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.resetCache 
> (PipelineOptionsFactory.java:581)
>
>
> 2023-10-12T10:39:17.9852896Z     at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.<clinit> 
> (PipelineOptionsFactory.java:547)
>
>
> 2023-10-12T10:39:17.9854577Z     at cio.mmt.PubSubTopicsToBigQuery.main 
> (PubSubTopicsToBigQuery.java:55)
>
>
> 2023-10-12T10:39:17.9856188Z     at org.codehaus.mojo.exec.ExecJavaMojo$1.run 
> (ExecJavaMojo.java:254)
>
> 2023-10-12T10:39:17.9857817Z     at java.lang.Thread.run (Thread.java:829)
>
>
> 2023-10-12T10:39:17.9885576Z [INFO] 
> ------------------------------------------------------------------------
>
> 2023-10-12T10:39:17.9885795Z [INFO] BUILD FAILURE
>
>
> 2023-10-12T10:39:17.9886047Z [INFO] 
> ------------------------------------------------------------------------
>
> 2023-10-12T10:39:17.9886514Z [INFO] Total time:  8.555 s
>
> 2023-10-12T10:39:17.9886767Z [INFO] Finished at: 2023-10-12T10:39:17Z
>
>
> 2023-10-12T10:39:17.9887048Z [INFO] 
> ------------------------------------------------------------------------
>
>
> 2023-10-12T10:39:17.9934156Z [ERROR] Failed to execute goal 
> org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-
> *cli) on project bigquery: An exception occured while executing the Java 
> class. org/apache/beam/sdk/options/MemoryMonitorOptions: 
> org.apache.beam.sdk.options.MemoryMonitorOptions -> [Help 1]*
>
> May you assist on the resolving the issue.
>
>
>
> Thanks
>
> Jaymik Deliwala.
>
> ------------------------------
>
> This message is for the designated recipient only and may contain
> privileged, proprietary, or otherwise confidential information. If you have
> received it in error, please notify the sender immediately and delete the
> original. Any other use of the e-mail by you is prohibited. Where allowed
> by local law, electronic communications with Accenture and its affiliates,
> including e-mail and instant messaging (including content), may be scanned
> by our systems for the purposes of information security, AI-powered support
> capabilities, and assessment of internal compliance with Accenture policy.
> Your privacy is important to us. Accenture uses your personal data only in
> compliance with data protection laws. For further information on how
> Accenture processes your personal data, please see our privacy statement at
> https://www.accenture.com/us-en/privacy-policy.
>
> ______________________________________________________________________________________
>
> www.accenture.com
>

Reply via email to