Hello,
I am new to Beam and am trying to get a simple example pipeline running on
EMR using the Flink Runner. I am getting the following error message.
Caused by: java.lang.NoClassDefFoundError: Could not initialize class
org.apache.beam.runners.core.construction.SerializablePipelineOptions
at java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:
1955)
at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:79)
at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:275)
at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:273)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:
272)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:694)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:
2003)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1850)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:
2160)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:
2405)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:
2187)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)
at org.apache.flink.util.InstantiationUtil.deserializeObject(
InstantiationUtil.java:615)
at org.apache.flink.util.InstantiationUtil.deserializeObject(
InstantiationUtil.java:600)
at org.apache.flink.util.InstantiationUtil.deserializeObject(
InstantiationUtil.java:587)
at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(
InstantiationUtil.java:541)
at org.apache.flink.api.java.typeutils.runtime.RuntimeSerializerFactory
.readParametersFromConfig(RuntimeSerializerFactory.java:78)
at org.apache.flink.runtime.operators.util.TaskConfig
.getTypeSerializerFactory(TaskConfig.java:1246)
at org.apache.flink.runtime.operators.util.TaskConfig
.getOutputSerializer(TaskConfig.java:599)
at org.apache.flink.runtime.operators.DataSourceTask.initInputFormat(
DataSourceTask.java:318)
at org.apache.flink.runtime.operators.DataSourceTask.invoke(
DataSourceTask.java:102)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:570)
at java.lang.Thread.run(Thread.java:748)
Here is my pipeline:
def run(port):
options = PipelineOptions([
"--runner=FlinkRunner",
"--flink_version=1.12",
f"--flink_master=127.0.0.1:{port}",
"--environment_type=DOCKER",
'--environment_config=docker-image'
])
with beam.Pipeline(options=options) as p:
(p
| 'Create words' >> beam.Create(['to be or not to be'])
| 'Split words' >> beam.FlatMap(lambda words: words.split(' '))
| 'Write to file' >> WriteToText('test.txt')
)
if __name__ == "__main__":
run(8081)
The master url is localhost because I am using a ssh tunnel (not shown).
Has anyone seen this error before? I am running on EMR 6.3.0 and Flink 1.12.1.
Thanks,
Trevor
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function lift_combiners at 0x12fbadaf0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sort_stages at 0x12fbac280> ====================
INFO:apache_beam.runners.portability.flink_runner:Adding HTTP protocol
scheme to flink_master parameter: http://127.0.0.1:64831
INFO:apache_beam.utils.subprocess_server:Using cached job server jar
from
https://repo.maven.apache.org/maven2/org/apache/beam/beam-runners-flink-1.12-job-server/2.29.0/beam-runners-flink-1.12-job-server-2.29.0.jar
INFO:apache_beam.utils.subprocess_server:Starting service with ['java'
'-jar'
'/Users/tkramer/.apache_beam/cache/jars/beam-runners-flink-1.12-job-server-2.29.0.jar'
'--flink-master' 'http://127.0.0.1:64831' '--artifacts-dir'
'/var/folders/np/lbz94j017px4t8zktt86pbrc0000gp/T/beam-tempuhv3qq6j/artifactsz7a040z7'
'--job-port' '64832' '--artifact-port' '0' '--expansion-port' '0']
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:08 AM
org.apache.beam.runners.jobsubmission.JobServerDriver
createArtifactStagingService'
INFO:apache_beam.utils.subprocess_server:b'INFO:
ArtifactStagingService started on localhost:64839'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:08 AM
org.apache.beam.runners.jobsubmission.JobServerDriver
createExpansionService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Java ExpansionService
started on localhost:64840'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:08 AM
org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer'
INFO:apache_beam.utils.subprocess_server:b'INFO: JobService started on
localhost:64832'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:08 AM
org.apache.beam.runners.jobsubmission.JobServerDriver run'
INFO:apache_beam.utils.subprocess_server:b'INFO: Job server now
running, terminate with Ctrl+C'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:09 AM
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2
onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Staging artifacts for
job_e7c7279f-8ee4-4aec-9a07-cc7e41a5ec69.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:09 AM
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2
resolveNextEnvironment'
INFO:apache_beam.utils.subprocess_server:b'INFO: Resolving artifacts
for
job_e7c7279f-8ee4-4aec-9a07-cc7e41a5ec69.ref_Environment_default_environment_1.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:09 AM
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2
onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Getting 0 artifacts
for job_e7c7279f-8ee4-4aec-9a07-cc7e41a5ec69.null.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:09 AM
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2
finishStaging'
INFO:apache_beam.utils.subprocess_server:b'INFO: Artifacts fully
staged for job_e7c7279f-8ee4-4aec-9a07-cc7e41a5ec69.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor'
INFO:apache_beam.utils.subprocess_server:b'INFO: Invoking job
BeamApp-tkramer-0604133209-e2e8e10c_6f8db917-be94-4d2c-b83c-bdc1931fc98c
with pipeline runner
org.apache.beam.runners.flink.FlinkPipelineRunner@486a1da2'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.beam.runners.jobsubmission.JobInvocation start'
INFO:apache_beam.utils.subprocess_server:b'INFO: Starting job
invocation
BeamApp-tkramer-0604133209-e2e8e10c_6f8db917-be94-4d2c-b83c-bdc1931fc98c'
INFO:apache_beam.runners.portability.portable_runner:Job state changed
to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed
to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed
to RUNNING
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.beam.runners.flink.FlinkPipelineRunner
runPipelineWithTranslator'
INFO:apache_beam.utils.subprocess_server:b'INFO: Translating pipeline
to Flink program.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.beam.runners.flink.FlinkExecutionEnvironments
createBatchExecutionEnvironment'
INFO:apache_beam.utils.subprocess_server:b'INFO: Creating a Batch
Execution Environment.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.beam.runners.flink.FlinkExecutionEnvironments
createBatchExecutionEnvironment'
INFO:apache_beam.utils.subprocess_server:b'INFO: Using Flink Master
URL 127.0.0.1:64831.'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:10 AM
org.apache.flink.api.java.utils.PlanGenerator
logTypeRegistrationDetails'
INFO:apache_beam.utils.subprocess_server:b'INFO: The job has 0
registered types and 0 default Kryo serializers'
INFO:apache_beam.utils.subprocess_server:b'Jun 04, 2021 8:32:45 AM
org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure'
INFO:apache_beam.utils.subprocess_server:b'SEVERE: Error during job
invocation
BeamApp-tkramer-0604133209-e2e8e10c_6f8db917-be94-4d2c-b83c-bdc1931fc98c.'
INFO:apache_beam.utils.subprocess_server:b'org.apache.flink.client.program.ProgramInvocationException:
Job failed (JobID: bd9cbe27f544153464b72542eb32645a)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:125)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$22(RestClusterClient.java:665)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:394)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.lang.Thread.run(Thread.java:748)'
INFO:apache_beam.utils.subprocess_server:b'Caused by:
org.apache.flink.runtime.client.JobExecutionException: Job execution
failed.'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:123)'
INFO:apache_beam.utils.subprocess_server:b'\t... 19 more'
INFO:apache_beam.utils.subprocess_server:b'Caused by:
org.apache.flink.runtime.JobException: Recovery is suppressed by
NoRestartBackoffTimeStrategy'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:118)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:80)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:233)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:224)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:215)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:665)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:89)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:447)'
INFO:apache_beam.utils.subprocess_server:b'\tat
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)'
INFO:apache_beam.utils.subprocess_server:b'\tat
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)'
INFO:apache_beam.utils.subprocess_server:b'\tat
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.lang.reflect.Method.invoke(Method.java:498)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:306)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:159)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)'
INFO:apache_beam.utils.subprocess_server:b'\tat
scala.PartialFunction.applyOrElse(PartialFunction.scala:123)'
INFO:apache_beam.utils.subprocess_server:b'\tat
scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)'
INFO:apache_beam.utils.subprocess_server:b'\tat
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)'
INFO:apache_beam.utils.subprocess_server:b'\tat
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)'
INFO:apache_beam.utils.subprocess_server:b'\tat
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.actor.Actor.aroundReceive(Actor.scala:517)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.actor.Actor.aroundReceive$(Actor.scala:515)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.actor.ActorCell.invoke(ActorCell.scala:561)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.Mailbox.run(Mailbox.scala:225)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.Mailbox.exec(Mailbox.scala:235)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)'
INFO:apache_beam.utils.subprocess_server:b'\tat
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)'
INFO:apache_beam.utils.subprocess_server:b'Caused by:
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.beam.runners.core.construction.SerializablePipelineOptions'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass.hasStaticInitializer(Native Method)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1955)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:79)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:275)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:273)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.security.AccessController.doPrivileged(Native Method)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:272)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:694)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2003)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1850)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2160)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.api.java.typeutils.runtime.RuntimeSerializerFactory.readParametersFromConfig(RuntimeSerializerFactory.java:78)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.util.TaskConfig.getTypeSerializerFactory(TaskConfig.java:1246)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.util.TaskConfig.getOutputSerializer(TaskConfig.java:599)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.BatchTask.getOutputCollector(BatchTask.java:1357)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.BatchTask.initOutputs(BatchTask.java:1441)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.BatchTask.initOutputs(BatchTask.java:1127)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:242)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755)'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.taskmanager.Task.run(Task.java:570)'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.lang.Thread.run(Thread.java:748)'
INFO:apache_beam.utils.subprocess_server:b''
ERROR:root:java.lang.NoClassDefFoundError: Could not initialize class
org.apache.beam.runners.core.construction.SerializablePipelineOptions
INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED
Traceback (most recent call last):
File "/Users/tkramer/PycharmProjects/RelayTxBeam/beam-test.py", line
33, in <module>
run(tunnel.local_bind_port)
File "/Users/tkramer/PycharmProjects/RelayTxBeam/beam-test.py", line
19, in run
(p
File
"/Users/tkramer/PycharmProjects/RelayTxBeam/venv/lib/python3.8/site-packages/apache_beam/pipeline.py",
line 583, in __exit__
self.result.wait_until_finish()
File
"/Users/tkramer/PycharmProjects/RelayTxBeam/venv/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",
line 602, in wait_until_finish
raise self._runtime_exception
RuntimeError: Pipeline
BeamApp-tkramer-0604133209-e2e8e10c_6f8db917-be94-4d2c-b83c-bdc1931fc98c
failed in state FAILED: java.lang.NoClassDefFoundError: Could not
initialize class
org.apache.beam.runners.core.construction.SerializablePipelineOptions
