Thanks Peter. I attached sanitized /etc/oozie/3.0.0.0-1634/0/oozie-site.xml. Please let me know if you see any issue.
On Mon, Jul 30, 2018 at 1:23 AM, Peter Cseh <gezap...@cloudera.com.invalid> wrote: > Hi! > > I'm not familiar with the details of HDP, but based on the error message > your xml is not well formatted. > > Based on the code: > https://github.com/apache/oozie/blob/master/core/src/ > main/java/org/apache/oozie/service/JPAService.java#L198 > the issue is in your driver classname or url for the jdbc. > Please check the generated xml files, or share them after removing > confidential information. > > All the best, > gp > > > On Sun, Jul 29, 2018 at 7:24 PM Lian Jiang <jiangok2...@gmail.com> wrote: > > > Hi, > > > > I am installing HDP3.0 using ambari 2.7. OOZIE failed to start due to > below > > error: > > > > > > 2018-07-29 06:21:27,402 WARN ConfigurationService:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Invalid configuration > defined, > > [credentialStoreClassPath] > > 2018-07-29 06:21:27,406 WARN Services:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] System ID [oozie-oozi] > exceeds > > maximum length [10], trimming > > 2018-07-29 06:21:27,631 WARN ConfigUtils:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Using a deprecated > > configuration property > > [oozie.service.AuthorizationService.security.enabled], should use > > [oozie.service.AuthorizationService.authorization.enabled]. Please > delete > > the deprecated property in order for the new property to take effect. > > 2018-07-29 06:21:28,551 FATAL Services:514 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Runtime Exception during > > Services Load. Check your list of 'oozie.services' or > 'oozie.services.ext' > > 2018-07-29 06:21:28,558 FATAL Services:514 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] E0103: Could not load > service > > classes, Unmatched braces in the pattern. > > org.apache.oozie.service.ServiceException: E0103: Could not load service > > classes, Unmatched braces in the pattern. > > at > > org.apache.oozie.service.Services.loadServices(Services.java:309) > > at org.apache.oozie.service.Services.init(Services.java:213) > > at > > > > org.apache.oozie.servlet.ServicesLoader.contextInitialized( > ServicesLoader.java:46) > > at > > > > org.apache.catalina.core.StandardContext.listenerStart( > StandardContext.java:4276) > > at > > org.apache.catalina.core.StandardContext.start( > StandardContext.java:4779) > > at > > > > org.apache.catalina.core.ContainerBase.addChildInternal( > ContainerBase.java:803) > > at > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:780) > > at > > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) > > at > > > > org.apache.catalina.startup.HostConfig.deployDescriptor( > HostConfig.java:676) > > at > > > > org.apache.catalina.startup.HostConfig.deployDescriptors( > HostConfig.java:602) > > at > > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:503) > > at > > org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) > > at > > org.apache.catalina.startup.HostConfig.lifecycleEvent( > HostConfig.java:325) > > at > > > > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent( > LifecycleSupport.java:142) > > at > > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1069) > > at > > org.apache.catalina.core.StandardHost.start(StandardHost.java:822) > > at > > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061) > > at > > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) > > at > > org.apache.catalina.core.StandardService.start(StandardService.java:525) > > at > > org.apache.catalina.core.StandardServer.start(StandardServer.java:761) > > at org.apache.catalina.startup.Catalina.start(Catalina.java:595) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > > at > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > > at org.apache.catalina.startup.Bootstrap.start(Bootstrap. > java:289) > > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java: > 414) > > Caused by: java.lang.IllegalArgumentException: Unmatched braces in the > > pattern. > > at java.text.MessageFormat.applyPattern(MessageFormat.java:508) > > at java.text.MessageFormat.<init>(MessageFormat.java:362) > > at java.text.MessageFormat.format(MessageFormat.java:840) > > at org.apache.oozie.service.JPAService.init(JPAService.java:197) > > at > > org.apache.oozie.service.Services.setServiceInternal(Services.java:386) > > at org.apache.oozie.service.Services.setService(Services. > java:372) > > at > > org.apache.oozie.service.Services.loadServices(Services.java:305) > > ... 26 more > > > > > > > > My oozie settings which worked in HDP2.6 is: > > > > { > > "oozie-site": { > > "properties": { > > "oozie.service.JPAService.jdbc.username": "admin", > > "oozie.service.JPAService.jdbc.password": > "%SERVICE_PASSWORD%", > > "oozie.email.from.address": "had...@something.com", > > "oozie.email.smtp.auth": "Yes", > > "oozie.email.smtp.host": "localhost", > > "oozie.email.smtp.username": "admin", > > "oozie.email.smtp.password": "%EMAIL_PASSWORD%" > > } > > } > > } > > > > Any idea? Thanks for any hints. > > > > > -- > *Peter Cseh *| Software Engineer > cloudera.com <https://www.cloudera.com> > > [image: Cloudera] <https://www.cloudera.com/> > > [image: Cloudera on Twitter] <https://twitter.com/cloudera> [image: > Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera > on LinkedIn] <https://www.linkedin.com/company/cloudera> > ------------------------------ >
<configuration xmlns:xi="http://www.w3.org/2001/XInclude";> <property> <name>credentialStoreClassPath</name> <value>/var/lib/ambari-agent/cred/lib/*</value> </property> <property> <name>hadoop.security.credential.provider.path</name> <value>localjceks://file/usr/hdp/current/oozie-server/conf/oozie-site.jceks</value> </property> <property> <name>oozie.action.retry.interval</name> <value>30</value> </property> <property> <name>oozie.authentication.authentication.provider.url</name> <value></value> </property> <property> <name>oozie.authentication.expected.jwt.audiences</name> <value></value> </property> <property> <name>oozie.authentication.jwt.cookie</name> <value>hadoop-jwt</value> </property> <property> <name>oozie.authentication.public.key.pem</name> <value></value> </property> <property> <name>oozie.authentication.simple.anonymous.allowed</name> <value>true</value> </property> <property> <name>oozie.authentication.type</name> <value>simple</value> </property> <property> <name>oozie.base.url</name> <value>http://host.myvcn.com:11000/oozie</value> </property> <property> <name>oozie.credentials.credentialclasses</name> <value>hcat=org.apache.oozie.action.hadoop.HCatCredentials,hive2=org.apache.oozie.action.hadoop.Hive2Credentials</value> </property> <property> <name>oozie.db.schema.name</name> <value>oozie</value> </property> <property> <name>oozie.email.from.address</name> <value>had...@myvcn.com</value> </property> <property> <name>oozie.email.smtp.auth</name> <value>Yes</value> </property> <property> <name>oozie.email.smtp.host</name> <value>localhost</value> </property> <property> <name>oozie.email.smtp.password</name> <value>mypassword</value> </property> <property> <name>oozie.email.smtp.username</name> <value>myusername</value> </property> <property> <name>oozie.service.ActionService.executor.ext.classes</name> <value> org.apache.oozie.action.email.EmailActionExecutor, org.apache.oozie.action.hadoop.ShellActionExecutor, org.apache.oozie.action.hadoop.SqoopActionExecutor, org.apache.oozie.action.hadoop.DistcpActionExecutor</value> </property> <property> <name>oozie.service.AuthorizationService.security.enabled</name> <value>true</value> </property> <property> <name>oozie.service.CallableQueueService.callable.concurrency</name> <value>3</value> </property> <property> <name>oozie.service.CallableQueueService.queue.size</name> <value>1000</value> </property> <property> <name>oozie.service.CallableQueueService.threads</name> <value>11</value> </property> <property> <name>oozie.service.coord.normal.default.timeout</name> <value>120</value> </property> <property> <name>oozie.service.coord.push.check.requeue.interval</name> <value>30000</value> </property> <property> <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> <value>*=/usr/hdp/3.0.0.0-1634/hadoop/conf</value> </property> <property> <name>oozie.service.HadoopAccessorService.kerberos.enabled</name> <value>false</value> </property> <property> <name>oozie.service.JPAService.create.db.schema</name> <value>false</value> </property> <property> <name>oozie.service.JPAService.jdbc.driver</name> <value>org.apache.derby.jdbc.EmbeddedDriver</value> </property> <property> <name>oozie.service.JPAService.jdbc.url</name> <value>jdbc:derby:${oozie.data.dir}/${oozie.db.schema.name}-db;create=true</value> </property> <property> <name>oozie.service.JPAService.jdbc.username</name> <value>myusername</value> </property> <property> <name>oozie.service.JPAService.pool.max.active.conn</name> <value>10</value> </property> <property> <name>oozie.service.PurgeService.older.than</name> <value>30</value> </property> <property> <name>oozie.service.PurgeService.purge.interval</name> <value>3600</value> </property> <property> <name>oozie.service.SchemaService.wf.ext.schemas</name> <value>shell-action-0.1.xsd,email-action-0.1.xsd,hive-action-0.2.xsd,sqoop-action-0.2.xsd,ssh-action-0.1.xsd,distcp-action-0.1.xsd,shell-action-0.2.xsd,oozie-sla-0.1.xsd,oozie-sla-0.2.xsd,hive-action-0.3.xsd</value> </property> <property> <name>oozie.service.SparkConfigurationService.spark.configurations</name> <value>*=/usr/hdp/current/spark-client/conf</value> </property> <property> <name>oozie.service.URIHandlerService.uri.handlers</name> <value>org.apache.oozie.dependency.FSURIHandler,org.apache.oozie.dependency.HCatURIHandler</value> </property> <property> <name>oozie.service.WorkflowAppService.system.libpath</name> <value>/user/${user.name}/share/lib</value> </property> <property> <name>oozie.services</name> <value> org.apache.oozie.service.SchedulerService, org.apache.oozie.service.InstrumentationService, org.apache.oozie.service.CallableQueueService, org.apache.oozie.service.UUIDService, org.apache.oozie.service.ELService, org.apache.oozie.service.AuthorizationService, org.apache.oozie.service.UserGroupInformationService, org.apache.oozie.service.HadoopAccessorService, org.apache.oozie.service.URIHandlerService, org.apache.oozie.service.MemoryLocksService, org.apache.oozie.service.DagXLogInfoService, org.apache.oozie.service.SchemaService, org.apache.oozie.service.LiteWorkflowAppService, org.apache.oozie.service.JPAService, org.apache.oozie.service.StoreService, org.apache.oozie.service.SLAStoreService, org.apache.oozie.service.DBLiteWorkflowStoreService, org.apache.oozie.service.CallbackService, org.apache.oozie.service.ActionService, org.apache.oozie.service.ActionCheckerService, org.apache.oozie.service.RecoveryService, org.apache.oozie.service.PurgeService, org.apache.oozie.service.CoordinatorEngineService, org.apache.oozie.service.BundleEngineService, org.apache.oozie.service.DagEngineService, org.apache.oozie.service.CoordMaterializeTriggerService, org.apache.oozie.service.StatusTransitService, org.apache.oozie.service.PauseTransitService, org.apache.oozie.service.GroupsService, org.apache.oozie.service.ProxyUserService, org.apache.oozie.service.JobsConcurrencyService, org.apache.oozie.service.ShareLibService, org.apache.oozie.service.SparkConfigurationService, org.apache.oozie.service.XLogStreamingService</value> </property> <property> <name>oozie.services.ext</name> <value> org.apache.oozie.service.JMSAccessorService,org.apache.oozie.service.PartitionDependencyManagerService,org.apache.oozie.service.HCatAccessorService</value> </property> <property> <name>oozie.system.id</name> <value>oozie-${user.name}</value> </property> <property> <name>oozie.systemmode</name> <value>NORMAL</value> </property> <property> <name>use.system.libpath.for.mapreduce.and.pig.jobs</name> <value>false</value> </property> </configuration>
