Hortonworks hadoop oozie 트러블슈팅

이번 포스팅은 HortonWorks에서 제공하는 hadoop 튜토리얼중 oozie를 설치하면서 생긴 문제점들을 정리했습니다

http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.3.1/bk_installing_manually_book/content/rpm-chap1.html

CentOS6

VritualBox 4.2.12 http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.3.1/bk_installing_manually_book/content/rpm-chap1.html

HortonWorks 튜토리얼 앞부분에 있는 환경 설정이 안되어 있다면 아래와 같이 oozie설치 진행이 안될 수 있습니다

oozie 3.2.0 Document 필요한 부분 번역

http://paranwater.tistory.com/395

이 문제를 해결 하려면 oozie 환경설정을 수정하고 Native library를 설치해야 합니다

oozie-env.sh 환경 설정은 제일 아래 보시면 java.library.path에 적혀 있는 설정을 /usr/local/lib 로 변경합니다

native library 설치는 http://www.solanara.net/solanara/tomcat#head_tomcat_inst_native 이 주소를 참고하시면 도움이 되실 겁니다
위 포스팅에서 아래 두 단계만 설치하시면 됩니다 아파치 톰캣은 oozie가 내부적으로 가지고 있습니다 (따로 실행 하는것도 가능합니다)
2. 라이브러리 : Apache Portable Runtime
5. Tomcat - Native library

아래 에러 문제 때문에 권한 바꾸고 진행하기

INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/hadoop/lib/native/Linux-amd64-64

su root

chown -R hadoop:hadoop /usr/lib/hadoop/lib/native/Linux-amd64-64
chmod -R 755 /usr/lib/hadoop/lib/native/Linux-amd64-64

su root

yum install oozie extjs-2.2-1

yum install oozie oozie-client

2.x으로 명령해서 실행되지 않은 쿼리

/usr/lib/oozie/bin/oozie-setup.sh -hadoop 2.x /usr/lib/hadoop -extjs /usr/share/HDP-oozie/ext-2.2.zip

/usr/lib/oozie/bin/oozie-setup.sh -hadoop 0.20.2 /usr/lib/hadoop -extjs /usr/share/HDP-oozie/ext-2.2.zip

2.x로 해서 실행되지 않은 쿼리

/usr/lib/oozie/bin/oozie-setup.sh -hadoop 2.x /usr/lib/hadoop -extjs /usr/share/HDP-oozie/ext-2.2.zip -jars /usr/lib/hadoop/lib/hadoop-lzo-0.5.0.jar

/usr/lib/oozie/bin/oozie-setup.sh -hadoop 0.20.2 /usr/lib/hadoop -extjs /usr/share/HDP-oozie/ext-2.2.zip -jars /usr/lib/hadoop/lib/hadoop-lzo-0.5.0.jar

/usr/lib/oozie/bin/oozie-setup.sh -hadoop 2.x /usr/lib/hadoop -extjs /usr/share/HDP-oozie/ext-2.2.zip -jars /usr/lib/hadoop/lib/hadoop-lzo-0.5.0.jar:/usr/share/java/mysql-connector-java.jar

각각의 파일 소유자와 권한을 수정해 줍니다

chown -R hadoop:hadoop /var/log/oozie
chmod -R 755 /var/log/oozie

chown -R hadoop:hadoop /etc/oozie/conf.dist/
chmod -R 755 /etc/oozie/conf.dist/

튜토리얼에서 제공하는 conf파일 oozie에서 oozie-site.xml 파일을 수정

Hortonworks튜토리얼에서는 mysql을 이용하게 설명되어있는데 default DB인 derby를 이용해서 진행합니다

<property>
<name>oozie.base.url</name>
<value>http://localhost:11000/oozie</value>
<description>Enter your Oozie server hostname.</description>
</property>

<property>

<name>oozie.service.JPAService.jdbc.driver</name>

<value>org.apache.derby.jdbc.EmbeddedDriver</value>

JDBC driver class.

</description>

</property>

<name>oozie.service.JPAService.jdbc.url</name>

<value>jdbc:derby:/home/hadoop/oozie/${oozie.db.schema.name}-db;create=true</value>

JDBC URL.

</description>

</property>

<name>oozie.service.JPAService.jdbc.username</name>

<value>hadoop</value>

DB user name.

</description>

</property>

<name>oozie.service.JPAService.jdbc.password</name>

<value>hadoop</value>

DB user password.

IMPORTANT: if password is emtpy leave a 1 space string, the service trims the value,

if empty Configuration assumes it is NULL.

</description>

</property>

hadoop/config/core-site.xml 아래에 이 설정 추가

<property>
<name>hadoop.proxyuser.hadoop.groups</name> <value>users</value> <description>Proxy group for Hadoop.</description> </property>

<property> <name>hadoop.proxyuser.hadoop.hosts</name> <value>*</value> <description>Proxy host for Hadoop.</description> </property>

oozie도 default conf에 파일이 있어서 수정한 conf파일을 default conf에 덮어 씌움

/home/hadoop/HDP~~~~~/conf~~~/oozie 파일을 수정

oozie-env.sh

Hortonworks 튜토리얼에서는 아래처럼 수정하라고 되어 있으나 실제 내용과는 달라서 아래 내용으로 수정함

<property>
<name>OOZIE_LOG_DIR</name>
<value>/var/log/oozie</value>
<description>Use value from $OOZIE_LOG_DIR </description>
</property>

<property>
<name>OOZIE_PID_DIR</name>
<value>/var/run/oozie</value>
<description>Use value from $OOZIE_PID_DIR </description>
</property>

<property>
<name>OOZIE_DATA_DIR</name>
<value>/var/db/oozie</value>
<description>Use value from $OOZIE_DATA_DIR </description>
</property>

실제 oozie-env.sh파일 내용이 이렇게 생겨서 위에 참고해서 수정함

# Oozie pid directory
#
export CATALINA_PID=/home/hadoop/id.pid

#Location of the data for oozie
export OOZIE_DATA=/home/hadoop/oozie

oozie-env.sh 환경설정 파일 가장 아래 부분에 설정

# set the libarary path to hadoop 64 bit native code dir
export JAVA_LIBRARY_PATH="/usr/local/lib"

su hadoop
/usr/lib/oozie/bin/oozie-start.sh

oozie-start.sh를 실행하니 나온 에러 해결

oozie-setup.sh 설정하는데 에러가 있었는데 확인 안된상태에서 진행 했더니 나오는 에러

2.x로 표시된 부분을 바꿔서 설정 했었어야함 0.20.2로 바꿔 명령 후 진행하니 문제없어짐

oozie-start.sh oozie-stop.sh
[hadoop@localhost ~]$ /usr/lib/oozie/bin/oozie-start.sh

Setting OOZIE_HOME:           /usr/lib/oozie
Sourcing:                     /usr/lib/oozie/bin/oozie-env.sh
setting OOZIE_CONFIG=${OOZIE_CONFIG:-/etc/oozie/conf}
setting OOZIE_DATA=${OOZIE_DATA:-/var/lib/oozie}
setting OOZIE_LOG=${OOZIE_LOG:-/var/log/oozie}
setting CATALINA_BASE=${CATALINA_BASE:-/var/lib/oozie/oozie-server}
setting CATALINA_TMPDIR=${CATALINA_TMPDIR:-/var/tmp/oozie}
setting CATALINA_PID=${CATALINA_PID:-/var/run/oozie/oozie.pid}
Using   OOZIE_CONFIG:         /etc/oozie/conf
Sourcing:                     /etc/oozie/conf/oozie-env.sh
setting JAVA_HOME=/usr/java/default
setting OOZIE_LOG=/var/log/oozie
setting CATALINA_PID=/home/hadoop/id
setting OOZIE_DATA=/home/hadoop/oozie
setting JAVA_LIBRARY_PATH="/usr/lib/hadoop/lib/native/Linux-amd64-64"
Setting OOZIE_CONFIG_FILE:   oozie-site.xml
Using   OOZIE_DATA:           /home/hadoop/oozie
Using   OOZIE_LOG:            /var/log/oozie
Setting OOZIE_LOG4J_FILE:     oozie-log4j.properties
Setting OOZIE_LOG4J_RELOAD: 10
Setting OOZIE_HTTP_HOSTNAME: localhost
Setting OOZIE_HTTP_PORT:      11000
Setting OOZIE_ADMIN_PORT:      11001
Setting OOZIE_BASE_URL:      http://localhost:11000/oozie
Using   CATALINA_BASE:        /var/lib/oozie/oozie-server
Setting CATALINA_OUT:         /var/log/oozie/catalina.out
Using   CATALINA_PID:         /home/hadoop/id

Using   CATALINA_OPTS:         -Dderby.stream.error.file=/var/log/oozie/derby.log
Adding to CATALINA_OPTS:      -Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie/conf -Doozie.log.dir=/var/log/oozie -Doozie.data.dir=/home/hadoop/oozie -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Doozie.http.hostname=localhost -Doozie.admin.port=11001 -Doozie.http.port=11000 -Doozie.base.url=http://localhost:11000/oozie -Djava.library.path=/usr/lib/hadoop/lib/native/Linux-amd64-64
WARN: Oozie WAR has not been set up at ''/var/lib/oozie/oozie-server/webapps'', doing default set up
setting OOZIE_CONFIG=${OOZIE_CONFIG:-/etc/oozie/conf}
setting OOZIE_DATA=${OOZIE_DATA:-/var/lib/oozie}
setting OOZIE_LOG=${OOZIE_LOG:-/var/log/oozie}
setting CATALINA_BASE=${CATALINA_BASE:-/var/lib/oozie/oozie-server}
setting CATALINA_TMPDIR=${CATALINA_TMPDIR:-/var/tmp/oozie}
setting CATALINA_PID=${CATALINA_PID:-/var/run/oozie/oozie.pid}
setting JAVA_HOME=/usr/java/default
setting OOZIE_LOG=/var/log/oozie
setting CATALINA_PID=/home/hadoop/id
setting OOZIE_DATA=/home/hadoop/oozie
setting JAVA_LIBRARY_PATH="/usr/lib/hadoop/lib/native/Linux-amd64-64"

ERROR: Stop Oozie first

[hadoop@localhost ~]$

su root

chown -R hadoop:hadoop /var/lib/oozie/
chmod -R 755 /var/lib/oozie/

mkdir /var/tmp/oozie

chown -R hadoop:hadoop /var/tmp/oozie/
chmod -R 755 /var/tmp/oozie/

su hadoop
/usr/lib/oozie/bin/oozie-start.sh

다른 에러가 나와서 해결중
/var/urn/oozie/catalina.2013-04-29.log 파일 내용

/var/lib/oozie/oozie-server/webapps/oozie/docs/oozie-default.xml 이 경로에 파일이 없음

webapps폴더 소유자가 oozie-oozie user로 되어 있어서인듯해 권한 수정 후 파일이 생성됨

su root

chown -R hadoop:hadoop /var/lib/oozie/oozie-server/webapps
chmod -R 755 /var/lib/oozie/oozie-server/webapps

Apr 29, 2013 3:54:37 AM org.apache.catalina.startup.Embedded initDirs
SEVERE: Cannot find specified temporary folder at /var/tmp/oozie
Apr 29, 2013 3:54:38 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/hadoop/lib/native/Linux-amd64-64
Apr 29, 2013 3:54:39 AM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-11000
Apr 29, 2013 3:54:39 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 1871 ms
Apr 29, 2013 3:54:39 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Apr 29, 2013 3:54:39 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.32
Apr 29, 2013 3:54:39 AM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive oozie.war
Apr 29, 2013 3:54:39 AM org.apache.catalina.startup.ContextConfig init
SEVERE: Exception fixing docBase for context [/oozie]
java.io.FileNotFoundException: /var/lib/oozie/oozie-server/webapps/oozie/docs/oozie-default.xml (No such file or directory)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
    at org.apache.catalina.startup.ExpandWar.expand(ExpandWar.java:457)
    at org.apache.catalina.startup.ExpandWar.expand(ExpandWar.java:173)
    at org.apache.catalina.startup.ContextConfig.fixDocBase(ContextConfig.java:886)
    at org.apache.catalina.startup.ContextConfig.init(ContextConfig.java:1021)
    at org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:279)
    at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
    at org.apache.catalina.core.StandardContext.init(StandardContext.java:5700)
    at org.apache.catalina.core.StandardContext.start(StandardContext.java:4448)
    at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
    at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
    at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601)
    at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
    at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
    at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
    at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1315)
    at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
    at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
    at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061)
    at org.apache.catalina.core.StandardHost.start(StandardHost.java:840)
    at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
    at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
    at org.apache.catalina.core.StandardService.start(StandardService.java:525)
    at org.apache.catalina.core.StandardServer.start(StandardServer.java:754)
    at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

위 폴더 권한 수정후 다른 에러 발생 확인 중

Existing PID file found during start.
Removing/clearing stale PID file.

/home/hadoop/id.pid파일을 삭제 하면 위에러는 나타나지 않음

[hadoop@localhost ~]$ /usr/lib/oozie/bin/oozie-start.sh

Setting OOZIE_HOME:           /usr/lib/oozie
Sourcing:                     /usr/lib/oozie/bin/oozie-env.sh
setting OOZIE_CONFIG=${OOZIE_CONFIG:-/etc/oozie/conf}
setting OOZIE_DATA=${OOZIE_DATA:-/var/lib/oozie}
setting OOZIE_LOG=${OOZIE_LOG:-/var/log/oozie}
setting CATALINA_BASE=${CATALINA_BASE:-/var/lib/oozie/oozie-server}
setting CATALINA_TMPDIR=${CATALINA_TMPDIR:-/var/tmp/oozie}
setting CATALINA_PID=${CATALINA_PID:-/var/run/oozie/oozie.pid}
Using   OOZIE_CONFIG:         /etc/oozie/conf
Sourcing:                     /etc/oozie/conf/oozie-env.sh
setting JAVA_HOME=/usr/java/default
setting OOZIE_LOG=/var/log/oozie
setting CATALINA_PID=/home/hadoop/id.pid
setting OOZIE_DATA=/home/hadoop/oozie
setting JAVA_LIBRARY_PATH="/usr/lib/hadoop/lib/native/Linux-amd64-64"
Setting OOZIE_CONFIG_FILE:   oozie-site.xml
Using   OOZIE_DATA:           /home/hadoop/oozie
Using   OOZIE_LOG:            /var/log/oozie
Setting OOZIE_LOG4J_FILE:     oozie-log4j.properties
Setting OOZIE_LOG4J_RELOAD: 10
Setting OOZIE_HTTP_HOSTNAME: localhost
Setting OOZIE_HTTP_PORT:      11000
Setting OOZIE_ADMIN_PORT:      11001
Setting OOZIE_BASE_URL:      http://localhost:11000/oozie
Using   CATALINA_BASE:        /var/lib/oozie/oozie-server
Setting CATALINA_OUT:         /var/log/oozie/catalina.out
Using   CATALINA_PID:         /home/hadoop/id.pid

Using   CATALINA_OPTS:         -Dderby.stream.error.file=/var/log/oozie/derby.log
Adding to CATALINA_OPTS:      -Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie/conf -Doozie.log.dir=/var/log/oozie -Doozie.data.dir=/home/hadoop/oozie -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Doozie.http.hostname=localhost -Doozie.admin.port=11001 -Doozie.http.port=11000 -Doozie.base.url=http://localhost:11000/oozie -Djava.library.path=/usr/lib/hadoop/lib/native/Linux-amd64-64

Using CATALINA_BASE:   /var/lib/oozie/oozie-server
Using CATALINA_HOME:   /usr/lib/oozie/oozie-server
Using CATALINA_TMPDIR: /var/tmp/oozie
Using JRE_HOME:         /usr/java/default
Using CLASSPATH:        /usr/lib/oozie/oozie-server/bin/bootstrap.jar
Using CATALINA_PID:     /home/hadoop/id.pid
Existing PID file found during start.
Removing/clearing stale PID file.
[hadoop@localhost ~]$

oozie 실행을 여러번 했더니 11000 포트에 대한 에러가 있어 해당 포트확인하고 pid확인해서 해결함

java.net.BindException: Address already in use <null>:11000

/usr/sbin/lsof -P -n -i tcp

해당하는 pid를 kill -9 로 강제 종료 시킴

Apr 29, 2013 4:21:45 AM org.apache.catalina.startup.Embedded initDirs
SEVERE: Cannot find specified temporary folder at /var/tmp/oozie
Apr 29, 2013 4:21:45 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/hadoop/lib/native/Linux-amd64-64
Apr 29, 2013 4:21:46 AM org.apache.coyote.http11.Http11Protocol init
SEVERE: Error initializing endpoint
java.net.BindException: Address already in use <null>:11000
    at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:549)
    at org.apache.coyote.http11.Http11Protocol.init(Http11Protocol.java:176)
    at org.apache.catalina.connector.Connector.initialize(Connector.java:1022)
    at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
    at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:838)
    at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
    at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)
Caused by: java.net.BindException: Address already in use
    at java.net.PlainSocketImpl.socketBind(Native Method)
    at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
    at java.net.ServerSocket.bind(ServerSocket.java:328)
    at java.net.ServerSocket.<init>(ServerSocket.java:194)
    at java.net.ServerSocket.<init>(ServerSocket.java:150)
    at org.apache.tomcat.util.net.DefaultServerSocketFactory.createSocket(DefaultServerSocketFactory.java:50)
    at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:538)
    ... 12 more
Apr 29, 2013 4:21:46 AM org.apache.catalina.core.StandardService initialize
SEVERE: Failed to initialize connector [Connector[HTTP/1.1-11000]]
LifecycleException: Protocol handler initialization failed: java.net.BindException: Address already in use <null>:11000
    at org.apache.catalina.connector.Connector.initialize(Connector.java:1024)
    at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
    at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:838)
    at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
    at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)
Apr 29, 2013 4:21:46 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 849 ms
Apr 29, 2013 4:21:46 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Apr 29, 2013 4:21:46 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.32
Apr 29, 2013 4:21:46 AM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive oozie.war

/var/log/oozie/ (oozie 로그 쌓는 위치)
catalina.2013-04-29.log 파일
이렇게 출력 중인데 http://localhost:11000/oozie 페이지가 열리지 않아 확인

/log/oozie/catalina.out에 있는 에러 로그를 확인하면 더 정확하게 볼 수 있음

Apr 29, 2013 9:12:22 PM org.apache.catalina.startup.Embedded initDirs

SEVERE: Cannot find specified temporary folder at /var/tmp/oozie ## 해당 경로에 폴더를 만들어서 해결

Apr 29, 2013 9:12:22 PM org.apache.catalina.core.AprLifecycleListener init

INFO: Loaded APR based Apache Tomcat Native library 1.1.27.

Apr 29, 2013 9:12:22 PM org.apache.catalina.core.AprLifecycleListener init

INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].

Apr 29, 2013 9:12:22 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: Failed to initialize the SSLEngine.

Apr 29, 2013 9:12:23 PM org.apache.coyote.http11.Http11AprProtocol init

INFO: Initializing Coyote HTTP/1.1 on http-11000

Apr 29, 2013 9:12:23 PM org.apache.catalina.startup.Catalina load

INFO: Initialization processed in 999 ms

Apr 29, 2013 9:12:23 PM org.apache.catalina.core.StandardService start

INFO: Starting service Catalina

Apr 29, 2013 9:12:23 PM org.apache.catalina.core.StandardEngine start

INFO: Starting Servlet Engine: Apache Tomcat/6.0.32

Apr 29, 2013 9:12:23 PM org.apache.catalina.startup.HostConfig deployWAR

INFO: Deploying web application archive oozie.war

Apr 29, 2013 10:27:37 PM org.apache.catalina.core.AprLifecycleListener init

INFO: Loaded APR based Apache Tomcat Native library 1.1.27.

Apr 29, 2013 10:27:37 PM org.apache.catalina.core.AprLifecycleListener init

INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].

Apr 29, 2013 10:27:38 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: Failed to initialize the SSLEngine.

Apr 29, 2013 10:27:38 PM org.apache.coyote.http11.Http11AprProtocol init

INFO: Initializing Coyote HTTP/1.1 on http-11000

Apr 29, 2013 10:27:38 PM org.apache.catalina.startup.Catalina load

INFO: Initialization processed in 851 ms

Apr 29, 2013 10:27:38 PM org.apache.catalina.core.StandardService start

INFO: Starting service Catalina

Apr 29, 2013 10:27:38 PM org.apache.catalina.core.StandardEngine start

INFO: Starting Servlet Engine: Apache Tomcat/6.0.32

Apr 29, 2013 10:27:38 PM org.apache.catalina.startup.HostConfig deployDescriptor

INFO: Deploying configuration descriptor oozie.xml

/log/oozie/catalina.out 로그 내용

Apr 30, 2013 1:44:09 AM org.apache.catalina.core.AprLifecycleListener init

INFO: Loaded APR based Apache Tomcat Native library 1.1.27.

Apr 30, 2013 1:44:09 AM org.apache.catalina.core.AprLifecycleListener init

INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].

Apr 30, 2013 1:44:09 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: Failed to initialize the SSLEngine.

Apr 30, 2013 1:44:09 AM org.apache.coyote.http11.Http11AprProtocol init

INFO: Initializing Coyote HTTP/1.1 on http-11000

Apr 30, 2013 1:44:09 AM org.apache.catalina.startup.Catalina load

INFO: Initialization processed in 861 ms

Apr 30, 2013 1:44:09 AM org.apache.catalina.core.StandardService start

INFO: Starting service Catalina

Apr 30, 2013 1:44:09 AM org.apache.catalina.core.StandardEngine start

INFO: Starting Servlet Engine: Apache Tomcat/6.0.32

Apr 30, 2013 1:44:09 AM org.apache.catalina.startup.HostConfig deployDescriptor

INFO: Deploying configuration descriptor oozie.xml

ERROR: Oozie could not be started

REASON: java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

Stacktrace:

-----------------------------------------------------------------

java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:37)

at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:34)

at org.apache.hadoop.security.UgiInstrumentation.create(UgiInstrumentation.java:51)

at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:216)

at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:226)

at org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:111)

at org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:77)

at org.apache.oozie.service.Services.setServiceInternal(Services.java:358)

at org.apache.oozie.service.Services.setService(Services.java:344)

at org.apache.oozie.service.Services.loadServices(Services.java:278)

at org.apache.oozie.service.Services.init(Services.java:202)

at org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:39)

at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4205)

at org.apache.catalina.core.StandardContext.start(StandardContext.java:4704)

at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)

at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)

at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601)

at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:675)

at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:601)

at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502)

at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1315)

at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)

at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)

at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061)

at org.apache.catalina.core.StandardHost.start(StandardHost.java:840)

at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)

at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)

at org.apache.catalina.core.StandardService.start(StandardService.java:525)

at org.apache.catalina.core.StandardServer.start(StandardServer.java:754)

at org.apache.catalina.startup.Catalina.start(Catalina.java:595)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)

at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration

at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1680)

at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)

... 36 more

/var/log/oozie/catalina.out에 있는 에러 해결

REASON: java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

폴더 소유자와 권한을 변경

chown -R hadoop:hadoop /usr/lib/oozie

chmod -R 755 /usr/lib/oozie

commons-configuration-1.6.jar파일을 복사

/usr/lib/oozie/oozie-server/lib 폴더에 복사

이렇게 시도 아래와 같은 에러는 표시안됨 (해결 된것으로 보임)

해결하는데 참고한 페이지

http://hbase.apache.org/book/trouble.versions.html

위 문제 해결 후 다시 에러 발생 해결

ooziedb를 실행해야 할 거 같아 실행 했는데 아래와 같은 에러가 나와 해결

[hadoop@localhost usr]$

[hadoop@localhost usr]$ su root

[root@localhost usr]# /usr/lib/oozie/bin/ooziedb.sh create -sqlfile oozie.sql -run Validate DB Connection

Validate DB Connection

DONE

Check DB schema does not exist

DONE

Check OOZIE_SYS table does not exist

DONE

Create SQL schema

DONE

Create OOZIE_SYS table

DONE

Oozie DB has been created for Oozie version '3.2.0.23'

The SQL commands have been written to: oozie.sql

[root@localhost usr]# su hadoop

Apr 30, 2013 1:58:15 AM org.apache.catalina.core.AprLifecycleListener init

INFO: Loaded APR based Apache Tomcat Native library 1.1.27.

Apr 30, 2013 1:58:15 AM org.apache.catalina.core.AprLifecycleListener init

INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].

Apr 30, 2013 1:58:15 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: Failed to initialize the SSLEngine.

Apr 30, 2013 1:58:15 AM org.apache.coyote.http11.Http11AprProtocol init

INFO: Initializing Coyote HTTP/1.1 on http-11000

Apr 30, 2013 1:58:15 AM org.apache.catalina.startup.Catalina load

INFO: Initialization processed in 929 ms

Apr 30, 2013 1:58:15 AM org.apache.catalina.core.StandardService start

INFO: Starting service Catalina

Apr 30, 2013 1:58:15 AM org.apache.catalina.core.StandardEngine start

INFO: Starting Servlet Engine: Apache Tomcat/6.0.32

Apr 30, 2013 1:58:15 AM org.apache.catalina.startup.HostConfig deployDescriptor

INFO: Deploying configuration descriptor oozie.xml

ERROR: Oozie could not be started

REASON: org.apache.oozie.service.ServiceException: E0103: Could not load service classes, Schema 'SA' does not exist {SELECT t0.bean_type, t0.conf, t0.console_url, t0.cred, t0.data, t0.error_code, t0.error_message, t0.external_child_ids, t0.external_id, t0.external_status, t0.name, t0.retries, t0.stats, t0.tracker_uri, t0.transition, t0.type, t0.user_retry_count, t0.user_retry_interval, t0.user_retry_max, t0.end_time, t0.execution_path, t0.last_check_time, t0.log_token, t0.pending, t0.pending_age, t0.signal_value, t0.sla_xml, t0.start_time, t0.status, t0.wf_id FROM WF_ACTIONS t0 WHERE t0.bean_type = ? AND t0.id = ?} [code=30000, state=42Y07]

Stacktrace:

-----------------------------------------------------------------

org.apache.oozie.service.ServiceException: E0103: Could not load service classes, Schema 'SA' does not exist {SELECT t0.bean_type, t0.conf, t0.console_url, t0.cred, t0.data, t0.error_code, t0.error_message, t0.external_child_ids, t0.external_id, t0.external_status, t0.name, t0.retries, t0.stats, t0.tracker_uri, t0.transition, t0.type, t0.user_retry_count, t0.user_retry_interval, t0.user_retry_max, t0.end_time, t0.execution_path, t0.last_check_time, t0.log_token, t0.pending, t0.pending_age, t0.signal_value, t0.sla_xml, t0.start_time, t0.status, t0.wf_id FROM WF_ACTIONS t0 WHERE t0.bean_type = ? AND t0.id = ?} [code=30000, state=42Y07]

at org.apache.oozie.service.Services.loadServices(Services.java:281)