[Solved-1 Solution] How to deploy and run oozie job in pig ?
What is oozie job ?
- Apache Oozie is a Java Web application used to schedule Apache Hadoop jobs.Oozie combines multiple jobs sequentially into one logical unit of work.
- The Workflow job has to wait. Oozie Coordinator jobs are recurrent Oozie Workflow jobs that are triggered by time and data availability.
Problem:
How to deploy and run oozie job in pig ?
Solution 1:
hadoop fs -put workflow.xml some_dir/
oozie job --oozie -config cluster_conf.xml -runcluster_conf.xml looks like this
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<configuration>
<property>
<name>nameNode</name>
<value>hdfs://my_nn:8020</value>
</property>
<property>
<name>jobTracker</name>
<value>my_jt:8050</value>
</property>
<property>
<name>oozie.wf.application.path</name>
<value>/user/my_user/some_dir/workflow.xml</value>
</property>
</configuration>