i trying move data local file system hadoop distributed file system , not able move through oozie can move or copy data local filesystem hdfs using oozie ???
i found workaround problem. ssh action execute oozie server. if files located on local file system of oozie server, able copy them hdfs. ssh action executed 'oozie' user. ssh action should this: myuser@oozie-server-ip, myuser user read rights on files oozie server. next, need set passwordless ssh between oozie user , myuser, on oozie server. generate public key 'oozie' user , copy generated key in authorized_keys file of 'myuser'. command generating rsa key:
ssh-keygen -t rsa
when generating key, need logged in oozie user. on hadoop cluster user have home in /var/lib/oozie , public key generated in id_rsa.pub in /var/lib/oozie/.ssh next copy key in authorized_keys file of 'myuser'. find in user's home, in .ssh folder. have set passwordless ssh, time set ssh oozie action. action execute command 'hadoop' , have arguments '-copyfromlocal', '${local_file_path}' , '${hdfs_file_path}'.
Comments
Post a Comment