Specialist - Architecture

Deploying maintaining the Hadoop cluster adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager configuring the NameNode high availability

Keeping a track of all the running Hadoop jobs

Implementing managing and administering the overall Hadoop infrastructure

Takes care of the daytoday running of Hadoop clusters

Work closely with the database team network team BI team and application teams to make sure that all the big data applications are highly available and performing as expected

Knowledge on Apache Distribution have to manually setup all the configurations CoreSite HDFSSite YARNSite and Map RedSite

Aware of the configuration setup using Hadoop distribution like Hortonworks Cloudera or MapR

Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster deciding the size of the Hadoop cluster based on the data to be stored in HDFS

Ensure that the Hadoop cluster is up and running all the time Monitoring the cluster connectivity and performance

Manage and review Hadoop log files Backup and recovery tasks Resource and security management

Troubleshooting application errors

 Skills Required

4 years min experience as Cloudera Admin

Preferably Cloudera Hadoop Admin Certification

Excellent knowledge of RedHat Linux 5 years Experience

Excellent oral verbal communication

Prefer prior experience in BFS Domain large Cloudera Hadoop cluster admin and performance tuning experiences  Need these both in NAM and India

Configuration management and automation tools like Puppet or Chef for nontrivial installation

Cluster monitoring tools like Ambari Ganglia or Nagios

 Good to Have

Knowing core java good understanding of OS concepts process management and resource scheduling

Basics of networking CPU memory and storage Good hold of shell scripting

Exposure to the components in the Hadoop ecosystem like Apache Pig Apache Hive Apache Mahout etc