Hadoop Admin in Columbus, Ohio

Any Visa Except H1b

 

 

Position:         Hadoop Admins

Location:        Columbus, Ohio

Duration:        8 months

Interview:       Phone Screen, Technical, Client Interview

 

Hadoop Admin Responsibilities:

• Responsible for implementation and ongoing administration of Hadoop infrastructure.
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hbase, SOLR, Kafka, Hive, Pig, Spark and MapReduce access for the new users.
• Cluster maintenance as well as creation and removal of nodes using Cloudera Manager Enterprise and/or Cloudera Express.
• Performance tuning of Hadoop clusters and Hadoop MapReduce/Spark routines.
• Screen Hadoop cluster job performances and capacity planning
• Monitor Hadoop cluster connectivity and security
• Manage and review Hadoop cluster log files.
• File system management and monitoring.
• Hadoop cluster support and maintenance.
• Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
• Collaborating with application teams to install Hadoop updates, patches, version upgrades when required.

 

DBA Responsibilities Performed by Hadoop Administrator:

• Software installation and configuration.
• Database backup and recovery.
• Database connectivity and security.
• Performance monitoring and tuning.
• Disk space management.
• Software patches and upgrades.

 

Skills Required to become a Hadoop Administrator:

• Expert knowledge of Linux as Hadoop runs on Linux.
• Good knowledge of JAVA.
• General operational expertise such as good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.
• Hadoop skills like HDFS, Hbase, Flume, Kafka and SOLR, Hive, MapReduce, Spark, etc.
• The most essential requirements are: They should be able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups.
• Thorough knowledge of Cloudera Manager and it’s API.
• Familiarity with open source configuration management and deployment tools such as git and Linux scripting.
• Good communication and documentation skills.

 

 

 

Regards,

Akshay Aggarwal| Recruiting Head

Trail Blazer Consulting LLC 

Tel: 914-274-6400 Ext 104

akshay@trailblazerit.com | www.trailblazerit.com