Hadoop Developer | Ashburn, VA / Irving, TX | 1+ Year

Hi,

Hope you are doing well.  

 

Position: Hadoop Developer

Location: Ashburn, VA / Irving, TX

Duration: 1+ Year           

 

Qualifications:

·         At least 4+ years working experience in a Big Data Environment

·         Knowledge on design and development best practices in datawarehouse environments

·         Experience developing large scale distributed computing systems

·         Knowledge of Hadoop ecosystem and its components – HBase, Pig, Hive, Sqoop, Flume, Oozie, etc.

·         Experience of Pyspark & Spark SQL

·         Experience with integration of data from multiple data sources

·         Implement ETL process in Hadoop (Develop big data ETL jobs that ingest, integrate, and export data.) Converting Teradata SQL to PySpark SQL.

 

Roles and Responsibilities

·         Understanding business requirements & helping in assessing them with the development teams.

·         Creating high quality documentation supporting the design/coding tasks.

·         Participate in architecture / design discussions and Develop the ETL/ELT using PySpark and SparkSql

·         Conduct code and design reviews and provide review feedback.

·         Identify areas of improvement in framework and processes and strive them to make better.

 

Ram. M | IT Recruiter  | Techgene Solutions, LLC.

O: +1-972-580-0247 Ext: 220 | E: ram.m@techgene.com

300 East Royal Lane, Suite 109, Irving, TX 75039 USA

 

This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender. Views or opinions presented in this email are solely those of the author, except where the sender specifically states them to be the views of Techgene. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. We respect your privacy, if you do not wish to hear from us please reply with the subject line "Remove