urgent Requirement on Data Engineer

Hi,

Hope you are doing great,

I have urgent Requirement on  Data Engineer

Role: Data Engineer
Duration :6-12 months
Location: Remote, United States
Experience: 5+
Interview : Phone and skype

Description: 
1) DE with - - - airflow/SQL support for a DS pod that supports a number of company metrics, and needs support with scaling their python stack

Responsibilities: 
• Own the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth 
• Evolve data model and data schema based on business and engineering needs 
• Implement systems tracking data quality and consistency 
• Develop tools supporting self-service data pipeline management (ETL) 
• SQL and spark job tuning to improve data processing performance 

Experience: 
• Strong experience with Python and Spark 
• Experience with workflow management tools (Airflow is preferred, Oozie, Azkaban, UC4) 
• Experience with Hadoop (or similar) Ecosystem (Spark, Presto are preferred, Yarn, HDFS, Hive, Pig, HBase, Parquet) 
• Solid understanding of SQL Engine and able to conduct advanced performance tuning 
• Proficient in at least one of the SQL languages (Redshift and Oracle Preferred) 
• Comfortable working directly with data analytics to bridge business goals with data engineering 
========================================================
Note: Terraform will be the big plus on this one.

Thanks & Regards
Mahesh B
Technical Recruiter
ShiftCode Analytics, Inc
5118 Sylvester loop, Tampa, Florida 33610
Direct: 480-691-1420 , 480-691-7093
Email: mkumar@shiftcodeanalytics.com
H: bellarymaheshkumar@gmail.com
www.shiftcodeanalytics.com

 

If you would prefer to no longer receive any emails from this Company, you may opt out at anytime by clicking here.