| Hi, Please go through the JD and revert me your interest in the same :- Position:- Data Pipeline Lead ( azure data lead) Location:- Oaks PA Duration:- Contract/Full Time Mandatory skills required: - 3-5 Years Lead exp and Strong with data pipline
- 2)ETL experience
- 3)Azure ADF and Azure
- 4)Python is a must
- 5)Pyspark - good to have
- 6)AWS or Oracle Any one of these
Job Description • Strong hands-on experience for developing ETL data pipeline implementation in cloud native infrastructure • Strong experience in PySpark and Python for building data pipelines activities • Experience in data ingestion programs to process large data sets in real-time and batch data pipelines that bring together data from disparate sources using PySpark, SparkSQL, Kafka, and Spark Streaming API etc. • Experience on various Spark transformations, actions and data frames for cleansing, preparing the input data before loading into target systems and databases • Experience on building Data Lake in On-premise and cloud will be a plus • Hands-on experience in SQL, PL/SQL and query tuning in Oracle Database • Excellent knowledge of performance tuning in SQL and data partitioning • Strong expertise in implementing Golden Gate Replication, Bi-directional replication using Golden Gate. • Experience in design technical solutions in the above areas • Experience in team management and guiding developers on the technical front • 8+ years of professional experiences in the area of software development and system analysis and design. • Strong experience in PySpark and Python for building data pipelines activities • Experience in data ingestion programs to process large data sets in real-time and batch data pipelines that bring together data from disparate sources using PySpark, SparkSQL, Kafka and Spark Streaming API etc. • Experience on various Spark transformations, actions and data frames for cleansing, preparing the input data before loading into target systems and databases • Experience on building Data Lake in On-premise and cloud will be a plus • Hands-on experience in SQL, PL/SQL and query tuning in Oracle Database • Excellent knowledge of performance tuning in SQL and data partitioning Vaibhav Kumar | VBeyond Corporation +1-6788928560 Ext. 211/ mob-732-436-3975 | (866) 614-3884 (F) | vaibhavk@vbeyond.com Hangout:-vaibhavvbeyond@gmail.com Vaibhav Kumar | VBeyond Corporation +1-6788928560 Ext. 211/ mob-732-436-3975 | (866) 614-3884 (F) | vaibhavk@vbeyond.com Hangout:-vaibhavvbeyond@gmail.com
|
Comments
Post a Comment
Thanks