Hi, Hope you are doing great! Under followed is the job description: Role: Data Pipeline Lead Location: Oaks, PA (Onsite) Mandatory skills required: - PySpark
- Python
- Oracle
- Experience on Building Data Lake on Azure cloud
- Snowflake knowledge & experience would be a plus.
Job Description • Strong hands-on experience for developing ETL data pipeline implementation in cloud native infrastructure • Strong experience in PySpark and Python for building data pipelines activities • Experience in data ingestion programs to process large data sets in real-time and batch data pipelines that bring together data from disparate sources using PySpark, Spark SQL, Kafka, and Spark Streaming API etc. • Experience on various Spark transformations, actions and data frames for cleansing, preparing the input data before loading into target systems and databases • Experience on building Data Lake in On-premise and cloud will be a plus • Hands-on experience in SQL, PL/SQL and query tuning in Oracle Database • Excellent knowledge of performance tuning in SQL and data partitioning • Strong expertise in implementing Golden Gate Replication, Bi-directional replication using Golden Gate. • Experience in design technical solutions in the above areas • Experience in team management and guiding developers on the technical front • 8+ years of professional experiences in the area of software development and system analysis and design. • Strong experience in PySpark and Python for building data pipelines activities • Experience in data ingestion programs to process large data sets in real-time and batch data pipelines that bring together data from disparate sources using PySpark, Spark SQL, Kafka and Spark Streaming API etc. • Experience on various Spark transformations, actions and data frames for cleansing, preparing the input data before loading into target systems and databases. • Experience on building Data Lake in On-premise and cloud will be a plus. • Hands-on experience in SQL, PL/SQL and query tuning in Oracle Database. • Excellent knowledge of performance tuning in SQL and data partitioning. Thanks & Regards, Satyam Biswas VBeyond Corporation I PARTNERING FOR GROWTH 390 Amwell Road, Bldg #1, Suite #107 Hillsborough New Jersey USA – 08844 Contact No: 908-663-2320 | EXT- 270 Direct number: 838-999-9607 https://www.linkedin.com/in/satyam-biswas-413462199/
Disclaimer: We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to Satyamb@vbeyond.com subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience. |
Comments
Post a Comment
Thanks