Hello Folks,
Hope you are doing great!
This is Azhar Tariq from ApTask.
We have urgent requirements with one of our client’s, please review the job description below and let me know if you have any relevant candidates on your bench, Kindly share.
Role: SR Data Engineer
Location : NYC, NY (Nybrid)
Tenure: Long Term
Need 12+ Years candidates.
Kindly help me with work authorization status and DL location with resume.
Need local Only
Need Experience on Data Migration, Hadoop, Snowflake and Pyspark
Job Description
Job Summary
We are seeking an experienced Data Engineer with strong expertise in Hadoop ecosystem technologies, PySpark, Python, and Snowflake to support enterprise-scale data engineering and migration initiatives. The ideal candidate should have hands-on experience migrating large-scale data from Hadoop platforms into Snowflake using PySpark-based frameworks and ETL pipelines.
The role requires deep technical expertise in data transformation, data integration, SQL optimization, and cloud data warehousing along with strong analytical, troubleshooting, and cross-functional collaboration skills.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark, Python, and Hadoop ecosystem tools.
Lead and support enterprise-level data migration projects from Hadoop/HDFS platforms to Snowflake.
Develop efficient ETL/ELT workflows for ingesting, cleansing, transforming, and loading large datasets.
Build reusable frameworks and automation for data migration and transformation activities.
Optimize Spark jobs and SQL queries for performance and scalability.
Work with structured and semi-structured datasets from multiple enterprise sources.
Collaborate with architects, business analysts, QA teams, and stakeholders to understand data requirements and deliver solutions.
Perform data validation, reconciliation, and quality checks during migration activities.
Troubleshoot production issues, identify root causes, and implement fixes/enhancements.
Ensure adherence to enterprise data governance, security, and best practices.
Participate in code reviews, technical discussions, and solution design sessions.
Create and maintain technical documentation related to data flows, mappings, and migration processes.
Required Skills & Qualifications
12+ years of overall IT experience in Data Engineering and Big Data technologies.
Strong hands-on experience with:
Hadoop Ecosystem
Apache Spark / PySpark
Python
Snowflake
Proven experience in data migration projects involving Hadoop to Snowflake migration using PySpark frameworks/libraries.
Strong understanding of ETL/ELT concepts and data warehousing principles.
Advanced SQL skills with experience in query optimization and performance tuning.
Experience handling large-scale enterprise data transformation and integration projects.
Good understanding of distributed data processing concepts.
Strong analytical and problem-solving abilities.
Excellent verbal and written communication skills.
Ability to work effectively with cross-functional and geographically distributed teams.
Regards,
Azhar Tariq
IT recruiter
ApTask is a global, diversity certified staffing and recruiting company that specializes in IT, finance and accounting, and blockchain developer placements.
Fintech Consulting LLC DBA ApTask
Connect: Azhart@aptask.com
Address: 120 Wood Ave South, Iselin, NJ 08830
For any questions or assistance please send an email to help@aptask.com
Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.
If you have any concerns or queries about your personal information, please feel free to contact our recruitment team at compliance@aptask.com.
This e-mail and any attachments may be confidential, proprietary or legally privileged. Any review, use, disclosure, distribution or copying of this e-mail is prohibited except by or on behalf of the intended recipient. If you received this message in error or are not the intended recipient, please delete or destroy the e-mail message and any attachments or copies and notify the sender of the erroneous delivery by return e-mail. It shall not attach any liability on the sender or ApTask or its affiliates. Any views or opinions presented in this email are solely those of the sender and may not necessarily reflect the opinions of ApTask or its affiliates.
