Hi Partner,
I hope you’re doing well.
Please review the highlighted points below and let me know if you have any consultants who would be a good fit for this role.
- Only Senior H1b Candidates.
- Only Locals to NY/NJ
Role : Big Data Engineer
Location : NYC office Hybrid (3 days a week)
Contract role
Technical Skills:
- Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.
- Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake
- Languages: Python, SQL and Shell Scripting.
- Databases: MySQL, Teradata, and SQL SERVER.
- Orchestration/Tools: Oozie, Airflow, CTRL-M, Maven, Jenkins, IntelliJ, GIT
JD
· Expertise in all components of Big Data Ecosystem- Spark, Hive, Sqoop, Oozie, Impala and Hue
· Extensive Experience with AWS services ensuring efficient data management and analysis.
· Successfully led the migration of legacy systems to Datawarehouse environments and Cloud, utilizing Informatica, Snowflake and AWS technologies, resulting in improved scalability, performance, and cost-effectiveness.
· Extensively worked with lambda, S3, cloudwatch,SQS,SNS,Step Functions and IAM roles in AWS services.
· Extensive knowledge on data serialization techniques like Avro, Sequence Files, Parquet, JSON and ORC.
· Experienced in handling databases: MySQL, SQL Server, Teradata.
· Expertise working across all phases of SDLC requirements gathering, system design, development, enhancement, maintenance, testing, deployment, production support, and documentation.
· Working experience in creating complex data ingestion pipelines, data transformations, data management and data governance in a centralized enterprise data hub.
· Knowledge of Kubernetes ecosystem.
· Did Data analysis and interpretation Using Databricks features to perform data transformations, run queries, and build visualizations collaborating Working with diverse teams to deliver insights in Analytics platform. – good to have.
· Strong problem-solving skills
· Strong team player with good communication, analytical, presentation and inter-personal skills.
Anurag Singh
EIT Professionals
17199 N Laurel Park Dr. Ste 402, Livonia, MI 48152, USA
Work: +1 (734) 772-9929
LinkedIn: linkedin.com/in/anurag-singh-it-recruiter
Email: anurag@eitprofessionals.com
Web: www.eitprofessionals.com