We have below requirement with our Client. Kindly go through the below JD and if interested please revert back with your updated resume.
Position: Data Engineer with Azure Databricks
Location: Louisville, Kentucky-USA, Remote
Client: Wipro
Rate: $60/hr on c2c
No OPT / CPT
Role:
-
The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
-
Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.
-
Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
-
The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams.
Responsibilities
-
Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements
-
Drive technology and business transformation through the creation of the Azure Data Lake
-
Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
-
Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio
Required Skills
-
10+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Cloudera
-
3 + / 2+ years working experience in Databricks (essential) and Python
-
Experience with Cloud / Azure architectural components
-
Experience building data pipelines and infrastructure
-
Deep understanding of Data warehousing concepts, reporting and Analytical concepts
-
Experience with Big Data tech stack, including Hadoop, Java, Spark, Scala, and Hive, NoSQL data stores
-
Bachelor's degree in Mathematics, Physical Sciences, Engineering or Computer Science
Nice to Have skills
-
Experience in leading design and development of large systems
-
Demonstrates strong drive to learn and advocate for development best practices
-
Proven track record of building and delivering enterprise-class products
-
Full Stack Experience (End to End Development)
-
Crisp and effective executive communication skills, including significant experience presenting cross-functionally and across all levels
