Azure Databricks developer | Las Vegas, NV(Onsite)
Hi Professional
We are seeking a skilled and experienced Cloud Azure Databricks Data engineer to join our dynamic team. The ideal candidate
Will have extensive experience in building, managing, and optimizing data pipelines and solutions on Azure Databricks.They
should also possess strong expertise in PySpark, Python,SQL,Unity Catalog, and excellent communication skills.
Key Responsibilities
• Design, develop,and maintain scalable data pipelines and workflows on Azure Databricks.
• Utilize PySpark and Python for data processing,transformation, and integration.
• Develop and optimize SQL quer ies to enable efficient data retrieval and analysis.
• Implement and manage Unity Catalog for data governance,access control,and metadata management.
• Collaborate with cross-functional teams to understand business requirements and translate them into technicalsolutions.
• Optimize data pipelines for performance, scalability, and cost-effectiveness.
• Ensure the security,compliance, and integrity of data.
•Troubleshoot and resolve issues related to data pipelines and processes.
• Create and maintain documentat ion for data workflows, processes,and solutions.
• Communicate effectively with stakeholders to provide project updates and insights.
Required Skills and Qualifications
• 7+ years of experience in data engineering or a related field.
• Strong hands-on experience with Azure Databricks. .
• Proficiency in PySpark and Python forlarge-scale data procesing.
• In-depth knowledge of SQL for data analysis and transformation.
• Experience with Unity Catalog for managing data governance and access control.
• Familiarity with Azure cloud services such as Azure Data Lake, Azure Data Factory,and azure synapse analytics.
• Understanding of data modelling concepts and ETL/ELT workflows.
• Excellent problem-solving and analyti.cal skills.
Strong communication skills, both written and verbal, to collabrate with technical and non-technical stakeholder&
Thanks & Regards
|
Comments
Post a Comment
Thanks