Job title Senior Data Engineer (Python & SQL)
Location Onsite, Dallas Tx Local
C2C- Only Citizen
Only local
JD
We are looking for a highly experienced Senior Databricks Engineer with strong hands-on expertise in Python, SQL, Spark, and end-to-end data pipeline development. The candidate will design scalable ETL workflows, optimize big-data jobs, and work closely with data architects to build high-performance analytics solutions on Azure Databricks.
Key Responsibilities:
- Develop, optimize, and maintain Databricks notebooks using Python and SQL.
- Build & enhance ETL/ELT pipelines using Spark and Delta Lake.
- Implement data ingestion, transformation, and validation frameworks.
- Optimize Spark jobs, cluster performance, and Delta Lake tables.
- Work with Azure data ecosystem (ADF, ADLS, Synapse preferred).
- Collaborate with data architects, analysts, and business teams for scalable solutions.
- Ensure best practices for version control, CI/CD, and job orchestration.
Required Skills:
- 12+ years of experience in data engineering.
- Strong proficiency in Databricks, Python (PySpark), SQL, and Spark optimization.
- Hands-on experience with Delta Lake, Unity Catalog, and Workspace management.
- Experience integrating with Azure Data Factory / Airflow / other orchestration tools.
- Strong knowledge of data modeling, performance tuning, and distributed computing.
- Excellent problem-solving and communication skills.
You received this message because you are subscribed to the Google Groups "C2Cbenchrecruiters" group.
To unsubscribe from this group and stop receiving emails from it, send an email to c2c_benchrecruiters+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/c2c_benchrecruiters/CA%2BttNjoEOTSKsbrN8Ldp%2BxsYy1h5pauRcAPsmvConqNUTGx_JA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment
Thanks
Gigagiglet
gigagiglet.blogspot.com