Job Description :: Databricks Engineer :: NYC, NY OR Iselin, NJ (Hybrid) (Preferred Local Candidates)

Hi ,
Abhay this side. We do have a new an excellent opportunity for you. This opportunity is a Contract position of Databricks Engineer. Please have a look at the job description below and let me know if you or someone you know is interested in this role. You can mail me at adubey@shiftcodeanalytics.com
Job Title: Databricks Engineer
Job Location: NYC, NY OR Iselin, NJ (Hybrid) (Preferred Local Candidates)
 Job Type:  Contract
 
Job Description
 
Work on Finance data related to Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo
Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Demonstrated proficiency with Data Analytics, Data Insights
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
Azure Synapse/Bigquery/Redshift is good to have.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

SKILLS:

5+ years' – Strong experience in Finance / Banking industry – Capital markets, investment banking - Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo
10+ years - Enterprise Data Management
10+ years - SQL Server based development of large datasets
5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding.
Azure Synapse/Bigquery/Redshift experience is good to have
3+ years Python(numpy, pandas) coding experience
Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
Capable of discussing enterprise level services independent of technology stack
Experience with Cloud based data architectures, messaging, and analytics
Superior communication skills
Cloud certification(s)
Any experience with Regulatory Reporting is a Plus

EDUCATION
Minimally a BA degree within an engineering and/or computer science discipline
Master's degree strongly preferred
 
 
Thanks & Regards
Abhay Dubey
Shiftcode Analytics Inc 
Tampa, FL
E-mail ID: adubey@shiftcodeanalytics.com
Hangout ID : imabhaydubey@gmail.com
Direct: 726-888-5944 Whatsapp: +91 8948499388
LinkedIn : linkedin.com/in/abhayy-dubey-a5425423a
(Due to heavy call flow I may miss your call so email is the best way to reach me.)
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

If you would prefer to no longer receive any emails from this Company, you may opt out at anytime by clicking unsubscribe.