| Title: Data Engineer Location: Santa Clara, CA (Post Covid19 Onsite) About the Data Engineer Role As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. The ideal candidate should be proficient in writing SQLs so they can be embedded into the informatica (IICS) for data transformation. Ideal candidate should be willing to learn open-source technologies on the fly as job demands. Responsibilities • Design, develop & implement ETL processes on Azure Cloud using Databricks and Azure Synapse • Advanced SQL knowledge, capable to write optimized queries for faster data workflows. • Must be extremely well versed with handling large volume data and work using different tools to derive the required solution. • Work with offshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies, and best practices Requirements • Bachelor's Degree or master’s degree in Computer Science. • 8+ years of hands-on software engineering experience. • Proven work experience in many of these areas such as REST APIs, RDS, Spark, Glue, S3, Terraform, CloudWatch, nodeJS, EMR, etc. • Experience in solutioning and implementing data pipelines, data curation, data modeling and implementing data solutions • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS • Strong database fundamentals including SQL, performance, and schema design. • Understanding of CI/CD framework is an added advantage. • Ability to interpret/write custom shell scripts. Python scripting is a plus. • Experience with Azure platform and Synapse • Experience with Git / Azure DevOps • To be able to work in a fast-paced agile development environment. Soundarya ASr. IT Support Executive VBeyond Corporation || PARTNERNG FOR GROWTH Desk :(669) 213 -4493 US: 908 -740 -8663 Ext - 959 SoundaryaA@vbeyond.com
Website: www.vbeyond.com | 
Comments
Post a Comment
Thanks