| Title: Data engineer With Azure Location: Fully Remote Duration: Long-term
Experience : 10+ Years
REQUIRED EXPERIENCE Azure Data Engineer Deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Services, SQL Server and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations. Note: This is a data engineer from the application side. Must be able to analyze data and develop strategies for populating data lakes (Databrick – Delta Lake). This is not an infrastructure position. This person will be called upon to do complex coding using T-SQL, Python, using PySpark. Responsibilities • Work as part of a team to develop Cloud Data and Analytics solutions • Participate in development of cloud data warehouses, data as a service, business intelligence solutions • Ability to provide solutions that are forward-thinking in data and analytics • Deliver a quality product • Coding complex Spark (Python), T-SQL • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse) Skills/ Qualifications: • Hands-on experience in Azure Databricks, Azure Data Factory, Azure Synapse – Mandatory • Good understanding of Azure Databricks platform and ability to build data analytics solutions to support the required performance & scale • Working with Spark cluster and effective usage of spark engine for any data transformation creating notebooks with PySql scripts • Ability to Read and Write data to Azure Data Lake or Blob storage from Databricks • Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks building Data Pipelines for File, Database and API based ingestion using different activities within and also with Data flows for any Data Transformation • Good Knowledge on Global parameters, Triggers, Linked services, Datasets and Arm template • Experience of creating tables, building dimensional modelling • Experience as Data Engineer in Azure Big Data Environment • Expertise in ETL tools i.e. (SSIS) • Expertise in Implementing Data Warehousing Solutions • Experience with working in Agile (KANBAN, Scrumban) environment as part of a scrum team • Programming experience in Python, T-SQL • Hands-on experience in Azure stack, with good knowledge on Azure Key Vault, Active directory and basic understanding of Devops and SSIS • Experienced working on performance tuning and optimizing long running jobs • Thanks & Regards, Vivek Yadav Recruitment Lead Call: (908) 633-4182 E: VivekY@VBeyond.com | www.vbeyond.com 390 Amwell Road, Suite # 107, Hillsborough, NJ 08844 Note – VBeyond is fully committed to Diversity and Equal Employment Opportunity. Disclaimer: We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to MohammadF@vbeyond.com subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience. | 
Comments
Post a Comment
Thanks