I am Khatib, working as a Technical Recruiter at Vbeyond Corporation. We provide staffing solutions to our clients nationwide. Please find the below job description and help me with suitable profiles.
Role: Bigdata Spark Engineer
Location : Alpharetta GA
Min Exp Required: 08+ years
Mandatory Key Skills:
· Spark
· Scala
· PySpark
· Spark SQL
· Data Pipeline
· Jupyter Notebooks (preferred)
· TSQL (highly preferred)
· PolyBase (Preferred)
Job Description:
· Apache Spark design and development experience using Scala.
· Experience with SQL Server Big Data Cluster is a plus, should have worked on SQL Server TSQL
· Build high performing data models on big-data architecture as data services.
· Build high performing and scalable data pipeline platform using Hadoop, Apache Spark.
· Partner with Enterprise data teams such as Data Management & Insights and Enterprise Data Environment (Data Lake) and identify the best place to source the data
· Work with business analysts, development teams and project managers for requirements and business rules.
· Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
· Effectively work in a hybrid environment where legacy ETL using PolyBase and Data Warehouse applications and new big-data applications co-exist
· Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
· Work with DBAs in Enterprise Database Management group to troubleshoot problems and optimize performance
· Support ongoing data management efforts for Development, QA and Production environments
· Utilizes a thorough understanding of available technology, tools, and existing designs.
· Leverage knowledge of industry trends to build best in class technology to provide competitive advantage
=========================================
Thanks & Regards,
Khatib Rahman
Recruitment Specialist
908-854-0423
390 Amwell Road, Suite #107, Hillsborough, NJ 08844
Note – VBeyond is fully committed to Diversity and Equal Employment Opportunity.
Disclaimer: We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to KhatibR@vbeyond.com subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience.
Please do not print unless absolutely necessary. Spread environmental awareness.
