| Hello, Greetings! This is Ubaid Rahman from VBeyond Corp. We are a global recruitment company with specialization in of hiring of IT professionals. One of our clients is Lead Data Engineer -100% Remote Title: Lead Data Engineer Location: - 100% Remote Type: Contract Responsibility: - Responsibilities: (The primary tasks, functions and deliverables of the role) · Design and build reusable components, frameworks and libraries at scale to support analytics products · Design and implement product features in collaboration with business and Technology stakeholders · Identify and solve issues concerning data management to improve data quality · Clean, prepare and optimize data for ingestion and consumption · Collaborate on the implementation of new data management projects and re-structure of the current data architecture · Implement automated workflows and routines using workflow scheduling tools · Build continuous integration, test-driven development and production deployment frameworks · Collaboratively review design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards · Analyze and profile data for designing scalable solutions · Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues · Lead and mentor team of data engineers · Trouble shoot key issues and ensure team member performance Requirements: Experience: · Strong understanding of data structures and algorithms · Strong understanding of solution and technical design · Has a strong problem solving and analytical mindset? · Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders · Able to quickly pick up new programming languages, technologies, and frameworks · Advanced experience building cloud scalable, real time and high-performance data lake solutions · In-depth understanding of micro service architecture · Strong understanding of developing complex data solutions · Experience working on end-to-end solution design · Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions · Willing to learn new skills and technologies · Has a passion for data solutions Required and Preferred Skill Sets: · 3+ years of hands-on expert level experience in AWS - EMR [Hive, Pyspark], S3, Athena or any other equivalent cloud · 3+ years of hands-on expert level experience Spark Batch Processing and some familiarity with Spark Structured Streaming · 3-4 years’ experience Working experience with Hadoop stack dealing huge volumes of data in a scalable fashion · 5+ years of hands-on experience with SQL, ETL, data transformation and analytics functions · 5+ years of hands-on Python experience including Batch scripting, data manipulation, distributable packages · 5+ years’ experience working with batch orchestration tools such as Apache Airflow or equivalent · 5+ years working with code versioning tools such as GitHub or Bitbucket; expert level understanding of repo design and best practices · 5+ years working with deployment automation tools such as Jenkins and familiarity with containerization concepts such as Docker and Kubernetes · 5+ years of hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development; some exposure to Nifi or Kafka · 5+ years designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake · 3+ years of experience supporting Tableau or Cognos use cases; familiarity with tools and capabilities · Familiarity with Agile; working experience preferred Education: · Bachelor's degree in IT or related field · One of the following alternatives may be accepted: o Associates + 6 yrs.; if you could reach out on my below mentioned contact coordinates, should the position be of interest to you. Have a great day ahead! Regards Ubaid Rahman Recruiter VBeyond Corporation 9089284061 ubaidr@vbeyond.com Note – VBeyond is fully committed to Diversity and Equal Employment Opportunity. Disclaimer: We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails, then please reply to UbaidR@vbeyond.com subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience. | 
No comments:
Post a Comment
Thanks
Gigagiglet
gigagiglet.blogspot.com