| Hi, One of our clients is looking for Lead Data Engineer/ Sr Data Engineer @ Remote.
Title: Lead Data Engineer/ Sr Data Engineer Location: Remote Job description: Strong understanding of data structures and algorithms • Strong understanding of solution and technical design • Has a strong problem solving and analytical mindset? • Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders • Able to quickly pick up new programming languages, technologies, and frameworks • Advanced experience building cloud scalable, real time and high-performance data lake solutions • In-depth understanding of micro service architecture • Strong understanding of developing complex data solutions • Experience working on end-to-end solution design • Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions • Willing to learn new skills and technologies • Has a passion for data solutions Required and Preferred Skill Sets: • 1 -2 years of hands-on experience in AWS - EMR [Hive, PySpark], S3, Athena or any other equivalent cloud; Ability to solve complex problems • 1-2 years of hands-on experience Spark Batch Processing and some familiarity with Spark Structured Streaming; Ability to solve complex issues • 1-2 years’ experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion • 2-3 years of hands-on experience with SQL, ETL, data transformation and analytics functions; Ability to solve complex problems • 2-3 years of hands-on Python experience including Batch scripting, data manipulation, distributable packages; Ability to solve complex problems • 2-3 years’ experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow • 2-3 years working with code versioning tools such as GitHub or Bitbucket; expert level understanding of repo design and best practices • 2-3 years working with deployment automation tools such as Jenkins and familiarity with containerization concepts such as Docker and Kubernetes • 2-3 years of hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development; some exposure to Nifi or Kafka • 2-3 years designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake • Preferred 1+ years of experience supporting Tableau or Cognos use cases · Familiarity with Agile; working experience preferred
Regards,
Shikhar Bharti VBeyond Corporation Technical Recruiter – IT Staffing USA Desk # +1-(908) 864-5856 | Fax # (866) 614-3884 E: Shikharb@vbeyond.com | www.vbeyond.com LinkedIn: https://www.linkedin.com/in/shikhar-bharti-8b14a9244/ 390 Amwell Road, Suite # 107, Hillsborough, NJ 08844
Note – VBeyond is fully committed to Diversity and Equal Employment Opportunity.
| 
Comments
Post a Comment
Thanks