Search This Blog

October 22, 2020

Data Engineer_Brooklyn, NY_C2C (Only USC/GC)

Dear Partners,

Greetings from TechGinia Inc.!

We have an open position for Data Engineer for the location Brooklyn, NY. If you have any consultant available for this role, kindly send me their resume.

Position: Data Engineer
Location: Brooklyn, NY

Position: 

We are seeking a highly motivated leader to be a Data Engineer, Platform to join our team in Brooklyn, NY. You will play an active role in designing and building big data pipelines to ingest, transform and persist sensor data, weather data and flight data to feed into Statistical/Machine Learning models. This role requires a deep understanding of Cloud (AWS, Azure) services with hands-on implementation experience in serverless, batch and streaming architectures and Software Engineering best practices. As part of this Data Engineering team, you will be working closely with Software Engineers, Data Scientists, and DevOps Engineers to deliver well tested, resilient code.  

Job Responsibilities 

  • Design, Write and deploy Cloud based, high volume data applications within a streaming architecture to ingest, transform, and store data to be used in Machine Learning Models, developing prototypes quickly 
  • Write and deploy ETL applications and scripts across a range of data sources and stores in support of batch data processing and reporting 
  • Analyze and improve efficiency, scalability, reliability and performance of our Big Data platforms and systems infrastructure at the core of United Technologies 
  • Manage individual project priorities, deadlines and deliverables. 
  • Collaborate with other engineers and product management to deliver scalable, resilient and secure solutions 
  • Ensure the reliability of systems critical to clients users and businesses 
  • Practice disciplined software engineering (e.g. automated testing, code reviews, and writing beautiful, pragmatic code) 
  • Actively contribute to team and company standards 
  • Mentor junior team members 


Qualifications: 

  • 5+ years hands-on Python Development 
  • 3+ years hands-on experience in Spark, the Hadoop Ecosystem and stream processing (i.e. Spark Streaming, Kafka, Flume, Samza, Flink…) 
  • 4+ years hands-on experience with a range of DBMS and formats both distributed and otherwise (i.e. Hive, Parquet, ORC, HBase, Oracle, Casandra…) 
  • Strong Experience with AWS Kinesis, Glue, S3, Athena and Lambda 
  • Experience in consuming and transforming from Enterprise eco-systems 
  • Experience working with Cloud Data Warehouses solutions like Snowflake and Redshift 
  • Experience in Agile, Git, application containerization, continuous integration/deployment 
  • Experience in designing and architecting distributed, highly available, highly performant, scalable big data applications and platforms 
  • Experience working with Data Science and machine learning models is a plus 
  • Excellent written and verbal communication skills along with the ability to well work in cross functional teams 
  • Motivated self-starter with a strong enthusiasm to learn  
  • Results-oriented with strong communication and customer focus 
  • Possesses a flexible attitude and is willing to work with a range of technologies and languages with an open mind and without bias.  
  • A constant learner, actively interested in updating skill sets and knowledge, following trends in the Big Data community 

 


Thanks & Regards,
Sameer Kumar |  Technical Recruiter
TechGinia Inc.
50 Harrison St., PH-401, Hoboken, NJ 07030