Requirement for Big Data Engineer

Hi,

This is Venkat from Deegit Inc.  I came across your profile today and wanted to discusses an opportunity with you.

Position: Big Data Engineer

Location: Sunnyvale, CA

Duration: 1 year

Key skills: Big Data and Software development/programming experience in JAVA and Python/Perl. We can look for candidates with some machine learning background as well since they will have strong scripting/programming experience along with big data. Experience with building data pipelines is very important.

o             Basic Big data stack needed by Yahoo [Pig, Hive, HBase]

o             Advanced Big data: Kafka, Storm/ any other

You Must Have
•         5+ years of overall experience in software development.
•         Strong data engineering experience with demonstrable skills building data pipelines from structured and semi-structured data sources, data cleansing, formatting and storing data into reporting tables.
•         Strong scripting experience using Python/Perl/Shell.
•         Strong programming experience with Java.
•         Strong experience with relational database systems such as Oracle, MySQL.
•         Strong demonstrable experience working on realtime data pipelines using technologies such as Kafka and Storm.
Preferred
•         Experience with big data technologies - HDFS, Pig, Hive, Oozie, HBase, Spark etc.
•         Experience working with RESTful APIs.