Requirement for Big Data Engineer

-


Hi,
This is Venkat from Deegit Inc.  I came across your profile today and wanted to discusses an opportunity with you.
Position: Big Data Engineer
Location: Sunnyvale, CA
Duration: 1 year
Key skills: Big Data and Software development/programming experience in JAVA and Python/Perl. We can look for candidates with some machine learning background as well since they will have strong scripting/programming experience along with big data. Experience with building data pipelines is very important.
o             Basic Big data stack needed by Yahoo [Pig, Hive, HBase]
o             Advanced Big data: Kafka, Storm/ any other

You Must Have
•         5+ years of overall experience in software development.
•         Strong data engineering experience with demonstrable skills building data pipelines from structured and semi-structured data sources, data cleansing, formatting and storing data into reporting tables.
•         Strong scripting experience using Python/Perl/Shell.
•         Strong programming experience with Java.
•         Strong experience with relational database systems such as Oracle, MySQL.
•         Strong demonstrable experience working on realtime data pipelines using technologies such as Kafka and Storm.
Preferred
•         Experience with big data technologies - HDFS, Pig, Hive, Oozie, HBase, Spark etc.
•         Experience working with RESTful APIs.

Comments

Post a Comment

Thanks

Popular posts from this blog

SAP Basis Architect

-
SAP Basis Architect Title:  SAP Basis Architect ·          Location: Philadelphia with some travel to Michigan ·        Basis Architect to review & evaluate existing landscape with multiple systems, and recommend future state architecture to support migration & upgrade. Resource should be self-starter with architect level experience & exposure with experience with multiple level environments in the landscape.   Thanks Divya divya@levanture.com Company Name | Website ...
Read more

JD :: Snowflake Python AWS Developer | contract | New Jersey

-
You don't want to miss this.   Hi , Hope you are doing well! I came across your profile and was very impressed with your background, wanted to reach out and see if you were interested in hearing more about a role I'm recruiting for. If it does, please share you updated resume at the earliest. My email ID is FaizA1@vbeyond.com . ( +1- 908-633-4135 )  Snowflake Python AWS Developer - NJ/Remote   Responsibilities: Snowflake DB Developer 6+ years of relevant experience and skilled in – Snowflake DB, Oracle Database with hands on exposure to Cloud environment - preferably AWS Experience in Snow SQL, Snow Pipes, Streams, Views, Procedures, performance tuning. Exposure to Time travel, data movement between Snowflake to other RDBMS and vice versa Experienced in SQL performance tuning and troubleshooting Good knowledge on Python including libraries like pandas, numpy others. Knowledge on CI/CD using Jenkins/...
Read more

Data Architect

-
Click here to if you no longer wish to receive our emails Hi, Hope you are doing great today! Hope you are Safe and healthy. This is Serisha from EA team. We have an opportunity with one of our clients,please find the below job Description and let me know if you have any suitableprofiles. Data Architect Atlanta,GA JD Data Architect Talend & green Plum This email is generated using CONREP software. A90024
Read more