Search This Blog

August 19, 2022

Sr. Data Engineer||Milpitas, CA (Initial Remote)

Hello ,

 

Greetings!

 

This is Avinash Singh  from VBeyond Corp. We are a global recruitment company with specialization in of hiring of IT professionals. One of our clients is looking for Sr. Data Engineer

 

Title: Sr. Data Engineer

Location: Milpitas, CA (Initial Remote)

Job description: Advance skills in big data technologies like Hadoop, Python, Spark, SQL.

Must have experience building data APIs.

5+ years of relevant experience in the field of Data Engineering

Bachelor’s in Computer Science or related disciplines

Knowledge of Data Structures and Algorithm.

Strong Python programming skills with ability to implement OOPs and functional programming. Knowledge of Scala/Java would be plus.

Strong knowledge on RDBMS and NoSQL databases with the ability to implement them from scratch. Knowledge of Graph databases will be a plus.

Strong expertise in building & optimizing data pipelines, architectures, and data sets.

Experience working with different file formats like Parquet, ORC, Avro, RC, etc.

Experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.

Knowledge and experience of using orchestration frameworks like Airflow, Oozie, Luigi, etc.

Experience using Spark, and building jobs using Python/Scala/Java.

Experience or Knowledge building stream processing platforms using Spark Streaming, Storm, etc. Knowledge of Kafka/Flink+Beam would be plus.

Knowledge of building REST API end points for data consumption.

Experience in building scalable data pipelines for both real time and batch using best practices in data modeling, ETL/ELT processes utilizing varioud technologies such as Spark, Kafka, Presto, SAP HANA, Airflow, informatica.

Perform Data analysis using Python, complex SQLs, and other tools.

Perform root cause analysis of issues from platform standpoint on Kubernetes, Containers, Hadoop, Spark, Hive, Presto

Excellent oral and written communication is a must.

Preferred

Master's in Computer Science or related disciplines

Experience building self-service tools for analytics would be plus.

Knowledge of ELK stack would be a plus.

Knowledge of implementing CI/CD on the pipelines is a plus.

Knowledge of Containerization (Docker/Kubernetes) will be plus.

Experience working with one of the popular Public Cloud based platforms is preferred

 

 

I would appreciate if you could reach out on my below mentioned contact coordinates, should the position be of interest to you.

Have a great day ahead!

Regards,


 

Thanks & Regards

Avinash Singh

Call - +1 (862) 343-5296

E-mail: avinashs@vbeyond.com


Disclaimer:

We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to (AvinashS@vbeyond.com) subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience.