Greeting from Excel-EST!!
We are looking for a Senior Data Engineer with Remote, for the opening with one of our clients. Please share the best resume... Job Title: Senior Data Engineer Location: Remote Qualifications Required - Advance skills in big data technologies like Hadoop, Python, Spark, SQL.
- Must have experience building data APIs.
- 5+ years of relevant experience in the field of Data Engineering
- Bachelors in Computer Science or related disciplines
- Knowledge of Data Structures and Algorithm.
- Strong Python programming skills with ability to implement OOPs and functional programming. Knowledge of Scala/Java would be plus.
- Strong knowledge on RDBMS and NoSQL databases with the ability to implement them from scratch. Knowledge of Graph databases will be a plus.
- Strong expertise in building & optimizing data pipelines, architectures, and data sets.
- Experience working with different file formats like Parquet, ORC, Avro, RC, etc.
- Experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
- Knowledge and experience of using orchestration frameworks like Airflow, Oozie, Luigi, etc.
- Experience using Spark, and building jobs using Python/Scala/Java.
- Experience or Knowledge building stream processing platforms using Spark Streaming, Storm, etc. Knowledge of Kafka/Flink + Beam would be plus.
- Knowledge of building REST API end points for data consumption.
- Experience in building scalable data pipelines for both real time and batch using best practices in data modeling, ETL/ELT processes utilizing various technologies such as Spark, Kafka, Presto, SAP HANA, Airflow, informatica.
- Perform Data analysis using Python, complex SQLs, and other tools.
- Perform root cause analysis of issues from platform standpoint on Kubernetes, Containers, Hadoop, Spark, Hive, Presto
- Excellent oral and written communication is a must.
Preferred - Masters in Computer Science or related disciplines
- Experience building self-service tools for analytics would be plus.
- Knowledge of ELK stack would be a plus.
- Knowledge of implementing CI/CD on the pipelines is a plus.
- Knowledge of Containerization (Docker/Kubernetes) will be plus.
- Experience working with one of the popular Public Cloud based platforms is preferred
- I would appreciate if you could reach out on my below mentioned contact coordinates, should the position be of interest to you.
- Have a great day ahead!!
| | Best Regards, Abdul Rehman Recruiter – IT +1-214-550-6434 Excel-EST, LLC 17290 Preston Rd, Suite 300-F, Dallas TX, 75252 Disclaimer: We respect your Online Privacy. This is not an unsolicited e-mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered spam as long as we include contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to AbdulR@ExcelEST.com with subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience. | | | | | | |
|