Data Engineer with strong experience of Scala & Spark

AWS

Hello,   Greetings!   This is Harshit Srivastava from VBeyond Corp. We are a global recruitment company with specialization in of hiring of IT professionals. One of our clients is looking for Data Engineer   Role : Data Engineer – Scala, Spark Location : Appleton, Wisconsin ( Remote till Covid) No. of Position : 3   Note : Need Strong Spark & Scala JD : •      8 + years of experience in Data pipeline engineering for both batch and streaming applications. Implementing SQL query tuning, cache optimization, and parallel execution techniques. Must be hands-on coding capable in at least a core language skill of (Python, Java or Scala) with Spark. •      Expertise in working with distributed DW via scripted pipeline Leveraged frameworks and orchestration like Airflow as required for ETL pipeline This role intersects with “Big data” stack to enable varied analytics, ML etc. Not just Datawarehouse type workload. •      Handling large and complex sets of XML, JSON, Parquet and CSV form various sources and databases. Solid grasp of database engineering and design Identify bottlenecks and bugs in the system and develop scalable solutions Unit Test and document deliverables Capacity to successfully manage a pipeline of duties with minimal supervision. •      Must understand Python, SQL, DW concepts and logic, AWS cloud knowledge •      Nice to have: Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores, Stream sets, Databricks, Airflow orchestration Thanks & Regards Harshit Srivastava 732-585-125 harshits@vbeyond.com Company Name Website

VBeyond Corporation | 390 Amwell Road, Suite # 107, Hillsborough, NJ 08844 Unsubscribe mbawithfun.co.nr.jobhunt@blogger.com Update Profile | About Constant Contact Sent by harshits@vbeyond.com