Title: Scala Developer (Scala/ Spark/ Java)
Location: Jersey City, NJ/ Houston, TX (Remote)
Education: Bachelor's Degree
Job Description:
- Main and core -> Hadoop/ HDFS and Spark – Cloudera Hadoop Distribution with Kafka as streaming platform and Java/Scala/Spark/Spark SQL as main tech skills. Python not required. Horton Works experience may be necessary but not required. Cloudera experience MUST.
- Performance tuning Spark apps - Hive, Impala and Spark SQL experience must.
- Spark execution graph. Spot problematic areas, Data skews, cartesian joins… resolve those issues would be of help
- Scala/ Spark / HDFS would be perfect, Model registry, store data models in form of entity and relationships…data Relationship debugging required
This is not a straight Spark app… some level of abstraction via Abacus framework. Users enter business logic in Abacus and that tool creates Scala/Spark code. This code needs performance tuning if developers would not configure Abacus in the appropriate manner. Idea is to figure out query acceleration needed for the Abacus output and then suggest changes in the Abacus config and tune the queries.
--
Best Regards,
Shailbi Shukla
Sr. Technical Recruiter
KTEK Resourcing LLC
Direct: +18327758715
Email: shailbi.shukla@ktekresourcing.com
Linkedin- https://www.linkedin.com/in/shailbi-shukla-ab4596192/
You received this message because you are subscribed to the Google Groups "US-IT Openings" group.
To unsubscribe from this group and stop receiving emails from it, send an email to java-developer-deepu+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/java-developer-deepu/CADJ7EegGKee7637A96J6%2BGLRHXJD0DzyoMnN%2BDx4fcdB40_diQ%40mail.gmail.com.