| Description: • All phases of software engineering including requirements analysis, application design and code development and testing • Designing and implementing product features in collaboration with business and IT stakeholders • Designing reusable frameworks, libraries and components • Working very closely with Architecture group and driving technical solutions • Lead technology decisions, drive product implementation and delivery • Troubleshooting production support issues post-deployment and come up with solutions as required • Demonstrate substantial depth of knowledge and experience in a specific area of Big Data and Java/Scala development • Unix, Java, SQL • Big Data Technologies (Spark, Scala, Python, ML Libraries, Elastic Search, Hbase, Hive, SQL, MapR, Talend) • Agile/Scrum methodology The primary role for this developer will be to audit existing ETL scripts in Spark API, develop a framework to identify long running/low performing scripts, debug and improve those scripts, and train the existing ETL team on pitfalls and best practices to eliminate and prevent recurrence of low performing ETL scripts in the future. 8+ years software engineering 5+ years hands on expertise with Unix, Java, SQL 3+ years Big data technologies - Spark, Scala - Must Expertise in performance tuning Spark/Scala appliations / scripts and best practices |
No comments:
Post a Comment
Thanks
Gigagiglet
gigagiglet.blogspot.com