Data Engineer || Waltham, MA or San Jose, CA

Hello Partner, please provide Consultant for this role.

 

Position Details
Job Location/Client Location (with City & State)	Waltham, MA or San Jose, CA
Project Duration	6-12 months
Project Start date	Immediate
Job Title/Role	Data Engineer
Mandatory Skills	Pyspark, Python, Hadoop, AWS etc
Client Interview Needed for Selection (yes / No)	Yes
Detailed JD (Pl share the Detailed Description, 1 liner JD will not work)	Day-Day responsibilities would be  1) Perform automation of test cases using pyspark/python 2) Perform manual query using SQL/Hive/pyspark/MongodB query 3) Perform data validation of different parameters from router to cloud for multiple product line   Minimum Qualifications  4+ years’ experience in AWS cloud environment  Very good understanding of big data pipeline and common database like MySQL, MongoDB, HBase Good understanding of Hadoop Framework Experience performing batch/real time processing using spark Experience designing and developing appropriate test automation frameworks and data validation techniques to ensure optimized product performance Understanding of networking stack or any wireless protocol - preferable 802.11 Experience working with embedded consumer products - router experience preferable  Experience with Cloud testing tools  Very strong scripting experience using Spark (preferred) or Python and SQL is a must

 

 

 

Thanks & Regards

Sumit Jaiswal

I3 Infotek Inc

Sumit@i3infotek.com

Phone – 217 487 0467

379 Thornall Street, 9th Floor, Edison, NJ 08837