Urgent Requirement - BigData Hadoop Consultant - Cincinnati OH

Hello, Hope you are having a wonderful day!!! My name is Praveen Kumar and I am a part of recruitment team at IDC Technologies INC. I came across your profile and wanted to see if you would be interested in Position BigData Hadoop Consultant with one of our customer located in Cincinnati, OH. Please let me know your thoughts on this exciting opportunity with us.      Role: BigData Hadoop Consultant Location: Cincinnati, OH Duration of Project: 12+ Months C2C & W2.                           Job Details: Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala Experience with Spark Experience with integration of data from multiple data sources Databaseapplication development experience in a complex enterprise environment Strong familiarity with working in a Linux environment which includes Shell scripting Experience in designing and implementing data pipelines in production using tools from the Hadoop ecosystem such as MapReduce, Hive, HBase, Spark, Sqoop, Oozie, Pig. Experience in or have a good understanding of other data lake technologies Prior experience with ETL applications such as Data StageThe ETL Developer will be responsible for migration of applications on DataStage to Hadoop based platformResponsible for delivering the projects end-end using latest toolstechnologies in an Agile environment, playing multiple roles as the requirements demandThis role requires solid DataStage Developer experience, as well as experience performing data analytics on Hadoop-based platforms and implementing complex ETL transformationsTransform existing ETL logic on DataStage application into Hadoop Platform.Design, develop and implement MicroServices based Data Lake Solutions on Hadoop PlatformAcquire data from primary or secondary data sourcesIdentify, analyze, and interpret trends or patterns in complex data setsInnovate new ways of managing, transforming and validating dataEstablish and enforce guidelines to ensure consistency, quality and completeness of data assetsApply quality assurance best practices to all work productsAnalyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budgetChallenge status quo and mentors development staff in terms of efficient design as well as reusable development best practices in minimizing unfavorable work variancesCommunicate risks or issues stemming from projects or tickets work to core teams as well as assigned Technical Delivery Managers, proactivelyQualifications 3+ years of development experience in delivering DataStage-based ETL solutions3+ years of Hadoop Big Data Developer experience including writing SQLs, YARN, Sqoop, Spark SQL, Hive, other ETL tools (Informatica, Talend, etc.), Impala, etc2-5 years of experience in Python, Java or Scala developmentExperience developing Spark processes and performance tuningExperience performing data analytics on Hadoop-based platforms and implementing complex ETL transformationsStrong experience with UNIX Shell Scripting to automate file preparation and database loadsExperience in data quality testing adept at writing test cases and scripts, presenting and resolving data issues Familiarity with relational database environment (Oracle, DB2, etc.) leveraging databases, tablesviews, stored procedures, agent jobs, etcand integrating with SalesForce backendExperience analyzing and designing deliverables in an Agile environment is requiredExperience working on a Development teams using Object Oriented Development and Scripting languages preferredDemonstrated independent problem solving skills and ability to develop solutions to complex analyticaldata-driven problemsComfortable learning cutting edge technologies and applications to greenfield projects       Thanks & Regards, Praveen Kumar IDC Technologies Inc. 1851 McCarthy Blvd, Suite 112 to 118 Milpitas, CA 95035 Desk: 408-637-5156 Phone: 732-708-3245 E: praveen.kumar1@idctechnologies.com

To unsubscribe from future emails or to update your email preferences click here .