Big Data / hadoop consultant available on c2c

Greetings of the day

Kindly find the details of my consultant available for your direct client requirement, on c2c. Kindly share the complete Job description at sadath@mutexsystems.com

Consultant"s info:-

Name: Rui Q

Total exp: 5+ years

Current location: Plano TX

Relocation: Open

Visa: h1b

Availability: 2 weeks' notice

Resume Summary:

� Professional IT work experience in developing Big Data applications for clients in multiple industries. Comprehensive experience in working with Apache Hadoop Eco-components.

� Hands on experience in Big Data Ecosystem with Hadoop, HDFS, MapReduce, Hive, HBase, and Sqoop

� Experienced in Yarn tuning and dynamic resource allocation

� Strong proficiency in implementing and optimizing MapReduce programs to support big data ETL procedures

� Experience in analyzing and cleansing raw data using HiveQL

� Proficient in writing and optimizing HiveQL queries to achieve data manipulation

� Experience handling Spark Dataframe using pySpark

� Experience with large batch data processing with Hive using Spark scala and Spark SQL

� Working experience with Database including MySQL 5.x, PostgreSQL 9.x, HBase 0.98+, MongoDB 2.4

� Implemented MLib functions for training and building fully loaded classifiers models using Spark streaming, Spark SQL and Machine Learning APIs.

� Expertise in analysing the data using Hive and writing custom UDF"s in Java for extended Hive core functionality.

� Deep working knowledge of functional programing, MVC design patterns, Spring MVC, Java mock framework, Quality Assurance

� Experience in descriptive and predictive analysis with Microsoft Excel, Tableau and Python using libraries like Pandas, Matplotlib, Scipy and Seaborn

� Experience working with AWS S3 and AWS EC2, AWS EMR for data storage and cloud computing, as well as Redshift for data warehouse

� Selected appropriate AWS services to design and deploy an application based on given requirements.

� Experience using pySpark and MLlib for classification and regression analysis

� Worked on ingesting, reconciling, compacting and purging base table and incremental table data using Hive and HBase and job scheduling through Oozie

� Solid understanding of predictive analysis, statistical analysis and modeling and regression

� Experience in Agile, Waterfall, TDD (Test Drive Development) methodologies

� Good experience working on Tableau and Spotfire and enabled the JDBC/ODBC data connectivity from those to Hive tables

� Practical experience in implementing multi-threading and concurrency framework

� Self-driven goal getter, excellent communication skills in collaborative team and have motivations to take independent responsibility.

EDUCATION:

� MS in Mathematical Finance from Lehigh University, 2018.

� Bachelor of Science from Huazhong University of Science and Technology, 2016.

TECHNICAL SKILLS:

Hadoop Ecosystem	Hadoop 2. *, Spark 2.4+, MapReduce 2.0, Hive 0.13+, Sqoop 1.4.5, Flume 1.4+, Kafka 0.8.2+, Hbase, Yarn
Cloud Platform	AWS, Heroku, Sina App\
Database:	HBase 0.98, MySQL 5.x, MongoDB 2.4
IDE:	visual studio, Sublime, Atom, Webstorm, Eclipse, PyCharm, Notepad++\
Data Analysis & Viz:	Matlab, Tableau, MS Excel, Matplotlib, D3.js, Scipy, Scikt-learn, Pandas, Seaborn
Version Control:	GIT