|
Hi,
Tirumaleshan is an Sr AWS Certified Data Engineer with over 10 years of extensive experience on architecting, design and development of various Big Data Technologies on various domains and environments.
· Has extensive experience working with AWS services such as AWS S3, EMR, Athena, Glue, Snowflake, Redshift, Kinesis, DynamoDB, Step Functions, AWS SDK, CLI, CloudFormation etc.
· Worked extensively on Spark development using Spark RDD’s, Dataframes, Datasets, Spark SQL, Spark Streaming for both Batch and Real-Time data pipelines development.
· Extensive experience in designing, developing, debugging, performance tune and deploy spark jobs using PySpark, Scala and Java .
· Worked heavily on developing spark streaming pipelines using Spark Streaming API consuming out of Kafka.
· Extensive experience in analyzing data using Hadoop Ecosystems including Sqoop, Flume, Storm, HDFS, Hive, Pig, Impala, Oozie, Zookeeper, Solr, Spark.
· Involvement in creating custom UDFs for Spark, Pig and Hive to consolidate strategies and usefulness of Python/Java into Spark, Pig Latin and HQL (Hive QL).
· Capable of processing large sets of structured, semi-structured and unstructured data and supporting systems application architecture.
· Experience working with orchestration tools such as Airflow, Oozie, Autosys, Control M etc.
· Experience working with CI/CD using Jenkins, Maven & Git.
· Planned and created answer for constant information ingestion utilizing Storm, Spark spilling and different NoSQL databases.
TECHNICAL SKILLS:.
Cloud Services | AWS S3, EC2, EMR, Athena, Glue, Kinesis, Snowflake, Lambda, Step Functions, Redshift, Dynamo DB. |
Languages | C, Java/J2EE, Python, Scala, SQL, PL/SQL, Pig Latin, HiveQL, Unix Shell Scripting |
AWS Others | Cloudwatch, AWS SDK, CLI, IAM, SQS, SNS. |
Hadoop/Bigdata Services | HDFS, Map Reduce, YARN, Hive, Pig, Spark, Kafka etc. |
Hadoop Distribution | AWS EMR, Hortonworks, Cloudera, Apache |
NoSql Databases | HBase, Cassandra, MongoDB, DynamoDB. |
Orchestration/Workflow | Airflow, Oozie, Autosys, ControlM. |
Monitoring Tools | Cloudera Manager, Cloud Watch, Nagios. |
CANDIDATE DETAILS:
Name | Tirumaleshan P |
Current Location | New Jersey |
Relocation | Yes/Open to US |
Visa | H1B |
Availability | Immediately |
Umesh Kumar / Sr Technical Recruiter
Ph#:(248)-468-1804 | Email Id: umesh@hstechnologiesllc.com | umesh@sbhstech.com
|