Search This Blog

September 7, 2023

Sr AWS Cloud Data Engineer Available Immediately

Sr AWS Cloud Data Engineer

Hi,

Tirumaleshan is an Sr AWS Certified Data Engineer with over  10 years of extensive experience on architecting, design and development of various Big Data Technologies on various domains and environments.

·         Has extensive experience working with AWS services such as AWS S3, EMR, Athena, Glue, Snowflake, Redshift, Kinesis, DynamoDB, Step Functions, AWS SDK, CLI, CloudFormation etc.

·         Worked extensively on Spark development using Spark RDD’s, Dataframes, Datasets, Spark SQL, Spark Streaming for both Batch and Real-Time data pipelines development.

·         Extensive experience in designing, developing, debugging, performance tune and deploy spark jobs using PySpark, Scala and Java .

·         Worked heavily on developing spark streaming pipelines using Spark Streaming API consuming out of Kafka.

·         Extensive experience in analyzing data using Hadoop Ecosystems including Sqoop, Flume, Storm, HDFS, Hive, Pig, Impala, Oozie, Zookeeper, Solr, Spark.

·         Involvement in creating custom UDFs for SparkPig and Hive to consolidate strategies and usefulness of Python/Java into Spark, Pig Latin and HQL (Hive QL).

·         Capable of processing large sets of structured, semi-structured and unstructured data and supporting systems application architecture.

·         Experience working with orchestration tools such as Airflow, Oozie, Autosys, Control M etc.

·         Experience working with CI/CD using Jenkins, Maven & Git.

·         Planned and created answer for constant information ingestion utilizing Storm, Spark spilling and different NoSQL databases.

TECHNICAL SKILLS:.

Cloud Services

AWS S3, EC2, EMR, Athena, Glue, Kinesis, Snowflake, Lambda, Step Functions, Redshift, Dynamo DB.

Languages

C, Java/J2EE, Python, Scala, SQL, PL/SQL, Pig Latin, HiveQL, Unix Shell Scripting

AWS Others

Cloudwatch, AWS SDK, CLI, IAM, SQS, SNS.

Hadoop/Bigdata Services

HDFS, Map Reduce, YARN, Hive, Pig, Spark, Kafka etc.

Hadoop Distribution

AWS EMR, Hortonworks, Cloudera, Apache

NoSql Databases

HBase, Cassandra, MongoDB, DynamoDB.

Orchestration/Workflow

Airflow, Oozie, Autosys, ControlM.

Monitoring Tools

Cloudera Manager, Cloud Watch, Nagios.      


CANDIDATE DETAILS:

 

Name

Tirumaleshan P

Current Location

New Jersey

Relocation

Yes/Open to US

Visa

H1B

Availability

Immediately

 

Umesh Kumar / Sr Technical Recruiter

Ph#:(248)-468-1804 | Email Id: umesh@hstechnologiesllc.com | umesh@sbhstech.com