ETL Developer (AWS Glue, AWS Aurora ) - Chicago, IL

Role: ETL Developer

Location: Chicago, IL (Initial Remote)

End Client: United Airlines

Implementation Partner: Mphasis

Long Term Contract

 

Key Skills: ETL Developer. Yr: 3-5

Primary skill- 

ETL, AWS Glue, SQL

Apache spark, PySpark, Spark SQL
AWS EMR, Glue, S3, Cloudwatch

Knowledge of RDS(AWS Aurora, Redshift etc.) 

 

Qualifications for ETL Developer

·  Overall 5yrs of experience in ETL development and very strong SQL queries.

·  Experience building and optimizing data pipelines, architectures and data sets.

·  Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

·  Strong analytic skills related to working with unstructured datasets.

·  Build processes supporting data transformation, data structures, metadata, dependency and workload management.

·  A successful history of manipulating, processing and extracting value from large disconnected datasets.

·  Working knowledge of message queuing, stream processing, and highly scalable data stores.

·  Strong project management and organizational skills.

·  Experience supporting and working with cross-functional teams in a dynamic environment.

·  Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

·  Experience with data pipeline and workflow management tools

·  Experience with object-oriented/object function scripting languages: Python, C# Java, C++, Scala, etc.

·  Knowledge with AWS cloud services: EC2, EMR, RDS, Redshift

·  Knowledge with stream-processing systems: Storm, Spark-Streaming, etc and willing to learn and contribute with the team

 

Responsibilities for ETL Developer

·  Create and maintain optimal data pipeline architecture,

·  Assemble large, complex data sets that meet functional / non-functional business requirements.

·  Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

·  Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.

·  Build analytics tools that utilize the data pipeline to provide actionable insights into Airline Revenue Management domain, operational efficiency and other key business performance metrics.

·  Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

·  Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.

·  Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

·  Work with data and analytics experts to strive for greater functionality in our data systems.

--

--

Best Regards,

Shailbi Shukla

Sr. Technical Recruiter

KTEK Resourcing LLC

Direct:  +18327758715 

Email: shailbi.shukla@ktekresourcing.com

--
You received this message because you are subscribed to the Google Groups "US-IT Openings" group.
To unsubscribe from this group and stop receiving emails from it, send an email to java-developer-deepu+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/java-developer-deepu/CADJ7Eeh_d7cxoiAjghi8Jh0ufZOWCSmwDL%3DwkCGNhiZ2662gng%40mail.gmail.com.