Senior AWS Data Engineer - Dallas, TX (Onsite) - 15+ Years (Need Banking Clients EXP)

Senior AWS Data Engineer – Need Banking Clients EXP.
Location: Dallas, TX (only Locals)
EXP Needed: 15+ Years
Work Mode: Onsite

Job Description

We are seeking highly skilled Data Engineers to join the AppBank Factory team supporting a large-scale datastore migration initiative The team will be responsible for migrating enterprise data assets from on-premises Data Lake environments to an AWS-hosted Lakehouse platform.

This is a high-visibility project requiring strong expertise in data engineering, migration frameworks, cloud platforms, and stakeholder collaboration.

Key Responsibilities

Pipeline Migration

• Refactor and migrate extraction logic and scheduling workflows from legacy platforms to modern Lakehouse environments.
• Perform end-to-end dataset migration while ensuring data integrity and consistency.
• Work closely with internal stakeholders and data owners to validate migrated assets and complete sign-off activities.
• Troubleshoot SQL and scripting-related migration issues.

Consumption Pattern Migration

• Convert and optimize legacy SQL and Spark-based consumption patterns for Snowflake and Apache Iceberg compatibility.
• Analyse existing usage patterns and deliver required data products.
• Support raw and modeled data migration efforts.
• Coordinate with business and technical stakeholders throughout migration phases.

Data Validation & Reconciliation

• Build and execute reconciliation frameworks to ensure migrated datasets are functionally equivalent to production systems.
• Perform data quality checks, validation, and issue resolution.
• Maintain governance and compliance standards during migration activities.

Platform Collaboration

• Collaborate with internal data platform and infrastructure teams.
• Learn and adapt to new workflows, frameworks, and language constructs as required.
• Support CI/CD and Kubernetes-based deployment processes.

Required Skills & Qualifications

Education

• Bachelor’s or master’s degree in computer science, Engineering, Applied Mathematics, or related quantitative field.

Experience

• 10–12 years of hands-on software/data engineering experience in collaborative development environments.
• Strong troubleshooting skills in SQL and scripting.
• Experience working on enterprise-scale data migration or modernization initiatives.

Programming & Development

• Strong proficiency in Python or Java.
• Deep understanding of SDLC methodologies and CI/CD best practices.
• Experience with Kubernetes (K8s) deployments.

Core Data Engineering Skills

• Temporal Data Modelling (SCD Type 2)
• Schema Evolution and enforcement strategies
• Data partitioning and clustering optimization
• Normalization vs Denormalization concepts
• Natural vs Surrogate Keys
• Data reconciliation and validation frameworks

Technical Stack

Data & Streaming

• Apache Spark
• Kafka
• ANSI SQL
• FTP

Platforms & Storage

• Hadoop (HDFS/Hive)
• Snowflake
• Apache Iceberg
• Sybase IQ
• AWS Lakehouse

Data Formats

• JSON
• Avro
• Parquet

Preferred Qualifications

• Experience working with cloud migration programs.
• Exposure to enterprise financial services environments.
• Strong analytical and debugging skills.
• Ability to work with distributed global teams.

 

 

Best,

Kavya Reddy

Email: kavya@dvgts.com
DVG Tech Solutions LLC.
(a WBE/MBE and E-Verify Employer)
666 Plainsboro Rd, Suite 1010, Plainsboro NJ 08536
Phone: (609) 888 6198 | Fax: 609-228-6092