Big Data Engineer

-
Click here to if you no longer wish to receive our emails

Hi,
Hope you are doing great today! Hope you are Safe and healthy.
This is Serisha from EA team. We have an opportunity with one of our clients,please find the below job Description and let me know if you have any suitableprofiles

 

Position: Data Engineer (Big Data)

Location: Philadelphia (PA) (Remote until post covid)

 

  • Build and manage the integration framework/data pipelines for OSS
  • Identify and utilize applications required for Extract, Translate and Load/stream data
  • Architecture the solution framework interfacing with application engineers
  • Build the infrastructure, such as spinning up of servers in AWS environment, setting up of application servers, secure and harden application servers for deep security, deploy applications, establish monitoring and implement high availability
  • Build processors to integrate applications involving 100s of millions of events a day
  • Influence and create new designs, architectures, standards, and methods for integrated applications spanning from network elements, element management systems, network managing systems, inventory systems, provisioning systems and activation systems in OSS
  • Practice agile methodology and rapid development to bring solutions incrementally
  • Engage in service capacity planning and demand forecasting, software performance analysis and system tuning
  • Engage in designing of fault tolerant, geographically redundant and resilient Application, Infrastructure and Database driven systems
  • Engage in designing of Security Information & Event Management (SIEM) concepts and functionality
  • Engage in designing of Application Integration (REST, SOAP, XML, JSON, Synchronous, Asynchronous)
  • Design and implement Performance Monitoring across applications
  • Engage in Disaster Recovery Program development, management and testing
  • Engage in Information Security incident response program development and management

 

Minimum qualifications:

  • BS degree in Computer Science or related technical field
  • 5-7 year of experience working as data engineer/architect or similar role
  • Demonstrable experience with big data tools: Hadoop, Apache Spark, Kafka
  • Demonstrable experience with data pipeline and workflow management tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc.
  • Exp with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra
  • Exp with Amazon Web Services (AWS) (VPC, EC2, EMR, RDS, DynamoDB, Route 53, ELB, VPN, Direct Connect, CloudTrail, CloudWatch, S3, IAM, WAF, Lambda scripting with Python/Node.JS, Messaging, Kinesis, Glue, Redshift, etc.)
  • Experience with network monitoring and packet analysis tools
  • Experience working with Unix/Linux systems from kernel to shell and beyond, with experience working with system libraries, file systems, and client-server protocols.
  • Experience with network protocols e.g. TCP/IP, UDP, ICMP, etc., MAC addresses, IP packets, DNS, OSI layers, and load balancing.
  • Work in an agile environment, ability to write epics and stories and familiar with tools such as Confluence and Jira

 

Preferred qualifications:

  • AWS certified Architect and Developer
  • Big Data certification
  • Exp with object-oriented/object function scripting languages: Python, Java, C++,
  • Expertise in designing, build, monitor and troubleshooting large-scale distributed systems
  • Systematic problem-solving approach, coupled with a strong sense of ownership and drive
  • Experience with monitoring applications such as Zabbix




This email is generated using CONREP software.

A90024

Comments

Post a Comment

Thanks

Popular posts from this blog

AWS / Cloud Architect with (Mainframe) | Remote | 10+ yrs exp

-
AWS / Cloud Architect with (Mainframe) | Remote | 10+ yrs exp   Hello ,   Greetings from VBeyond Corporation!   VBeyond has been consistently recognized by renowned clients for being their trusted staffing partners for almost one and half decades.   I am sorry if am bothering you on your busy schedule, we are looking for an AWS Architect with Mainframe Migration and not sure if you are looking for new project.   If you do, then please share your updated resume with contact information or kindly help me with a suitable reference that would be a great help.   Role : AWS / Cloud Architect with (Mainframe) Location : Remote Duration:- Long Term Contract The customer is looking for AWS architect who can help define application architecture leveraging native AWS component. Required to be hands on Tech Architectural profile , providing solutions , suggestions and helping in maintaining the technic...
Read more

Sr. Data Engineer : With MI DL & In-person interview

-
Title: Sr. Data Engineer Duration: 6 + Months Interview: in -person Location: Immediate onsite 3 days per week in Troy, MI (Need Locals Only) Visa: USC, GC, TN, OPT/EAD, CPT/EAD, EAD/GC, H4/EAD LinkedIn Must At least 9 years experience Position Title Sr Data Engineer        Job Summary   The Sr. Data Engineer is responsible in understanding and supporting the businesses through the design, development, and execution of Extract, Transform, and Load (ELT/ETL), data integration, and data analytics processes across the enterprise. He/She will stay on top of tech trends, experiment with and learn new technologies, contribute to the growth of data organization, participate in internal & external technology communities, and mentor other members of the team. Provide technical leadership at every stage of the data engineering lifecycle, from designing data platforms, data pipelines, data stores, and gathering, importing, wrangling, querying, and analyzing data....
Read more

AWS Architect with Mainframe Migration

-
You don't want to miss this.   Hi , Hrishikesh from VBeyond Corporation this side.   VBeyond has been consistently recognized by renowned clients for being their trusted staffing partners for almost one and half decades.   Please see the job description below If interested, kindly do share your updated resume.  Role: AWS Architect with Mainframe Migration Location: Remote Duration: Long Term   Job Description:   The AWS Architect is responsible for the designing and managing AWS Architecture. Roles and Responsibilities: •Hands on experience architecting in AWS • Strong experience in Designing data pipelines and data solutions on premise and on cloud, in AWS Big Data, Glue/EMR/S3/Redshift, Hadoop distributed frameworks, Apache Spark with Python, Java programming and Hadoop Ecosystems • Good experience on Snowflake, End to End implementations on ETL...
Read more