Good Day,
This is Pradip and I am a Technical Recruiter at Shiftcode Analytics. Please see a new job requirement from our client and kindly respond with any matching profiles.
Title: Big Data Engineer
Duration: 12+ Months contract
Location: Remote
Visa: All apart from H1B and CPT
SUMMARY:
- The Big Data Engineer will support the Enterprise Integration Technology workstream to develop file and API-based integrations between campus systems and Oracle Financials Cloud. Development will utilizing a low-code toolset consisting of Apache NiFi/Cloudera, Kafka, and Kafka Connect. Effective communication and collaboration with diverse project team members, subject matter experts, business partners, functional users, and cross-technical teams is essential for success in this role.
DUTIES:
- Using the integration toolset previously selected by the project team, design, develop, and test data integrations between systems providing or requiring many different data formats and delivery methods.
- Using Node.JS and GraphQL to build and document robust APIs to provide services for data integrations.
- Responsible for estimating timelines for delivery and meeting those timelines.
- Responsible for documenting developed data pipelines and ensuring project documentation is correctly maintained.
- Responsible for keeping team and project management informed of progress, anticipated adjustments to timelines, and blocking issues.
- Participate in team meetings for status updates and knowledge sharing.
- Assist team members in troubleshooting of problems during testing of integrations.
- Establishes and maintains effective relationships with team members and integration stakeholders.
- Other duties as assigned to meet project objectives.
- Facilitate integration requirements gathering, requesting and analysis of functional data, making recommendations based on findings.
QUALIFICATIONS:
- 2+ Years of Experience with use of Apache NiFi or Cloudera Data Flow for production environments to facilitate near real-time data exchange.
- Experience troubleshooting Apache NiFi flows for performance, system load, and functional issues.
- 2+ Years of Experience using Apache Kafka as a structured message data source or sink in a data integration flow. Experience with Confluent Registry for support of schema definitions in Kafka messages.
- Demonstrated superior organizational skills to organize work, plan, coordinate and set priorities effectively; multi-task and adapt to changing priorities.
- Proven experience establishing and maintaining professional interpersonal relationships. Demonstrated skill and ability to work in a collaborative environment to build relationships.
BONUS:
- Experience using complex transforms in Apache NiFi such as: JoltTransformJSON, ScriptedTransformRecord, EvaluateJsonPath, EvaluateXQuery.
- Experience with developing backend Node.JS code to implement Apollo GraphQL services. Experience with GraphQL schema design and resolver performance considerations.
- Experience writing documentation in Markdown. Use of Docsify to build documentation into a website.
- Experience with VSCode for JavaScript/TypeScript and documentation development.
- Experience using Docker and writing Docker files for running local servers and deploying applications.
- Familiarity with Groovy scripting to support some types of data transformations.
- Experience in working in Higher Education.
- Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization.
- Experience working with project management tools such as Smartsheet and Jira.
Thanks & Regards,
Pradip Sarkar
Technical Recruiter
ShiftCode Analytics Inc.,
5118 Sylvester loop Tampa,
Florida 33610
Direct: 813-580-8980
Email: psarkar@shiftcodeanalytics.com
URL: http://www.shiftcodeanalytics.com/
