Urgent Need/ Big Data Engineer with Apache NiFi/Cloudera / Remote

Good Day,
This is Pradip and I am a Technical Recruiter at Shiftcode Analytics. Please see a new job requirement from our client and kindly respond with any matching profiles.

Title: Big Data Engineer
Duration: 12+ Months contract

Location: Remote
Visa: All apart from H1B and CPT

SUMMARY:

  • The Big Data Engineer will support the Enterprise Integration Technology workstream to develop file and API-based integrations between campus systems and Oracle Financials Cloud. Development will utilizing a low-code toolset consisting of Apache NiFi/Cloudera, Kafka, and Kafka Connect. Effective communication and collaboration with diverse project team members, subject matter experts, business partners, functional users, and cross-technical teams is essential for success in this role.

DUTIES:
  • Using the integration toolset previously selected by the project team, design, develop, and test data integrations between systems providing or requiring many different data formats and delivery methods.
  • Using Node.JS and GraphQL to build and document robust APIs to provide services for data integrations.
  • Responsible for estimating timelines for delivery and meeting those timelines.
  • Responsible for documenting developed data pipelines and ensuring project documentation is correctly maintained.
  • Responsible for keeping team and project management informed of progress, anticipated adjustments to timelines, and blocking issues.
  • Participate in team meetings for status updates and knowledge sharing.
  • Assist team members in troubleshooting of problems during testing of integrations.
  • Establishes and maintains effective relationships with team members and integration stakeholders.
  • Other duties as assigned to meet project objectives.
  • Facilitate integration requirements gathering, requesting and analysis of functional data, making recommendations based on findings.

QUALIFICATIONS:
  • 2+ Years of Experience with use of Apache NiFi or Cloudera Data Flow for production environments to facilitate near real-time data exchange.
  • Experience troubleshooting Apache NiFi flows for performance, system load, and functional issues.
  • 2+ Years of Experience using Apache Kafka as a structured message data source or sink in a data integration flow. Experience with Confluent Registry for support of schema definitions in Kafka messages.
  • Demonstrated superior organizational skills to organize work, plan, coordinate and set priorities effectively; multi-task and adapt to changing priorities.
  • Proven experience establishing and maintaining professional interpersonal relationships. Demonstrated skill and ability to work in a collaborative environment to build relationships.

BONUS:
  • Experience using complex transforms in Apache NiFi such as: JoltTransformJSON, ScriptedTransformRecord, EvaluateJsonPath, EvaluateXQuery.
  • Experience with developing backend Node.JS code to implement Apollo GraphQL services. Experience with GraphQL schema design and resolver performance considerations.
  • Experience writing documentation in Markdown. Use of Docsify to build documentation into a website.
  • Experience with VSCode for JavaScript/TypeScript and documentation development.
  • Experience using Docker and writing Docker files for running local servers and deploying applications.
  • Familiarity with Groovy scripting to support some types of data transformations.
  • Experience in working in Higher Education.
  • Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization.
  • Experience working with project management tools such as Smartsheet and Jira.


   Thanks & Regards,
 
    Pradip Sarkar
   Technical Recruiter

   ShiftCode Analytics Inc.,
   5118 Sylvester loop Tampa,
   Florida 33610
   Direct: 813-580-8980
   Email: psarkar@shiftcodeanalytics.com
   URL: http://www.shiftcodeanalytics.com/
 
If you would prefer to no longer receive any emails from this Company, you may opt out at anytime by clicking here.

Comments

Popular Posts