Data Engineer(Google Cloud & Bigdata Exp) Immediate Need @ Remote ( CST Hrs)
Position Data Engineer(Google Cloud & Bigdata Exp)
Location Remote .(CST Hrs)
Duration 12 Months
Healthcare Clients Experience is Ideal
Python and/or Scala Coding, Spark, Hadoop, and GCP, AWS, or Azure Cloud (Will be working in Google Cloud Platform GCP)
Lacking experience with Spark processing and Big Data Development
Needing strong coding experience with Scala/Python for pipeline development (we mostly use scala – so need JVM skills)
GCP experience is preferred, but AWS or Azure would be comparable for us.
Responsible for construction and development of "large-scale cloud data processing systems" The Data Engineer must have considerable expertise in data warehousing and the job requires proven coding expertise with Python, Scala, SQL, and Spark languages.
Must be able to implement enterprise cloud data architecture designs, and will work closely with the rest of the scrum team and internal business partners to identify, evaluate, design, and implement large scale data solutions, structured and unstructured, public and proprietary data.
Desired Work Experience:
Proficient in multiple programming languages, frameworks, domains, and tools.
Coding skills in Scala or Python, and Spark Programming
Experience with gcp platform development tools Pub/sub, cloud storage, big table, big query, data flow, data proc, and composer desired.
Strong Linux/Unix background and hands on knowledge.
Knowledge in Hadoop and cloud platforms and surrounding ecosystems.
Experience with web services and APIs as in RESTful and SOAP
Ability to document designs and concepts
API Orchestration and Choreography for consumer apps
Well rounded technical expertise in Apache packages and Hybrid cloud architectures
Pipeline creation and automation for Data Acquisition
Metadata extraction pipeline design and creation between raw and finally transformed datasets
Quality control metrics data collection on data acquisition pipelines
Able to collaborate with scrum team including scrum master, product owner, data analysts, Quality Assurance, business owners, and data architecture to produce the best possible end products
Experience contributing to and leveraging jira and confluence.
Strong experience working with real time streaming applications and batch style large scale distributed computing applications using tools like Spark, Kafka, Flume, pubsub, and airflow.
Ability to work with different file formats like Avro, Parquet, and JSON.
Managing and scheduling batch jobs.
Hands on experience in Analysis, Design, Coding and Testing phases of Software Development Life Cycle (SDLC)
--
Best Regards,
Vara
Intellisoft Technologies, Inc.
1320 Greenway Dive, #460. Irving, TX 75038
Ph. (972) 756 1212 Ext: 133 Direct No:4702919397
varaprasad@intellisofttech.com
http://www.intellisofttech.com
Note: In case if i miss any calls, Please don't hesitate to send me an email.
Equal Employment Opportunity
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
If you would like to unsubscribe from Intellisoft Technologies, please click here.
Location Remote .(CST Hrs)
Duration 12 Months
Healthcare Clients Experience is Ideal
Python and/or Scala Coding, Spark, Hadoop, and GCP, AWS, or Azure Cloud (Will be working in Google Cloud Platform GCP)
Lacking experience with Spark processing and Big Data Development
Needing strong coding experience with Scala/Python for pipeline development (we mostly use scala – so need JVM skills)
GCP experience is preferred, but AWS or Azure would be comparable for us.
Responsible for construction and development of "large-scale cloud data processing systems" The Data Engineer must have considerable expertise in data warehousing and the job requires proven coding expertise with Python, Scala, SQL, and Spark languages.
Must be able to implement enterprise cloud data architecture designs, and will work closely with the rest of the scrum team and internal business partners to identify, evaluate, design, and implement large scale data solutions, structured and unstructured, public and proprietary data.
Desired Work Experience:
Proficient in multiple programming languages, frameworks, domains, and tools.
Coding skills in Scala or Python, and Spark Programming
Experience with gcp platform development tools Pub/sub, cloud storage, big table, big query, data flow, data proc, and composer desired.
Strong Linux/Unix background and hands on knowledge.
Knowledge in Hadoop and cloud platforms and surrounding ecosystems.
Experience with web services and APIs as in RESTful and SOAP
Ability to document designs and concepts
API Orchestration and Choreography for consumer apps
Well rounded technical expertise in Apache packages and Hybrid cloud architectures
Pipeline creation and automation for Data Acquisition
Metadata extraction pipeline design and creation between raw and finally transformed datasets
Quality control metrics data collection on data acquisition pipelines
Able to collaborate with scrum team including scrum master, product owner, data analysts, Quality Assurance, business owners, and data architecture to produce the best possible end products
Experience contributing to and leveraging jira and confluence.
Strong experience working with real time streaming applications and batch style large scale distributed computing applications using tools like Spark, Kafka, Flume, pubsub, and airflow.
Ability to work with different file formats like Avro, Parquet, and JSON.
Managing and scheduling batch jobs.
Hands on experience in Analysis, Design, Coding and Testing phases of Software Development Life Cycle (SDLC)
--
Best Regards,
Vara
Intellisoft Technologies, Inc.
1320 Greenway Dive, #460. Irving, TX 75038
Ph. (972) 756 1212 Ext: 133 Direct No:4702919397
varaprasad@intellisofttech.com
http://www.intellisofttech.com
Note: In case if i miss any calls, Please don't hesitate to send me an email.
Equal Employment Opportunity
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
If you would like to unsubscribe from Intellisoft Technologies, please click here.
Comments
Post a Comment
Thanks