Big Data Engineer(Spark Exp) Needed@Uptown Houston, TX
Position Big Data Engineer
Location Uptown Houston, TX (Galleria area)
Duration Long Term contract.
Must have:
#1 - Spark – RDD and Spark processing; integration of Spark with various analytic tools like R/Python
Scala (development language for Spark???)
R based tools: Python / RStudio / Jupyter / Anaconda
Cloudera/Hadoop
O&G experience is highly desired.
Job Description:
• Must have academic and work experience in the area of Statistics, Statistical and Analytical Modeling. B.S. degree or higher in Statistics or Computer Science or a related discipline.
• 8-10 years of IT experience using the Waterfall and Agile methodologies developing Analytical, BI applications.
• At least 4-5 years of experience working with Big Data technologies, especially Hadoop, Cloudera distribution preferred.
• Must have detailed knowledge of Hadoop tools like Hive, Pig, Impala, Sqoop. Must be able to design schemas with partitioning, bucketing, and understand and implement different storage formats. Must know when to use each of these.
• Understand MapReduce programming paradigm and Hadoop2.x and 3.x with a good understanding of YARN.
• Must have fairly detailed knowledge of Spark. Creation of RDD, and Spark processing.
• Understand the integration of Spark with various Analytic tools/applications like R, Python.
• Must have at least 1-2 years of deep experience using R based tools like RStudio, Python Jupyter Notebooks, and Anaconda environment.
• Must be conversant with other analytical processing tools like Tensorflow
• Must be able to work with minimal supervision, a self-starter and able to experiment with upcoming technologies and provide guidance about which is a good fit within the environment.
• Must be mature enough to work with the customer directly, asking the pertinent questions and advising the customer to arrive at a feasible optimal solutions
• Experience with Java would be a plus.
• Any experience with IoT, streaming tools like NiFi, StreamSets, or Informatica BDM is a plus.
• Knowledge of concepts like Data Catalog, etc. a plus.
• Experience in O&G industry a plus.
Sincerely,
Vara
IntelliSoft Technologies Inc
Irving, TX 75038.
Office No: 972-756-1212 Ext: 133
varaprasad@intellisofttech.com
If you would like to unsubscribe from Intellisoft Technologies, please click here.
Location Uptown Houston, TX (Galleria area)
Duration Long Term contract.
Must have:
#1 - Spark – RDD and Spark processing; integration of Spark with various analytic tools like R/Python
Scala (development language for Spark???)
R based tools: Python / RStudio / Jupyter / Anaconda
Cloudera/Hadoop
O&G experience is highly desired.
Job Description:
• Must have academic and work experience in the area of Statistics, Statistical and Analytical Modeling. B.S. degree or higher in Statistics or Computer Science or a related discipline.
• 8-10 years of IT experience using the Waterfall and Agile methodologies developing Analytical, BI applications.
• At least 4-5 years of experience working with Big Data technologies, especially Hadoop, Cloudera distribution preferred.
• Must have detailed knowledge of Hadoop tools like Hive, Pig, Impala, Sqoop. Must be able to design schemas with partitioning, bucketing, and understand and implement different storage formats. Must know when to use each of these.
• Understand MapReduce programming paradigm and Hadoop2.x and 3.x with a good understanding of YARN.
• Must have fairly detailed knowledge of Spark. Creation of RDD, and Spark processing.
• Understand the integration of Spark with various Analytic tools/applications like R, Python.
• Must have at least 1-2 years of deep experience using R based tools like RStudio, Python Jupyter Notebooks, and Anaconda environment.
• Must be conversant with other analytical processing tools like Tensorflow
• Must be able to work with minimal supervision, a self-starter and able to experiment with upcoming technologies and provide guidance about which is a good fit within the environment.
• Must be mature enough to work with the customer directly, asking the pertinent questions and advising the customer to arrive at a feasible optimal solutions
• Experience with Java would be a plus.
• Any experience with IoT, streaming tools like NiFi, StreamSets, or Informatica BDM is a plus.
• Knowledge of concepts like Data Catalog, etc. a plus.
• Experience in O&G industry a plus.
Sincerely,
Vara
IntelliSoft Technologies Inc
Irving, TX 75038.
Office No: 972-756-1212 Ext: 133
varaprasad@intellisofttech.com
If you would like to unsubscribe from Intellisoft Technologies, please click here.
Comments
Post a Comment
Thanks