ONLY REPLY TO ABHAY.SINGH@DIVERSELYNX.COM TO REVIEW PROFILE.
I hope you're doing well!
My name is Abhay and I'm an IT Recruiter at Diverse Lynx.
I have an urgent position for the following role. If interested, please share your resume at Abhay.singh@diverselynx.com
Core Spark & Scala Developer - Onsite (Jersey City, NJ or Tampa, FL)
About the Role:
We are seeking a highly motivated and experienced Big Data Developer to join our team in either Jersey City, NJ or Tampa, FL. In this role, you will play a crucial part in designing, developing, and maintaining big data solutions using Apache Spark and Scala to extract valuable insights from our data. You will collaborate with data engineers, data scientists, and business stakeholders to design, develop, and implement scalable data pipelines and applications.
Responsibilities:
- Develop and maintain big data applications using Spark and Scala for processing and analyzing large datasets.
- Design and implement scalable data pipelines using Spark to ingest, transform, and load data from various sources (e.g., relational databases, message queues, log files).
- Utilize Spark libraries (e.g., Spark SQL, MLlib) to perform data cleansing, transformation, feature engineering, and potentially machine learning tasks.
- Work closely with data engineers to optimize Spark jobs for performance and efficiency on on-premise physical clusters.
- Collaborate with data scientists to understand their analytical needs and translate them into production-ready Spark applications.
- Write clean, maintainable, and well-documented code adhering to best practices.
- Participate in code reviews and knowledge-sharing sessions with the team.
- Stay updated on the latest advancements in big data technologies (Spark, Scala).
Qualifications:
- Essential Skills:
- 5+ years of experience in software development with a focus on big data technologies.
- Proven experience developing big data applications using Apache Spark and Scala.
- Strong understanding of distributed computing frameworks and concepts (MapReduce, functional programming).
- Experience with data ingestion techniques (e.g., Kafka, Flume) is a plus.
- Familiarity with relational databases (e.g., MySQL, PostgreSQL) and SQL querying.
- Experience working with data pipelines and data warehousing concepts.
- Experience working with on-premise physical clusters for big data deployments.
- Excellent problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Strong communication and collaboration skills.
- Desirable Skills:
- Experience with cloud platforms (AWS, Azure, GCP) for deploying Spark applications (a plus).
- Knowledge of machine learning libraries (e.g., MLlib, TensorFlow) is a plus.
- Experience with containerization technologies (Docker, Kubernetes).
- Experience with DevOps tools and methodologies (CI/CD pipelines).
- Experience working in an Agile development environment.
Best Regards,
Abhay Singh
IT Recruiter
Diverse Lynx LLC.
Email: abhay.singh@diverselynx.com | URL: http://www.diverselynx.com
LinkedIn ID: https://www.linkedin.com/in/abhaysingh-chauhan/
Diverse Lynx LLC|300 Alexander Park|Suite #200|Princeton, NJ 08540
You received this message because you are subscribed to the Google Groups "Dev Goel Data 5" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dev-goel-6+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dev-goel-6/CAPVQj4pEzAcSqp-GQU0at%3DLxYc78veriMbruCqgRN0dgnS9ntw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.