Job Description
Job Description
Job Description
Job Title : Scala Spark Lead 15+ years of experience
Location : Broadway, New York, NY 10036 (3 days onsite per week)
Duration : 10 / 08 / 2024 - 12 / 31 / 2024 (with potential extension)
Job Role :
We are seeking a highly skilled Scala Spark Lead with over 10 years of experience to join our dynamic team. In this role, you will lead the design, development, deployment, and optimization of data processing applications using Spark and Scala.
Key Responsibilities :
Design, develop, and maintain data processing applications using Scala and Apache Spark.
Collaborate with cross-functional teams to gather data requirements and design efficient solutions.
Troubleshoot and optimize Spark applications for performance issues, ensuring optimal data processing.
Implement test-driven deployment practices to improve the reliability and quality of applications.
Deploy artifacts to higher environments, ensuring smooth transitions and production releases.
Work in an Agile environment, contributing to sprint planning, development, and timely delivery of high-quality solutions.
Provide essential support for production batches, troubleshooting issues to meet business-critical needs.
Mandatory Skills & Experience :
Big Data : 7+ years
Scala : 8+ years
Apache Spark : 7+ years
Core Java : 5+ years
10+ years of experience in software engineering, focusing on Big Data, Scala, and Apache Spark.
Strong understanding of design patterns and data structures for efficient data processing.
Familiarity with database concepts and SQL.
Proficiency in troubleshooting and debugging Spark applications for optimal performance.
Good to Have Skills :
Knowledge of Java and Snowflake.
Familiarity with Python.
Understanding of Databricks platform.
Experience with test-driven deployment practices.
Knowledge of DevOps practices.
Additional Information
Machine Learning Engineer, Ads Attribution, 8+ Years of Experience
Bachelor's degree in technical field such as computer science, mathematics, statistics or equivalent years of experience. Snap Engineering teams build fun and technically sophisticated products that reach hundreds of millions of Snapchatters around the world, every day. We're deeply committed to the...
Android Engineer (7+ years of experience)
We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures (Series C lead), Kleiner Perkins (Series B lead), Sequoia Capital (Series A and Seed co-lead), Andreessen Horowitz (Series A and Seed co-lead), Uncommon Projects, Kevin Systrom, Mike Kri...
Machine Learning Engineer, 3+ Years of Experience, Generative AI
Bachelor's degree in technical field such as computer science, mathematics, statistics or equivalent years of experience. Promote proof of concepts and new features based on new LLM capabilities. Evaluate the technical tradeoffs of every decision. Every day around the globe, millions of people use S...
Radiology Biostatistician - 5 years of post-graduation experience required
For 175 years, NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped to shape the course of medical history and enrich the lives of countless people. PhD in biostatistics, statistics or related field, minimum of 3 years of post-graduate experience. At lea...
Principal Software Engineer, iOS, 14+ Years of Experience
Design, architect and implement well-tested Objective-C software which powers experiences in Snapchat's camera capture and playback experience. Bachelor's degree in technical field such as computer science, mathematics, statistics or equivalent years of experience. Snap Engineering teams build fun a...
Machine Learning Engineer, Generative AI Inference, 3+ Years of Experience
Bachelor's degree in technical field such as computer science, mathematics, statistics or equivalent years of experience. Strong track record of software development in Python or C++. Experience working with high performance kernels: Experience with CUDA programming, OpenMP / OpenCL programming or A...
Security Officer in High End Properties (5 Years of experience Minimum). ($25/h) (All Shifts)
Security Officer in High End Properties (5 Years of experience Minimum). We offer an array of careers that deliver a rewarding experience, great benefits and professional growth and development. At least 5 years of experience working in high end buildings. We challenge our colleagues each step of th...
Software Engineer, Backend, 7+ Years of Experience
BS/BA degree in a technical field such as Computer Science or equivalent years of experience. We’re deeply committed to the well-being of everyone in our global community, which is why are at the root of everything we do. Experience in at least one of the following areas:. Design, implement, and ope...
Data Analyst *Must have 2 years of Professional Post Grad Experience*
To qualify you must have a Minimum Qualifications:1-3 years of prior work experience in a professional setting and a Bachelor's degree. Perform complex data analysis in support of ad-hoc and standing departmental requests using Microsoft Excel or other data collection, statistical, and reporting sys...
Audio-visual Install Technician - (minimum Of 5 Years Of Experience)
Minimum of 5 years of experience as an Audio-Visual Installation Technician. Advanced understanding of AV drawings/schematics. Organized, professional, and good communication skills. ...