Search jobs > Palo Alto, CA > Senior software engineer

Senior Distributed Computing Software Engineer (Big Data)

TalEx
Palo Alto, California, US
Full-time

Tal-Ex is partnering with a media services organization to identify a talented Sr. Distributed Computing Software Engineer to join our client's Machine Learning Platform and Predictive Segments team.

In this role, you are instrumental in transforming research concepts and business requirements into software products. We value attitude, aptitude, communication skills, and coding skills over experience with specific languages and environments.

Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below.

The Predictive Segments team, part of the Forecasting and Optimization from our client, is responsible for machine learning-based advertising targeting products and supporting machine learning platforms which are responsible for driving performance of advertising campaigns managed by One DSP.

The team, leveraging cutting-edge technologies and rich data, is building a real-time big data and machine learning platform offering audience segmentation products.

Team members, in close partnership with research and product, work with very large amounts of data (2.5 - 3 billion records per day) to help discover and prove new advanced data analytic algorithms for surfacing unique methods for optimizing statistical models enabling prediction and personalization analysis (large-scale machine learning and pattern recognition).

The end goal is to improve online advertising campaign targeting thus maximizing revenues. In addition to the utilization of distributed computing technologies, proving newly developed algorithms, work involves architecture and design to incorporate these new algorithms into new products.

Job Description

The Responsibilities of our Sr. Distributed Computing Software Engineer will include :

  • Performing research and iterative prototyping with large-scale distributed computing and distributed database systems architecture.
  • Utilizing experience with distributed file systems, database architecture, and data modeling to organize and process large data sets.
  • Developing software to support machine learning and data mining projects and contextual analysis, such as crawling, parsing, indexing, and unique content analysis.
  • Collaborating with scientists and analytics solution architects to design distributed data storage and processing services that are scalable, reliable, and available.
  • Identifying potential performance bottlenecks and scalability issues to justify or critique the design of new algorithms;

and assists researchers with accessing and processing large amounts of data.

Qualifications

  • Master’s degree in Computer Science or related field.
  • At least 3 years of software development experience.
  • A minimum of 2 years of experience working with distributed systems.
  • Knowledge in distributed system design, data pipelining, and implementation.
  • Knowledge in machine learning algorithms.
  • Knowledge and experience in building large scale applications using various software design patterns and OO design principles.
  • Experience with Java, Scala, Python.
  • Experience with either distributed computing (Hadoop / Spark / Cloud) or parallel processing (CUDA / threads / MPI).
  • Expertise in design patterns (UML diagrams) and data modeling of large scale analytic systems.
  • Experience in research, analysis, and the conversion of large amounts of raw collected data and content into new sets of data that is structured and does not reduce data context in order to enable the productization of new products.
  • Worked with data warehousing and distributed / parallel processing of large data sets using parallel computing systems to map / reduce computation and Linux clusters (e.

g. Hadoop / Cloud technologies, HDFS); cluster.

  • Experienced in modern development methodology such as Agile, Scrum, and SDLC.
  • Ability to work in a research-oriented, fast-paced, and highly technical environment.
  • Quick thinker and a fast learner, collaborative spirit, and excellent communication and interpersonal skills.

J-18808-Ljbffr

23 hours ago
Related jobs
Promoted
Apple
Cupertino, California

As tech lead for our software team, you be responsible for: - Understanding customer needs, partnering with PM to define the future of DSI's applications - Delighting our customers with the experience of using DSI-built tools - Driving a team of engineers to effectively decompose, plan, and execute ...

Promoted
Snowflake
San Mateo, California

We are seeking talented Senior Software Engineers who are technical leaders in the big data open source community to join us to define the strategy, engage and deliver innovation into the open source community, and bring Snowflake to millions of big data professionals. Our customers want to bring mo...

Promoted
Fortinet
Sunnyvale, California

Our team is responsible for building the graphic user interface for several on-premise and SaaS based products.We're looking for a highly motivated individual who can thrive in a fast pace environment and successfully contribute to the team.The ideal candidate will have a can-do attitude, passion fo...

Promoted
Alldus
CA, United States

Bachelor's or Master’s degree in fields such as Computer Science, Software Engineering, Electrical Engineering, Robotics, or a closely related discipline. Effective communicator, able to collaborate with multidisciplinary teams including software engineers, hardware engineers, and product managers. ...

Promoted
Apple
Sunnyvale, California

We're looking for a Senior Data Engineer to play an integral role in building the data foundations, interpreting quantitative data and developing insights for the Apple Developer Program. Other responsibilities include: Serving as an expert on the data sources associated with our services and proces...

Promoted
31st Union
San Mateo, California

We’re seeking a Senior Audio Programmer who enjoys a collaborative and creative work environment and is looking to lead the effort to push the boundaries of cutting edge Audio. Maintain documentation on audio system that’s understandable by engineers and designers. Experience developing for multi-pl...

Promoted
Google
Sunnyvale, California

We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing ever...

Promoted
Gatik AI Inc.
Mountain View, California

We are seeking backend engineers for our software team to build our fleet management platform. Experience with Relational Databases and NoSQL Databases like Cassandra or MongoDB. Collaborate with the frontend and infrastructure engineers for successful implementation of product features. Design, dev...

Databricks
Mountain View, California

As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...

ByteDance
San Jose, California

Qualifications- 5+ years of work experience in software engineering, privacy engineering or security engineering. Data privacy engineering is a new technological territory that hasn't been well defined in our industry. By joining the team, you will have chances to refine the data privacy framework, ...