Search jobs > Syracuse, NY > Software engineer infrastructure

Software Engineer - Data Infrastructure - Kafka

Canonical
Syracuse, New York, US
Full-time

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise.

The data platform team is a collaborative team that develops managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics;

all the way to structured SQL engines (similar to Amazon RDS approach).

Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity

We are facing the interesting problem of fault-tolerant mission-critical distributed systems and intend to deliver the world's best automation solution for delivering managed data platforms.

We are looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark).

Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organizations.

Location : This is a Globally remote role

What your day will look like

The data platform team is responsible for the automation of data platform operations, with the mission of managing and integrating Big Data platforms at scale.

This includes ensuring fault-tolerant replication, TLS, installation, backups and much more; but also provides domain-specific expertise on the actual data system to other teams within Canonical.

This role is focused on the creation and automation of infrastructure features of data platforms, not analysing and / or processing the data in them.

  • Collaborate proactively with a distributed team
  • Write high-quality, idiomatic Python code to create new features
  • Debug issues and interact with upstream communities publicly
  • Work with helpful and talented engineers including experts in many fields
  • Discuss ideas and collaborate on finding good solutions
  • Work from home with global travel for 2 to 4 weeks per year for internal and external events

What we are looking for in you

  • Proven hands-on experience in software development using Python
  • Proven hands-on experience in distributed systems, such as Kafka and Spark
  • Have a Bachelor's or equivalent in Computer Science, STEM, or a similar degree
  • Willingness to travel up to 4 times a year for internal events

Additional Skills That You Might Also Bring

You might also bring a subset of experience from the followings that can help Data Platform to achieve its challenging goals and determine the level we will consider you for :

  • Experience operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc) and / or NoSQL (MongoDB, Redis, ElasticSearch, etc), similar to DBA level expertise
  • Experience with Linux systems administration, package management, and infrastructure operations
  • Experience with the public cloud or a private cloud solution like OpenStack
  • Experience with operating Kubernetes clusters and a belief that it can be used for serious persistent data services

What we offer you

Your base pay will depend on various factors including your geographical location, level of experience, knowledge and skills.

In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilization.

Our compensation philosophy is to ensure equity right across our global workforce.

In addition to a competitive base pay, we provide all team members with additional benefits, which reflect our values and ideals.

Please note that additional benefits may apply depending on the work location and, for more information on these, please ask your Talent Partner.

  • Fully remote working environment - we've been working remotely since 2004!
  • Personal learning and development budget of 2,000USD per annum
  • Annual compensation review
  • Recognition rewards
  • Annual holiday leave
  • Parental Leave
  • Employee Assistance Programme
  • Opportunity to travel to new locations to meet colleagues twice a year
  • Priority Pass for travel and travel upgrades for long haul company events

About Canonical

Canonical is a pioneering tech firm that is at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world on a daily basis.

We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do.

Canonical has been a remote-first company since its inception in 2004. Work at Canonical is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game.

Canonical provides a unique window into the world of 21st-century digital business.

Canonical is an equal-opportunity employer. We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products.

Whatever your identity, we will give your application fair consideration.

J-18808-Ljbffr

3 days ago
Related jobs
Promoted
Canonical
Syracuse, New York

The data platform team is a collaborative team that develops managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL engines (similar to Amazon RDS approach). The data platf...

Promoted
Whatnot
Syracuse, New York

As our next Infrastructure Software Engineer, you should have 5+ years of infrastructure engineering experience, building scalable systems that can handle millions of users, plus:. As part of the Infrastructure team, you will be responsible for building and scaling Whatnot’s best-in-class live strea...

Enigma
New York, US

Over the past year weve made significant investments in our data infrastructure to allow engineers & data scientists to quickly deliver customer value by reliably testing & shipping changes to our data pipeline. This role is responsible for developing a data engineering & data science platform. Brin...

Reddit
New York, US

Reddit is a community of communities.Its built on shared interests, passion, & trust & is home to the most open & authentic conversations on the internet.Every day, Reddit users submit, vote, & comment on the topics they care most about.With 100,000+ active communities & approximately 82M+ daily act...

TCGplayer
Syracuse, New York

As a Senior Software Engineer - Kafka, you will design and develop features of our eCommerce website working with some of the best engineers in development today. Understanding of enterprise application technology architecture, databases, microservices, networking, and infrastructure as code. You wi...

CLEAR
New York, US

As a Principal Engineer for our Data Platform team, you will be responsible for modernizing our data platform & practice. Data Engineer, focusing on building scalable data solutions. You will work cross-functionally with multiple engineering teams, providing leadership & advice & helping teams integ...

Prudential Financial
NY, US

As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. Experience in building scalable and stronger data pipelines to support data integra...

CLEAR
New York, US

Working with cloud-based application development, & be fluent in at least a few of: Cloud services providers like AWSData pipeline orchestration tools like Airflow, Dagster, Luigi, etcBig data tools like Spark, Kafka, Snowflake, Databricks, etcCollaboration, integration, & deployment tools like Gith...

Fastly
New York, US

The platform is designed to take advantage of the modern internet, to be programmable, & to support agile software development. ...

CLEAR
New York, US

Were looking for a Senior Software Engineer to join our Infrastructure team to accelerate building & scaling our innovative systems that support our growing identity platform. A software engineer with deep infrastructure & platform experience. Build the paved-road for all engineers to build & deploy...