Search jobs > Palo Alto, CA > Data engineer

Data Engineer

Arch Systems
Palo Alto, California, US
Full-time

Arch Systems is seeking a talented and impactful Data Engineer to become part of our rapidly expanding team. In this role, you will work with data collected from factory machines and devices, processing and preparing it for effective data analytics and visualization.

Your contributions will play a crucial role in transforming raw data into actionable insights that drive our business forward.

Check all associated application documentation thoroughly before clicking on the apply button at the bottom of this description.

About Arch Systems

Started by Stanford Engineering PhDs and grown out of non-profit work in Africa, Arch is a venture-backed company working with the world’s largest electronics manufacturers.

We combine rich data from all machines, new and legacy, to drive real-time and predictive analytics transforming manufacturing efficiency and how we work.

We are looking for talented and driven people who seek a lasting impact both in transforming manufacturing operations as well as making critical industries more efficient, connected, and sustainable.

Come join our diverse and passionate team!

Compensation

We adhere to equitable compensation practices, benchmarking against prevailing rates in the San Francisco Bay Area. Our compensation structure includes various elements such as base salary and performance incentives.

Employees based in the US can anticipate competitive benefits for themselves and their dependents, alongside equity ownership within the company.

Remote Equal

Even before the onset of COVID-19, Arch has embraced a remote-friendly work environment. Unfortunately, we are unable to provide visa sponsorship at this juncture.

Arch also adheres to the regulations set forth by the Office of Foreign Assets Control (OFAC) to ensure compliance with all applicable sanctions programs.

This position will require candidates to be based in the United States with proper work authorization to work in the US.

About the Role

As a Data Engineer, you will play a key role in managing and optimizing the data pipelines that fuel our Athena DB, ensuring seamless data integration and accessibility.

In this role, you'll collaborate closely with both our cloud and data science teams to deliver robust, scalable data solutions.

What You Will Own & Drive :

  • ETL Pipeline Development : Write and maintain transform code in Python to ensure efficient and reliable data flows within our ETL pipeline.
  • Infrastructure Maintenance : Troubleshoot and fix infrastructure code related to AWS Lambda functions, ensuring smooth operation of cloud services.
  • Cross-Team Data Modeling : Lead complex data modeling efforts across multiple teams and domains, identifying and resolving data inconsistencies.
  • Report Generation & Debugging : Develop code to generate complex reports and assist team members in debugging and optimizing their report-generating processes.

What You Bring to The Table :

  • Bachelor’s Degree Required, Advanced degrees (Master's or Ph.D.) are highly preferred.
  • 3-7+ years of proven experience in Data science, Data processing, & Insight generation.
  • Practical Experience : Hands-on experience with machines, manufacturing, or other industrial processes, applying data-driven insights in real-world scenarios.
  • Exceptional Logical Thinking : Strong problem-solving abilities with a focus on clear, structured logic.
  • Proficient in Python : Strong expertise in Python development, with a focus on data engineering applications.
  • Platform / Infrastructure Expertise : Comfortable working with cloud infrastructure, and eager to contribute to Terraform code for infrastructure as code (IaC) initiatives.
  • SQL & Data Modeling : Skilled in SQL, with experience in data modeling and analytics engineering to ensure clean, structured, and scalable data systems.
  • Systems Thinking : Comprehensive understanding of complex systems, ensuring effective integration and functionality across platforms.
  • Communication Skills : Exceptional ability to simplify and articulate complex concepts to customers, ensuring clarity and engagement.
  • Visual Presentation : Proficient in creating clear, impactful visuals and actionable takeaways that drive understanding and decision-making.

What Makes You Stand Out :

  • Exceptional Coding Skills : Demonstrated proficiency in coding, showcasing a strong command of best practices and efficient programming techniques.
  • Deep Theoretical Understanding : Outstanding grasp of theoretical concepts in computing, allowing for informed decision-making in complex scenarios.
  • System Design Proficiency : Highly adept at understanding the trade-offs involved in system design, ensuring optimal performance and scalability.
  • Self-Starter : Ability to self-unblock easily, demonstrating initiative and resourcefulness in overcoming challenges.
  • Remote Team Experience : Proven experience collaborating effectively with remote, distributed teams, leveraging communication tools to maintain productivity.
  • AWS Expertise : Hands-on experience with AWS services, contributing to cloud-based solutions and architecture.
  • Infrastructure as Code (IaC) : Proficient in using Terraform for infrastructure management, enabling efficient deployment and scaling of resources.
  • Container Orchestration : Familiarity with Kubernetes for managing containerized applications, enhancing deployment efficiency and reliability.

How We Will Support You :

  • Ambitious and clear vision of how you can be a part of transforming the manufacturing supply chain and building next generation IoT technology.
  • Highly motivated and experienced team with relevant domain expertise and network.
  • Ability to deploy your work solving cutting edge problems with major manufacturers worldwide including Fortune 500 companies.
  • Learning & Development budget to allow you to continue to grow in not only your function, but in any way that relates!
  • Trust in your ability to do your best work when and where you want and to communicate this with your team.
  • Flexible Time Off : take the time you need, including an end-of-year break and an ask that all Arch-itects take at least one additional (consecutive) week off each year to recharge in addition to local holidays and religious observances.
  • Opportunity to challenge yourself, be nurtured, and grow in a highly dynamic environment.
  • A culture that welcomes and encourages autonomy, ownership, and transparency; allowing you to make, learn from, and teach others in your failures as much as your successes.
  • Potential to travel to the annual Arch Summit.
  • A culture of diversity of thought and background with many languages and nationalities on the team.

Resumes must be submitted in English.

We encourage interested and enthusiastic applicants to apply and not allow imposter syndrome to self-select out of an opportunity.

We believe in hiring people as their full and authentic selves, allowing them to utilize their strengths and then helping them to learn, grow, and add to those strengths.

J-18808-Ljbffr

20 hours ago
Related jobs
Promoted
TikTok
San Jose, California

The Global E-Commerce team focuses on building data infrastructure and data product areas to support business engineering teams working directly on TikTok's E-Commerce platform. As a data engineer in the Global E-Commerce team, you will have the opportunity to build, optimize and grow one of the lar...

Promoted
DataBricks
Mountain View, California

The role that the Data Engineer plays is collaborative and, as such, works with data analysts, data scientists, and other data consumers within the business in an attempt to gather and populate data warehouse table structure, which is optimized for reporting. The Data Engineer participates with desi...

Promoted
OneSignal
San Mateo, California

We are looking for a Lead Data Engineer who lives and breathes data to sit within the operations team and connect and organize our data across the company. Full Time] Staff Data Engineer at OneSignal (United States). Create systems that process data into a data lake within operations. Build data sci...

Promoted
CROSS SAFETY MANAGEMENT LLC
Santa Clara, California

Principal Firmware Engineer - Data Center Server ManagementNVIDIA. The candidate will be responsible for overseeing firmware quality, reliability, and performance in data centers. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry. Disclaimer: J...

Promoted
Western Digital
San Jose, California

From energizing the most competitive gaming platforms, to enabling systems to make cities safer and cars smarter and more connected, to powering the data centers behind many of the world’s biggest companies and public cloud, Western Digital is fueling a brighter, smarter future. Our data-centric sol...

Promoted
Walmart
Sunnyvale, California

Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud. Guide and mentor a team of engineers, conducting code reviews and leading design discussions to ensure engineering best practices. Skilled in data modelling ...

Orangepeople
Menlo Park, California

Welcome to the forefront of data innovation! The main function of the Data Engineer is to develop, evaluate, test, and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the ...

Mindlance
Cupertino, California

Build a high-quality data transformation framework, implementing and operating data pipelines with an understanding of data and Client lifecycles. Understand end to end nature of data lifecycles to deliver high quality data and debug data concerns. Drive development of data products in collaboration...

Mediabistro
Redwood City, California

Senior Software Engineer, Data Engineering - Moloco Commerce Media. Candidates should have over 7 years of software engineering experience with modern programming languages such as Java, C#, Go, C++, and Python, alongside advanced proficiency in SQL and database technologies. Further expertise in da...

Axiom Software Solutions Limited
Sunnyvale, California

Big Data Technologies along with Java development experience. ...