Platform & Infrastructure Engineer

Job description ABOUT USMindsDB is a fast-growing AI startup headquartered in San Francisco, California. MindsDB is an AI Analytics solution that connects to diverse data sources and applications then unifies structured and unstructured data, at petabyte scale. Powered by an industry-first cognitive engine that can operate anywhere (on-prem, VPC, serverless), it empowers both humans and AI with highly informed decision-making capabilities. MindsDB was founded in 2017 by Adam Carrigan and Jorge Torres, inspired by Ian M. Banks's Culture series, in which super AI systems called Minds collaborate with other forms of life to accomplish incredible goals. Starting as an open source project, MindsDB now has both open source and enterprise AGI data solutions. The MindsDB community stretches across our GitHub with over 27,000 stars, nearly 800 contributors, and our Slack community of over 6,500 members from every corner of the globe and continues to grow every day. We are backed with over $55M in funding from Benchmark, Mayfield, YCombinator, and NVIDIA. MindsDB is also recognized by Forbes as one of America's most promising AI companies (2021) and by Gartner as a Cool Vendor for Data and AI (2022). THE ROLEOur organization is looking for an experienced Platform & Infrastructure Engineer to join our technology team. This position is ideal for a seasoned professional looking to make a significant contribution to both our company and the open source community. In this role, you will be responsible for designing and implementing complex backend services. We’re looking for someone with not just backend programming experience, but designing them in an highly-scalable fashion, and can take a step back and look at the bigger picture as an architect and see how any individual service will play out on a larger scale and how it’ll interact with other services. The successful candidate will be proficient in Python and have demonstrable experience designing, developing, and deploying scalable & highly available services. We expect you to have a deep understanding of performance, multi-threading, data modeling, and distributed systems. An intimate knowledge of distributed microservice architecture will be critical in this role, as the development and maintenance of these services will form a significant part of your responsibilities. A substantial part of your role will involve developing and maintaining services intended to be run in a Kubernetes environment. As such, knowledge and experience in Kubernetes and containerization are essential. The ideal individual will need to understand how to write robust, resilient applications that can effectively scale and respond to changing conditions in a cloud-based, containerized environment. They will have multiple experiences as such and be able to explain in detail the challenges they’ve had in this space before and how to navigate around them. In addition to technical skills we are seeking a candidate who thrives in a collaborative environment. Excellent communication skills are key as you will be expected to interface with various teams and individuals within the organization and potentially external partners, being able to translate business needs into effective technology solutions will be crucial. We are looking for someone who is driven and motivated and is able to carry projects both on their own and with others. If you are a passionate Python professional with a strong background in backend development, systems architecture, microservices, and Kubernetes, we would like to meet you. This role promises not only technical challenges but also the opportunity to shape the future direction of our technology stack and services. With MindsDB, you will have the chance to bring and expand your skills, face unique challenges, and make a real impact on our business and your future. We have a number of talented and experienced individuals in both the ML / AI space and in the high-scalability space, so there is room for professional growth and tutoring from your fellow staff as well as the opportunity to teach others. We are looking for a candidate currently based in one of the following timezones : Central Time (GMT-5), Mountain Time (GMT-6), Pacific Time (GMT-7), Alaska Time (GMT-8), Hawaii-Aleutian Standard Time (GMT-10). We are open to Hybrid working (in the Bay Area, SF) or Fully Remote. KEY RESPONSIBILITIESEngineering new microservices from the ground up for specific purpose-fit solutions Modifying existing services to perform in a higher-scalability capacity. Experienced with various fan-out patterns, queueing systems, etc. Migrating some services from a monolith to a scalable microservice pattern Devising solutions from a set of requirements Collaborating with team members or other industry professionals or partners about possible requirements, solutions, and deciding a path forward together Implementing that solution either on your own, or on larger projects with a team of engineers some which may be remote. You may be asked to manage your project and any resources (engineers, testers, staff) assigned to your project Having shared responsibility for our suite of services, infrastructure, uptime, and quality of our product Contributing to an open-source project REQUIREMENTS5+ years of industry experience working with Python (or comparable experience) 5+ years engineering backend / API / microservices (or comparable experience) Knowledge of and experience with designing highly-scalable microservices Deep knowledge of Docker, containerization, Kubernetes / docker orchestration Experience working in a team-based environment, in an agile workflow Interest and desire to learn in all items mentioned in “Nice to have” below on the job NICE TO HAVEKnowledge of and experience with Machine Learning / AI tools, technologies, concepts and frameworks Knowledge of Grafana, Prometheus, ElasticSearch / Kibana to assist with debugging Experience with kubectl, capable to debug services deployed into Kubernetes Experience with helm, capable to modify / improve / deploy services into Kubernetes Experience with our open-source library, MindsDB Experience working with Open-Source projects, ideally having contributed and / or authored code to various projects. Understanding what is necessary to successfully contribute Experience with Amazon Web Services (AWS) or Azure Experience with doing tracing and performance auditing and improvements to code and services BENEFITS & PERKSFlexible Working Hours Remote or Hybrid Working Competitive Compensation Competitive Medical, Dental, Vision, Life Insurance (US) 401k with up to 6% matching (US) Unlimited PTO New Hire Remote Setup budget ($1500) Lunch Provided Mon-Fri (US) Internet Budget ($25 / month) (US) Commuter Budget ($1200 / year) (US) Learning & Development budget Wellbeing Budget ($1200 / year) International in-person company retreats Wellbeing / Mental Health leave DIVERSITY, EQUALITY & INCLUSIONMindsDB is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all of our employees. MindsDB will give all qualified applicants consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances.​ Salary Range$100,000—$150,000 USD