Key Responsibilities:Develop data processing pipelines integrating various datasets at a large scaleCollaborate on transforming existing ML code into automated servicesSupport data governance and DevOps practices, including CI/CD solutionsRequired Qualifications, Training, and Education:Minimum of 3...
Architect and develop robust data ingestion pipelines to collect data from diverse sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage. Architect and implement data processing pipelines using cloud-native data processing...
A company is looking for a Cybersecurity Data Management Engineer to safeguard its critical infrastructure and enhance cybersecurity strategies. ...
Partner with data scientists, software engineers and cross-functional stakeholders (Marketing, Operations, Finance) to build data pipelines that will provide critical data and insights to drive growth for the business, while ensuring data availability and accuracy. Proven success in communication wi...
A company is looking for a Data Engineer with strong experience across the entire Cloud Data stack. ...
Design and maintain scalable data pipelines using Spark and AWS EMR for processing terabytes of consumer data. Automate delivery of structured data to enterprise clients via Snowflake and Databricks. Collaborate with the Data Science team to optimize data infrastructure. Contribute to data modeling ...
Develop and maintain data ingestion pipelines to collect data from various sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage. Develop and maintain data processing pipelines using cloud-native data processing frameworks...
Design and implement scalable data pipelines using Databricks and Spark. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Ensure data quality and integrity across various data sources. Proven experience as a Data Engineer or in a similar role. ...
About Tessera DataTessera Data is a leading background data provider with specialized expertise in criminal records, court data, and motor vehicle report retrieval for people-risk insight assessment and management. We are focused on building a safer future by providing valuable, people data used to ...
Computer science, data analysis and/or data engineering coursework Interest in a software engineering career and technology startups Affinity and familiarity working with data in Excel Scripting or coding experience in Python to efficiently manipulate large volumes of data. Uncountable is seeking re...
As the Lead Data Engineer, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines. If you're a seasoned data engineer with expertise in data engineering technologies and a track record of leading su...
The Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. Establish sol...
Data Experience is a tightly-knit team working within the Disney Entertainment & ESPN Technology’s (DE&E Tech) Data department. As the business place moves toward more data-driven decision making, the ability to access data easily becomes very important. While focused on full-stack application devel...
Welcome to the forefront of real-time data engineering! At our company, we're dedicated to harnessing the power of real-time data to drive insights and enable real-time decision-making. As a Real-Time Data Engineer, you'll play a pivotal role in designing, building, and optimizing our real-time data...
System Engineer, Customer Data Platform. Monitor data flow, identify anomalies, and ensure data quality and consistency. Collaborate with business, product, and data teams to ensure data needs are met. The Enterprise Technology team supports insights with data and the technical systems that give our...
This is not a Data Engineer role to work with the engineering team on iOS project . Sr Data Engineer III - 3 days a week hybrid on site. Experience with databases like Teradata a big plus. Proven work Data Engineer working with Enterprise Clients (Google, Facebook, Nvidia, Uber, Linkedin etc). ...
Build, improve and maintain Brex’s data platform and infrastructure: data warehouse & analytics (Snowflake), data streaming (Kafka), replication (CDC) and materialization (Flink), data jobs orchestration (Airflow), data observability, access & governance. To ensure that our product experienc...
If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team. As a Senior Data Engineer, you'll play a critical role in designing, building, and maintaining our data infrastructure and pipelines. You'll work on ...
Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers. ...
The Engineering team includes Data, IT, Security, and Software, and is responsible for building innovative products and infrastructure for both internal and external users. This includes working with our Cloud Provider to engineer the computing, data storage, and networking functionality for our cus...
As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...
Splunk is looking for an enthusiastic and innovative Principal Software Engineer to join our Observability Data Platform organization. The Data Platform is a large-scale, highly performant, available and reliable system that processes billions of data points per minute. Experience with 1 or more rel...
Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...
The central Data Platform seeks to build a self-service tooling platform to make the petabytes of data at Discord easily accessible for everyone at the company. Reporting to the Engineering Manager of Data Products, you will work on strategy that is foundational to the company and product. Work with...
The team is responsible for data management tools, operations, data quality, and research on techniques for data collection. OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Have past experience as a technical lead of a larger organization (Uber TL), serving as...