Responsibilities
- Ensure the quality and reliability of data pipelines, data warehousing, and analytics solutions driven through automated testing.
- A strong background in data engineering, ETL & ELT (Extract, Transform, Load) orchestration tools, SQL, & Tableau.
- Identify and report defects and work closely with data engineers to resolve issues.
- Collaborate with data engineers to validate and optimize data warehousing solutions.
- Ensure data consistency, accuracy, and efficient storage.
- Utilize ETL orchestration tools to automate and schedule data workflows.
- Create tests to validate functionality and reliability of these workflows.
- Develop and maintain test suites for Tableau dashboards and reports; verify data accuracy and dashboard functionality to ensure data visualizations provide meaningful insights.
- Write and execute SQL queries to validate data transformations, data loading, & data retrieval processes. Ensure data consistency and correctness at each stage of the pipeline.
- Test data streaming processes for correctness, data integrity, & performance.
- Implement and maintain regression test suites to ensure that changes or updates to data pipelines do not introduce new issues or regressions.
- Develop and maintain automated test scripts and frameworks for data engineering processes to improve testing efficiency and coverage.
- Collaborate closely with data engineers, data analysts, and other stakeholders to understand data requirements and ensure data quality and reliability.
- Document test cases, test plans, and test results; create and maintain documentation on data pipelines, ETL processes, & data structures.
- Stay up to date with industry best practices, emerging technologies, and trends related to data engineering and testing;
identify opportunities for process improvement and automation.
Skills & Requirements :
- 5+ years of experience with software QA and / or data engineering.
- Proven experience in software testing, specifically in data engineering, ETL processes, and data warehousing.
- Strong SQL skills and experience working with databases such as SQL Server or similar, and data warehousing such as Snowflake or Amazon Redshift.
- Proficiency in ETL orchestration tools such as SnapLogic, Fivetran, similar.
- Experience with data visualization tools, particularly Tableau.
- Strong problem-solving skills, attention to detail, & excellent communication / collaboration skills.
- Proven ability to work independently and in a team.
- Knowledge of scripting languages for test automation is a plus (Python and / or JavaScript preferred).
- Experience with real-time data streaming technologies is preferred (Amazon Kinesis or Apache Kafka preferred).
- Bachelors in Computer Science, Information Technology, or related field is preferred.
Principal Engineer Software Test
Bachelor’s degree in a Science, Technology, Engineering, or Mathematics (STEM) discipline from an accredited university and 5 or more years of experience in software engineering OR a Master’s degree in a Science, Technology, Engineering, or Mathematics (STEM) discipline and 3 or more years of experi...
Software Development Engineer in Test: Mail, Messages, FaceTime, and Phone
The Internet Technologies QE & Ops team is seeking an experienced and passionate Software Development Engineer in Test to take our existing automation infrastructure to the next level. We're looking for critical thinkers to play a key role in qualifying Apple's software releases and ensuring a h...
Software Engineer for AI Training Data
A company is looking for a Software Engineer for AI Training Data. ...
Software Test Engineer II - R&D (Automation)
Leads and coordinates activities of employees engaged in performing audits and tests of software products in accordance with software test plans and procedures. Works as a contributing member of cross-functional teams as needed, working closely with R&D engineering, Technical Support and Quality...
Staff Software Engineer Data Tools
Key Responsibilities:Lead an org-wide architecture for self-service data consumptionDesign scalable data-related technologiesOwn and build-out the Data ModelRequired Qualifications:Post-secondary degree in Computer Science, Engineering, or relevant field8+ years experience as a Software Engineer or ...
Software Development Engineer (ML)
Do you want to join an innovative team of engineers and scientists who use terabytes of data and create state-of-the-art algorithms to push the boundaries of AI? We are building the foundational behavioral model for Amazon Stores using LLM and Large Model training techniques that fuses general world...
Software Test Engineer II
An individual responsible for designing and developing test automation tools & infrastructure. Tandem is firmly committed to being an equal opportunity employer and maintaining a diverse and inclusive environment. Our company’s human-centered approach to design, development, and support delivers...
Senior Software Test Engineer - Payload
This role will involve architecting and building test infrastructure, collaborating closely with hardware engineers and software developers, and providing technical leadership throughout the testing process. We are seeking a Senior Software Test Engineer with a specialization in software test archit...
Senior Staff Software Development Engineer
To be successful in this position you will have experience in modern cloud-based systems (GCP, Terraform, Big Query), development experience using standard modeling and machine learning libraries, understanding of container based platforms such as Kubernetes, and mobile application development on iO...
Software Development Engineering Manager, Framework Internal Apps
That Development Engineer, Engineering Manager, Internal, Software, Framework, Manager, Technology. Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the res...