Description
Learn more about the general tasks related to this opportunity below, as well as required skills.
Team Introduction
The Data Platform team works on building data infrastructures and data products to support business engineering teams.
As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world.
You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Responsibility
- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, and multi-dimensional analysis)
- Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
- Establish solid design and best engineering practice for engineers as well as non-technical people
Requirements
- BS or MS degree in Computer Science or related technical field or equivalent practical experience
- Experience in the Big Data technologies (Hadoop, M / R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.)
- Experience with performing data analysis, data ingestion and data integration
- Solid communication and collaboration skills
- Experience with ETL (Extraction, Transformation & Loading) and architecting data systems
- Experience with schema design and data modeling
- Experience in writing, analyzing and debugging SQL queries
- Deep understanding of various Big Data technologies
- Passionate and self-motivated about technologies in the Big Data area
J-18808-Ljbffr
Data Integration Engineer
A company is looking for a Principal Data and Integration Engineer (REPLICATION ADMIN) - REMOTE. ...
Data Engineer, Global Live
We support our businesses in achieving their missions by building high quality real-time and offline data warehouses, creating various forms of efficient and data-friendly data assets, and exploring and implementing business oriented data solutions. We provide stable and reliable data capabilities f...
Data Engineer, Data Products
As a data engineer in the Data Products group, your work will be typically focused on designing, building, and maintaining new data pipelines and datasets for workflows involving one or more Business Units at SoFi. SoFi is seeking an experienced and motivated Data Engineer to drive high standard tec...
Machine Learning Data Engineer Specialist
Ensure data quality, security and availability for the data, notebooks, models, experiments, and applications. Build secure, robust, scalable, and performant systems for processing transactions and managing customer data. For specific information on how FIS protects personal information online, plea...
Full Stack Software Engineer, Data Center Engineering
Our mission is to provide critical data to operators and engineers that enables them to make informed decisions for sustainability of data center facilities. Deploy RDBMS software in performance-critical, high available environments and provide support for system upgrades, new system releases, perfo...
Staff Engineer Full Stack & Data Engineering
Solid understanding of data engineering concepts: ETL processes, data warehousing, data lakes. Staff Engineer - Full Stack & Data Engineering. The team is building an analytics platform for accessing, enriching, analyzing, and visualizing geospatial data. We are seeking a talented full-stack Eng...
Staff Engineer – Data Lakehouse Platform
Our Staff Engineer is a key member of the engineering staff working across the organization to innovate and bring the best open-source data infrastructure and practices into Geico as we embark on a greenfield project to implement a core Data Lakehouse for all Geico’s core data use-cases across each ...
Software Development Engineer, Dashboards Service Team
As we expand at a tremendous rate, we are looking for innovative engineers with a passion for data, search, analytics and distributed systems to join the team. Amazon OpenSearch Service makes it easy for you to perform interactive log analytics, real-time application monitoring, website search, and ...
Sr Machine Learning Engineer, Risk Data Mining
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Appropriately handling and managing confidential inf...
Sr. Optical Network Engineer, DRES
The DRES Optical Services team is responsible for the development, delivery and lifecycle support of the optical products used to interconnect AWS Data Centers and PoPs (Point of presence), ensuring diversity of supply and continually lowering data transfer cost for customers. PhD or foreign equival...