Job Description
Job Description
Data Engineer
The Cloud services group is looking for world class engineers to join our technology innovation group focused on the rapid development of cloud based end-to-end mobile applications and services.
This is a great opportunity for a talented Data Engineer to step up to the next level and build secure cloud services for users of the world’s best-selling mobile devices. This Cloud Team is focused on productizing research projects and supporting their corresponding cloud-based service platforms and infrastructure.
Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to join our technology innovation group focused on the rapid development of AI driven cloud based end-to-end mobile applications and services.
Responsibilities :
- Implement, maintain and evolve big data platform and infrastructure
- Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
- Perform extensive research and analysis to make optimal architecture and design decisions
- Write large amounts of code, perform code reviews, write unit tests and documentation
- Interface with other groups including Product Management, QA and Operations
- Create quick proof-of-concept prototypes
- Work in a scrum team with ML & Cloud Engineers
Requirements :
Hand-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaStrong skills in statistical analysis : correlation analysis, regression analysis, univariate and multivariate analysisStrong skills in algorithms, Data structures, UNIX / Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and NetworkingHands-on experience in building REST API’sTeam player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data EngineeringDesire to learn fast and pick up latest and greatest technologiesMS in Computer Science or equivalent experiencePreferred :
Programming Language : PythonBig Data Technologies : AWS EMR, Iceberg, Spark, Kafka, & YARNMachine Learning : PyTorch, TensorFlow, Spark MLREST API : Flask, FastAPI, or DjangoData Quality tools such as Monte Carlo, Great Expectations, or DatabandExperience with teams using MLflowCompensation : $70 - $95 per hour
ID# : 36469055