We are looking for a Senior Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects.
If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI / CD and DevOps we would love to speak with you!
About You experience, education, skills, and accomplishments
- Bachelor's degree in computer science or equivalent experience in software development.
- Minimum 3 years of relevant experience in developing Big Data systems.
- Minimum 3 years' experience in working with all aspects of distributed processing, including Hadoop, Hive, Apache Spark and Cassandra.
- Minimum 3 years' experience coding in key technologies like Java, Apache Spark, Hive, PostgreSQL, Scala, Git, Linux, AWS, and Greenplum.
- Minimum 3 years' experience in AWS Ecosystem with hands-on knowledge of ec2, S3 and services
- Minimum 3 years' experience in working with build tools like Maven, Gradle and CI / CD tools like Jenkins.
It would be great if you also had . . .
- Experience in Big Data design and development
- Experience on Spark streaming
- An understanding of existing complex processes and workflows
- Hands on experience with the full SDLC
- Experience working in an Agile Scrum methodology
What will you be doing in this role?
- Make modifications to existing software and integrating applications within the core pathway.
- Must develop software using disciplined software development processes, adhering to team / company standards and software best practice guidelines, and corporate policies.
- Deliver quality product to our QA and be responsible for creating and executing unit tests on the code that they write for their applications.
- Able to write high-performance, reliable, and maintainable code.
Hours of Work
- Full time, permanent
- Hybrid working schedule 2-3 days / week on-site
- Must live within a commutable distance to our Philadelphia, PA office
Clarivate is an Equal Opportunity Employer Vets / Minorities / Women / Disabled
Senior Clinical Data Engineer
Handling Missing Values, reading raw data files, creating data structures, handling programming errors, accessing, and managing data, appending and concatenating SAS datasets. Lead and implement the setup of Data Receipt Agreements with vendors by working with cross functional teams. Programming and...
Senior Cloud Engineer - Data Transmission Services
Are you looking for an exciting opportunity to grow and learn while driving major impact for a critical platform at Vanguard? The Data Transmission Services team is seeking an AWS Cloud Engineer to join our expanding engineering team. Provide senior level system analysis, design, development, and im...
Senior Data Engineer, Finance Data Team (REMOTE)
Experience developing new and enhancing existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components. Our Senior Data Engineer is a key member of the engineering staff working across the organization to provide a friction-less experience to our cu...
Senior Data Engineer (remote)
Proven success in communication with database users, software engineers and senior management to collect requirements, discuss data modeling decisions and define data engineering strategies. Partner with data scientists, software engineers and cross-functional stakeholders (Marketing, Operations, Fi...
Senior Data Engineer
We are looking for a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer at Partnerize, you will:. Collaborate with data scientists and other stakeholders to support data-driven decision making and implement data solutions. Experience with data warehousing, data modeling,...
Senior Data Engineer
As a Senior Data Engineer on the MMA National IT Data and Analytics Team, we will count on you to develop and maintain scalable data pipelines, enhance data models, and provide subject matter expertise in data acquisition and consumption pipelines on Azure, Databricks and Confluent. In-depth underst...
Senior Data Engineer, Java
As part of the Data Engineering team, you will be working with a team of smart, friendly, and dedicated Data Engineers, ML Engineers, and Data Scientists determined to develop high-quality data products that power core features of our app. The ideal candidate has a passion for data, a strong backgro...
Big Data Engineer
Lending Club’s Data Architecture group is responsible for the strategic architecture and deployment of the data infrastructure ecosystems. As a key member of the Big Data team you will be responsible for architecting, designing and developing major components of next generation stream and batch proc...
Big Data Hadoop Python Spark Engineers (3 Positions)
Python Hadoop Data Engineer ( 3 Positions) . My client a global leader and top place to work has hired me to find for them a Python Hadoop Data Engineer. In this role you will develop and implement big data solutions. ...
Lead Big Data Engineer
We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you!. Minimum 5 years of relevant experience in developing Big D...