Engineer
Engineer
Contract Duration 12 Months
Pay range $58.24 - $76 / hr
Job Description
The Engineer will create new ingest batch / streaming pipelines from the ground up or maintain existing pipelines.
Recommend tools / tech stack that will improve the effectiveness of existing pipelines or reduce the overall operating cost of the existing pipelines Responsibilities
Possess an in-depth understanding of the data structures and governance Deep understanding of modern cloud computing platforms and concepts (AWS preferred)
Work with modern schema-less big data storage solutions.
Work closely with machine learning and data science teams to create scale and efficiency
Work closely with DevOps to foster a culture of collaboration
Demonstrate critical thinking for potential roadblocks; comprehend a bigger picture of the business and effectively communicate these issues to stakeholders
Work closely with internal stakeholders to implement solutions that adhere to solution designs and schema
Engineer will work in an agile software development team to create new batch / streaming ingest data pipelines from the ground up, and / or expand upon those created by other team members.
Act as a lead, identifying and assigning new work for other engineers.
Test and create automated unit / integration tests for your code, ensuring every function, service, and object is compatible with your team’s work and with the many systems within the clientNews Group system portfolio.
Act as a development leader, help to formulate best practices, and set up toolsets and procedures for the team, leveraging internally available tools and communicating with other internal development & product teams.
Stay up-to-date on new development and platform technologies, make recommendations for the right tool for the job, and take the lead in setting up those tools and training other developers on them.
The Engineer will create documentation for developers as well as business users to help them understand your products.
Maintain cloud-based platforms and environments of supported applications, troubleshooting and patching functional issues and data issues in lower or production environments when necessary.
Qualifications
Embrace a builder’ mentality to push the business forward
8+ years experience in a software developer role
4+ years of experience as a data engineer
Proficient with AWS, Python, and Pyspark
Experience with EMR, S3, SNS, Ka fka, Databricks, Athena, Kinesis, Lambda and Airflow
Experience with distributed data technologies (e.g. Spark)
Proficient with Linux environment
Passion for media and news
B.S. degree in Computer Science, Information Technology, or equivalent experience
Benefits :
Medical, Vision, and Dental Insurance Plans
401k Retirement Fund
About the Company :
One of the world's leading entertainment and media companies involved with the evolution, production, and marketing of news, entertainment, and information to a global audience.
They operate in over 30 countries including television stations group and production operations, premier motion picture company, news and entertainment television networks, a premium ad-supported streaming service, and world-renowned theme parks.
This company strives to foster a diverse and inclusive culture where its employees feel supported, embraced, and heard. They believe that their workforce should represent the communities they live in, so that together, they can continue to create and deliver content that reflects the current and ever-changing face of the world.
gtttf
LI-GTT
phone number removed)