Search jobs > Philadelphia, PA > Big data developer

Big Data Developer

Tata Consultancy Services
Philadelphia, PA
Full-time

Job Title : Big Data DeveloperRelevant Experience (in Yrs)10-12 years Technical / Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins Experience Required10 - 12 Years Roles & ResponsibilitiesWe are seeking a talented and experienced Data Framework Development Technical Lead to join our growing team.

In this exciting role, you will play a pivotal role in shaping the future of our data infrastructure by designing, developing, and implementing cutting-edge data frameworks.

You will split your time equally between :

50% Leading and Guiding : oUnderstanding the data needs and challenges faced by various development teams. oDesigning and architecting scalable, efficient, and secure data frameworks using Python, Java, Spark, and Scala.

oProviding clear technical guidance and mentorship to your team, fostering collaboration and knowledge sharing. oConducting code reviews and ensuring adherence to best practices and coding standards.

oDocumenting processes and best practices for future reference and knowledge transfer.

50% Hands-on Development : oWriting clean, efficient, and maintainable code for data pipelines, data processing tasks, and data quality checks.

oImplementing unit tests and integration tests to ensure code quality and reliability. oTroubleshooting and resolving technical issues related to the data framework.

oStaying abreast of the latest advancements in data engineering technologies and best practices. To be successful in this role, you will need :

  • 5+ years of experience in data engineering or a related field.
  • 2 years Framework experience
  • Proven experience in designing and developing scalable data frameworks using Python, Java, Spark, and Scala.
  • Strong leadership skills with the ability to motivate and guide a team of engineers.
  • Excellent communication and collaboration skills.
  • A passion for data engineering and a commitment to continuous learning.
  • Experience in code review and documentation is a plus.
  • Experience with cloud platforms like AWS.
  • Familiarity with data governance and security principles.
  • Experience with DevOps practices and tools. Generic Managerial SkillsMotivated team player with excellent communication, interpersonal, analytical and problem solving skills.
  • 30+ days ago
Related jobs
Promoted
Tata Consultancy Services
Philadelphia, Pennsylvania

Job Title : Big Data Developer (only local candidates apply for Philadelphia, PA). Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins. Writing clean, efficient, and maintainable code for data pipelines, data processing tasks, and data...

Liberty Jobs
Philadelphia, Pennsylvania

They are currently seeking a Big Data Developer to join our the Development team. ...

Tata Consultancy Services
Philadelphia, Pennsylvania

Job Title: Big Data DeveloperRelevant Experience (in Yrs)10-12 years Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins Experience Required10 - 12 Years Roles & ResponsibilitiesWe are seeking a talented and experienced Data Framework ...

Promoted
Disney Entertainment & ESPN Technology
Philadelphia, Pennsylvania

As a Principal Software Engineer, you'll:. Bachelors degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience. Working with engineers across multiple global teams, often leading proof of concept ...

Promoted
NTT DATA, Inc.
King of Prussia, Pennsylvania

SQL Developer/ Lead to join our team in King Of Prussia, Pennsylvania (US-PA), United States (US). Develop Dynamic SQL and stored procedures. Using indexes to speed up the SQL queries. In-depth understanding of data modeling best practices, normalization techniques, and database design patterns Adva...

Promoted
Comcast Corporation
Philadelphia, Pennsylvania

Make your mark at Comcast -- a Fortune 30 global media and technology company.From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide.Become part of our award-winning technology team that turn...

Promoted
Saransh Inc
Philadelphia, Pennsylvania

Java, Spring Boot, Kubernetes, Oracle/Postgres, Microservices. ...

Promoted
Brooksource
Philadelphia, Pennsylvania

Brooksource is looking to hire a Data Scientist to work with one of our healthcare insurance clients. As the Data Scientist, you will use Google Cloud Platform (GCP) tools and technologies, such as Vertex AI and BigQuery, to build, deploy, and monitor scalable and robust machine learning solutions. ...

Promoted
TalentBurst, an Inc 5000 company
Philadelphia, Pennsylvania
Remote

We are seeking an experienced and skilled LoanIQ Software Developer to join our team. The successful candidate will be responsible for developing, testing, and maintaining software applications using LoanIQ, Servicing software. The ideal candidate should have a strong understanding of LoanIQ, experi...

Promoted
Diverse Lynx
Philadelphia, Pennsylvania

Acquire data from primary or secondary data sources and maintain databases/data systems. Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality. Hands-on architecture of real time REST APIs or other solutions for...