Search jobs > Houston, TX > Data engineer python

Senior Data Engineer - Python AWS (French speaking)

QUANTEAM - North America (RAINBOW PARTNERS Group)
Houston, TX, United States
Full-time

As the founding entity of RAINBOW PARTNERS, Quanteam is a consulting firm specializing in the fields of Banking, Finance, and Financial Services.

Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 1,000 expert consultants, representing 35 different nationalities, collaborates across 10 international offices : Paris, Lyon, New York, Montreal, London, Brussels, Geneva, Lisbon, Porto and Casablanca.

Context

The Senior Developer will be responsible for the design, development, and implementation of the platform components, ensuring the use of best practices in software development, and adhering to internal framework guidelines and architecture standards.

The role will also involve collaboration with cross-functional teams to propose common capabilities for the platform.

Key Responsibilities

  • Design, develop, and implement the core components of the Data Lake platform, including :
  • Ingesting large datasets from various sources.
  • Processing and normalizing the data.
  • Distributing the data to different stakeholders.
  • Building and improving the platform’s common framework (e.g., monitoring, CI / CD, testing, performance, resiliency, and development practices).
  • Collaborate with business stakeholders to understand, challenge, and refine their requirements, and translate these into technical solutions.
  • Lead development activities in a senior / expert capacity, producing efficient, reusable, and high-quality code in line with industry standards.
  • Identify bottlenecks and bugs and devise effective solutions to ensure the platform remains resilient and performant.
  • Support production phases, including providing monitoring and alerting tools to minimize disruptions during and after development.
  • Prepare and maintain technical documentation, ensuring it is available to the wider team and external partners. Ensure clear and timely communication with all relevant teams.

Skills & Experience Required

  • At least 3 years of hands-on experience working with AWS cloud services.
  • At least 5 years of experience in Big Data architecture, with expertise in designing and implementing scalable solutions.
  • 5 years of experience in Python 3 development, with a focus on data processing and transformation.
  • Proven experience working in complex and international environments, navigating cross-country operations and regulations.
  • Strong experience in Big Data technologies, data ingestion, processing, and distribution at scale.
  • Extensive experience in software development best practices, including CI / CD, testing, performance optimization, and code quality.
  • Fluent in French required
  • 8 days ago
Related jobs
Promoted
ENVISN INCORPORATED
Houston, Texas

Need 5+ years of hands on experience with Python Data Engineering. ...

GEICO
Houston, Texas
Remote

Experience developing new and enhancing existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components. Our Senior Data Engineer is a key member of the engineering staff working across the organization to provide a friction-less experience to our cu...

JPMorgan Chase & Co.
Houston, Texas

As a Senior Lead Software Engineer at JPMorgan Chase within the Digital Banking organization, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Actively contributes to the engineering ...

Oracle
TX, United States

We're looking for a highly skilled experienced engineers to design and build high-scale, cloud-based data processing systems that can handle massive amounts of data with low latency. As part of this team, you will accelerate several architectural efforts - achieve orders of magnitude data processing...

Tata Consultancy Services
Houston, Texas

Configure cluster setting, cashing database, monitor log capturing, email configuration, Replicator, Dashboard and JVM setting for DEV, TEST and PROD Denodo environment. Scripting experience (Bash, Ansible, Python, PowerShell. ...

Addison Group
Houston, Texas

The Python Software Engineer will work closely with Data Engineers and Data Scientists using advanced analytics and machine learning. Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3. We are currently seeking an experienced Pyt...

Lucas Group
Houston, Texas

We have partnered with our client in their search for a....

Amazon
Houston, Texas

As a AI Specialist Architect for the Energy Data Insights (EDI) on AWS, you will engage with engineering and product to influence the direction of the EDI platform and help our customers and partners tap into new markets by utilizing AI & GenAI along with other AWS services. Are you passionate about...

ENVISN INCORPORATED
Houston, Texas

Need 5+ years of hands on experience with Python Data Engineering. ...

Amazon
Houston, Texas

We are seeking an experienced Designer with UX/UI expertise to join our team and help shape the future of Energy for our Energy Data Insights OSDU Data Platform. Ensure design consistency and adherence to brand guidelines across the OSDU Data Platform and AWS Energy product suite. AWS Support also p...