Senior Spark & Python Developer

Mavens Guild
McLean, Virginia, United States
Full-time

What we would like to see :

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm.

Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer :

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark / PySpark, Java and performance enhanced SQL
  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools
  • Design and develop automation of data flow tasks and end-to-end process testing
  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems
  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem
  • Implement and lead implementation efforts of Spark / Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table :

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark
  • 5+ years experience as a Java programmer
  • 3+ years experience programming in Python (PySpark API)
  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3
  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams
  • Experience with continuous integration tools like Jenkins
  • Experience working in a distributed computing infrastructure like Hadoop and / or Spark
  • Critical and analytical approach to solving technical problems
  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike
  • 30+ days ago
Related jobs
Promoted
Capital One
McLean, Virginia

West 19th Street (22008), United States of America, New York, New YorkSenior Software Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment...

Promoted
Capital One
Idylwood, Virginia

West 19th Street (22008), United States of America, New York, New YorkSenior Software Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment...

Promoted
Capital One
McLean, Virginia

Center 1 (19052), United States of America, McLean, VirginiaSenior Lead Software Engineer (Building Strategic Roadmaps, Executing Complex Solutions, Python, AWS, Spark)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabo...

Promoted
Capital One
Fairfax, Virginia

Plano 6 (31066), United States of America, Plano, TexasSenior Data Engineer (Python, SQL, Spark)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part o...

Promoted
Capital One
Merrifield, Virginia

West 19th Street (22008), United States of America, New York, New YorkSenior Software Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment...

Promoted
Capital One
McLean, Virginia

Senior Software Engineer (Python, Spark, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. Java, Scala, Python, Go, or Node...

Mavens Guild
McLean, Virginia

Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure. In a senior developer role, you will design an...

Pyramid Consulting, Inc
McLean, Virginia

Provide L3 Production Support for python based I&CM core applications. Python, SQL, pytest, numpy, pandas. Design and implement Web-based applications using Python. ...

Zillion Technologies, Inc.
McLean, Virginia

Senior Python Developer- Must be local to Mclean, VA. Must Have Qualifications: Must have a minimum of 5 years of hands-on python development experience. Provide L3 Production Support for python based I&CM core applications. Design and implement Web-based applications using Python. ...

Bitcoin Devs Company
Vienna, Virginia

TheSenior Python Developer plays a crucial role in our companyssoftware development team. Develop cleanmaintainable scalable and testable software for high performantbackend systems with Python. Youhave a long track record with Python and RestAPI knowledge built upin product based companies. ...