Senior Spark & Python Developer Job at Mavens Guild, McLean, VA

QVhrR29NNGFIdXptRGY5cGFhUFVsUVByZlE9PQ==
  • Mavens Guild
  • McLean, VA

Job Description

What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table:

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems 

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

Job Tags

Contract work,

Similar Jobs

Encore Vet Group

Associate Veterinarian - Kelly Veterinary Clinic Job at Encore Vet Group

Overview: Embrace your future with confidence as an Associate Veterinarian with Kelly Veterinary Clinic ! Sign-on bonus + relocation assistance, plus a welcoming team ready to support your growth every step of the way. Discover Adrianwhere small-town charm meets outdoor... 

The Stembridge Agency, LLC

Neurosurgeon needed in Prescott Valley, AZ, 2 Hours to Phoenix & Grand Canyon (SA198278) Job at The Stembridge Agency, LLC

 ...eligible Neuro surgeon to join their medical staff and enhance the neurosurgical service line. The Practice: Join Experienced Neurosurgeon, Minimally Invasive, Cerebrovascular & Skull Base Trained Mix of Spine and Cranial Neurosurgery Average 2-3 Surgery Days... 

Two Eleven Distribution dba Leatt USA

Inside Sales Representative - West Region Job at Two Eleven Distribution dba Leatt USA

 ...Salary Range: $45-55K Inside Sales Representative West Region Department : Sales Reports To : National Sales Manager & VP of Sales Moto/ADV Location : Remote (Preferred West Coast-based), can also be in the Reno, NV area. Type : Full-TimeLeatt, located... 

Bristol Myers Squibb

Clinical Development Program Leader, Oncology Job at Bristol Myers Squibb

 ...with Us**Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production... 

Valley Youth House

Life Skills Coach Job at Valley Youth House

 ...Position: Life Skills Coach Location: Philadelphia The Organization: Valley Youth House empowers and strengthens the lives of children, youth, and families through inclusive programming that builds resilience and fosters growth and independence. VYH...