Senior Spark & Python Developer Job at Mavens Guild, McLean, VA

QVhrR29NNGFIdXptRGY5cGFhUFVsUVByZlE9PQ==
  • Mavens Guild
  • McLean, VA

Job Description

What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table:

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems 

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

Job Tags

Contract work,

Similar Jobs

Gotham Gym

Personal Trainer Job at Gotham Gym

 ...Gotham Gym is a high-profile gym seeking a Personal Trainer who specializes in boxing or kickboxing. We are looking for an upbeat, energetic...  ...individual and group training sessions Evaluate clients' fitness levels and health conditions Build individualized exercise... 

Merit Advisors LLC

Severance Tax Consultant - Houston Job at Merit Advisors LLC

 ...youre making, keep reading. Merit Advisors is looking for a consultant who thrives on autonomy, delivers exceptional client service,...  ...and Team-First. What We Seek We are seeking a Severance Tax Senior Consultant who will join our team working with our clients... 

Crescent Cleaning Company

Don't see a position you'd like? Be on our waitlist! Job at Crescent Cleaning Company

Tell us what shift, time and days are you available to work. We'll contact you once something becomes available with your schedule.

NATIVE HEALTH

Family Practice Physician Job at NATIVE HEALTH

 ...At NATIVE HEALTH, we strive to provide the best health care available for urban American...  ...services to patients. # Knowledge of public health, community health, and population...  ...Completion of an accredited medical school, internship and completion of the certification... 

Waukesha-Pearce Industries (WPI)

Field Tech Class A (ED) Job at Waukesha-Pearce Industries (WPI)

Job Details Description Job purpose To work alongside a journeyman technician while performing major work on assigned jobs. Promote good attitudes and aesthetics that are represented of WPI. To lead small minor repair or service jobs on natural gas engines and ...