Avatar for Quantcast

It’s time to focus on what matters: growth

Staff Software Engineer (Lead), Scale & Transport

$170k – $250k
Apply now

At Quantcast, data is king, and the Scale & Transport team knows how to process it. The unique features of our custom map-reduce implementation include a revolutionary petabyte sort mechanism, an efficient and flexible petabyte join and lookup, based on innovative data indexing and partitioning mechanisms, dynamic task size adjustment in running jobs, and a self-tuning system that learns and improves job performance without developer intervention. In the last 5 years it has allowed Quantcast to scale from processing 400 to 40,000 terabytes of data per day. For a workload consisting primarily of ETL, analytics, and data mining, our big data processing platform is on average 4 to 5 times more efficient than the most popular open source map-reduce system.

Now Quantcast is looking to marry the ergonomics of Spark with the adaptability and performance of our home-grown stack. Are you the Staff Engineer who can bring us into the next generation of distributed computing? You would integrate and improve new open source technologies and invent your own.

Responsibilities

  • Co-own the vision for peta-scale computation at Quantcast, from strategy to implementation
  • Work with engineers using Quantcast’s distributed computing infrastructure to anticipate and meet their needs, with an eye to business value
  • Design and develop high performance distributed computing systems
  • Diagnose and solve big data problems with system engineering solutions
  • Perform design, architecture, and code reviews
  • Mentor and grow junior team members
  • Innovate in the big data space: lead, not follow

Requirements

  • BS in Computer Science or equivalent experience
  • 8 years of industry experience in software development
  • Experience working & optimizing the performance of large-scale distributed systems
  • Proficient in C++ and/or Java
  • Strong software development skills (version control, code review, testing, release, monitoring, debugging)
  • Proficiency and high level of insight into Linux OS and running software systems on Linux

Quantcast is an audience intelligence and measurement company headquartered in San Francisco. Combining machine learning, a privacy-by-design approach, and live data drawn from more than 100 million online destinations, Quantcast provides software, information and advertising services for marketers, publishers and advertising agencies worldwide. Founded in 2006, Quantcast has employees in 20 offices across 10 countries.

We are committed to building an inclusive and diverse environment where everyone can be their authentic self. We work to ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Health & wellness

Career development

Compensation

Work-life balance

Quantcast at a glance

It’s time to focus on what matters: growth

Quantcast focuses on Internet, Advertising, and Software. Their company has offices in San Francisco, New York, London, Milan, and Dublin. They have a large team that's between 501-1000 employees. To date, Quantcast has raised $53.2M of funding; their latest round was closed on January 2010.

You can view their website at http://www.quantcast.com or find them on Twitter.

Similar jobs to Staff Software Engineer (Lead), Scale & Transport at Quantcast

Avatar for Thunder
Enable digital marketing creative agility, personalization, and optimization
Avatar for Docbot
Docbot develops real-time AI-driven assistance for colonoscopy
Avatar for Datavant
Providing solutions to help institutions protect, match and share health data
Avatar for Stealth HR Tech / AI startup
AI that coaches employees to provide meaningful and unbiased employee performance reviews
Avatar for Altitude Networks
Altitude Networks provides data security for enterprises using collaboration SaaS
Avatar for AllStripes
2-sided patient and life sciences platform to accelerate drug research in rare disease
Avatar for Biomie
Influencer Marketing Platform