Avatar for Pinterest

Discover recipes, home ideas, style inspiration and other ideas to try.

Software Engineer, Big Data Platform

$100k – $180k • 0.02% – 0.2%
Apply now
We’re looking for a seasoned Big Data engineer to help us build and scale the next generation of big data platform and infrastructure at Pinterest. You'll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, etc.) in the world on hundreds of petabytes data to help hundreds of millions of people discover and do what they love.

What you’ll do :
Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
Contribute to the team’s technical vision and long-term roadmap
Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale

What we’re looking for :
5+ years of experience on open-source Big Data technologies
Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
Experience with Hadoop, Spark, Hive, Presto, SQL, Kafka, Parquet, and HDFS
Proficiency in multiple systems languages (Java, Scala, Python)
AWS experience a plus

More jobs at Pinterest

View all jobs

Machine Learning Engineer

Apply now

Software Engineer, Ads Infrastructure

Apply now

Software Engineer, Homefeed Infrastructure

Apply now

Sr Web Engineer

Apply now

Sr. Full-Stack Engineer, Growth

Apply now

Product Manager

Apply now