Lead Data Engineer

 (7+ years exp)
€60k – €80k • No equity
Published: today

Job Location

Remote • 
London • 
Barcelona • 
Oxford • 
Sevilla • 
Málaga • 

Job Type

Full Time

Visa Sponsorship

Not Available

Remote Work Policy

Onsite or remote

Hires remotely in

Preferred Timezones

Central European Time

Relocation

Not Allowed

Skills

Python
SQL
AWS/EC2/ELB/S3/DynamoDB
Terraform
DBT
Datalake
AWS Athena

The Role

About us

At Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfill the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We make it possible for businesses to meet the ever rising expectations of their customers, and we make the world smaller and more accessible to consumers everywhere. Auctane brands enable hundreds of thousands of merchants to annually deliver billions of products — over $200 billion worth — to customers around the globe. And Auctane is just getting started.

Auctane is a team of shipping and software experts with a passion for helping merchants move their ideas, dreams and innovations around the globe. The Auctane family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, Shipsi, GlobalPost, and Packlink. Our partners include Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.

About the role

This is a hands-on role for a Data Engineering Technical Lead seating within the Data Products team. In this role, you will have an enormous impact on the design, implementation and maintenance of existing and greenfield customer-facing data products. Data is key to Auctane’s strategy. We work at a scale pace and with the latest architecture patterns and tech. We process thousands of events per second and our massive dataset keeps growing at a staggering pace. We keep improving our data platform and data engineering stack to accommodate growth, enable novel solutions and provide the best service to our customers. We have a flat and open engineering culture where data & evidence beat opinion and hierarchy, backed by honest discussions. We passionately believe in forming autonomous, cross-functional teams who are empowered to deliver our ambitious strategy. Energy and passion for our business and customers are a part of the Auctane culture – and we love working with like-minded people.

What you'll be doing?

  • Lead and manage a team of data engineers and contribute to the design, build and operational management of our data pipelines and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, Kinesis and ECS.
  • Motivate and grow the team to develop their skills and increase their ownership and impact
  • Collaborate with the Product Owner and other stakeholders to implement the Data Products strategy.
  • Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset.
  • Drive the design and architecture of Auctane’s data product Contribute directly to the implementation and operations of our systems
  • Support the Data Analysts and Data Scientists with automation, tooling, data pipelines and data engineering expertise, enabling them to build rich and complex analytical features and machine learning solutions for our data products.
  • Be an advocate of data quality and observability principles and use state-of-the-art technologies like Airflow, dbt and Spark to process data and get our datasets just right.
  • Define the roadmap of the team based on the input from the Product Owner, other leads and stakeholders.
  • Foster engineering excellence by delivering highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc.
  • Define, implement and enforce automated data security and data governance best practices within the solutions designed.
  • Mentor more junior colleagues and coach the team on coding and data engineering best practices and patterns

What are we looking for?

  • A strong Data Engineering background.
  • Experience developing and supporting robust, automated and reliable data pipelines in Python and SQL.
  • Experience with data processing frameworks like Spark, Trino (Athena), Pandas or DBT.
  • Experience with streaming data processing AWS, Azure or Google Cloud experience.
  • Continuous integration/delivery environment experience with a passion for automation.
  • Knowledge of a Data Orchestration solution like Airflow, Oozie, Luigi or Prefect.
  • Knowledge of both relational and non-relational database design.
  • Knowledge of how to design distributed systems and the trade-offs involved
  • Experience working with software engineering best practices for development, including source control systems, automated deployment pipelines like Jenkins and DevOps tools like Terraform.
  • Comfortable working within a geographically distributed team

What will make you stand out?

  • Production experience working with very large datasets.
  • Experience with AWS and big data cloud technologies like EMR, Athena (Trino), Glue, Big Query, Dataproc, Dataflow.
  • Direct experience with Infrastructure as Code tools (e.g. Terraform, CloudFormation)
  • Knowledge and direct experience of using business intelligence and analytics tools (Tableau, Looker, Power BI, etc.)
  • Practical understanding of PII related issues and other considerations regarding data security MLOps know-how.
  • A desire to constantly challenge the norm Proven track record of promoting and maintaining high engineering standards.
  • Fast learner with a keen interest in evaluating and adopting new technologies: Apache Iceberg, Dagster, DBT, GreatExpectations, Prefect, Snowflake, etc.
  • Willing to attend conferences, webinars and meet-ups and share the learning

What do we offer?

  • 💸 Clear and transparent compensation plan. We will discuss the indicated range with you in the first recruiting call to ensure that we are on the same page.
  • 📦 99% discount on your personal shipment orders via Packlink.pro
  • 💙 Up to 150 EUR/year to match your NGO donations! We are happy to support your initiatives by duplicating the amount donated.
  • 😊 Volunteer day. You can take 1 day off per year to participate in volunteering activities! We will love to see some pictures in our slack!
  • Referral Fee 🔗 We need your support in hiring top-class talent! We offer a referral bonus of 1k-3K, depending on the complexity of the role and the hiring process.
  • ⚖️ Great work-life balance We offer a flexible work schedule and will do our best to adapt to your personal situation. Working in a fast-paced environment can be intense, but that doesn’t mean you shouldn’t enjoy your free time!
  • 💜 An inclusive and upbeat work environment Leave your suit behind... we’re a t-shirt and converse kind of place! More importantly, our company culture promotes diversity and inclusion. The personality and opinions of each of our team members are important and valid, and we aim to offer all employees a safe environment where they can be themselves and thrive.
  • 🌍 A cross-cultural atmosphere We are a truly international team of 20 nationalities that speak 10 languages. Our company language is English and all internal communication and company-wide meetings are in English.
  • 🏟️ Company events Work hard, play hard! We do our best every day, even at our regular team-building events.
  • 📺 Internal and external training, free access to online training platforms such as Linkedin Learning
  • 🏠 We are a remote-first company All team members at Auctane Spain are remote employees. You can decide if you want to work in the office 2 days a week or 3 days per quarter—it's up to you. We also cover your expenses for working from home (50€ net per month/600€ per year).
  • 🌅 We have 25 days of holidays per year (23+🎂 your Birthday Take your birthday off to celebrate!+Christmas).
  • 💻 Everything you need to work from home. Whether you prefer Mac, Linux, or Windows (or an additional screen or two), we set you up for success when working remotely.
  • 🏥 8 hours per year for attending to medical appointments.
  • 👩‍⚕️ 10 hours per year to support your family members when going to the doctor)
  • 📙 Personal Training Budget. Up to 2000€/year training budget (certifications, conferences attendance, etc.) to invest in your professional development. We want to help you improve your technical skills, feel involved in the product community, and develop your soft skills to lead teams and manage other stakeholders.
  • 💰 Flexible Salary We work with a flexible compensation plan for transport, restaurants, and kindergarten so our employees can save on personal income tax via Cobee.
  • 🗺️ Languages classes every week. Thirsty for knowledge? Learn a new language by joining our free English/Spanish/French classes. In groups of 4-5 people, you can connect and enjoy taking up a new language or improving your current skills with one of our great instructors.
  • 🏐 Health and Wellness: The well-being of our team is super important to us.
  • Up to 42€ to cover your Gym membership or exercise classes (pilates, kick-boxing, etc.).
  • Private health insurance, we offer a great plan courtesy of our partner Alan.
  • 👩‍⚕️We have psychological assistance vouchers free of charge.
  • 🏢 Nice Office in the center of Madrid (free drinks, snacks…)

** Please note the perks will be different depending on the country you're hired. The listed above are for Spain.

Similar Jobs

Bulb Software company logo
Bulb Software
Helping growing businesses manage their physical assets in an easy and affordable way
Chainlink Labs company logo
Chainlink Labs
Chainlink Labs is building Chainlink, the industry-standard Web3 services platform
Staze company logo
Staze
A last-minute booking app for holiday rentals
Propeterra company logo
Propeterra
Global Emerging Markets Real Estate Advisory
CogX company logo
CogX
CogX’s mission is to provide the fastest way to discover and learn from the experts that matter
CogX company logo
CogX
CogX’s mission is to provide the fastest way to discover and learn from the experts that matter
Planetrics company logo
Planetrics
Analytics platform to help clients understand climate risk
Creation Labs company logo
Creation Labs
Energy-efficient Autopilot for Trucks