Data Infrastructure Engineer

About the role

We are looking for infrastructure engineers with expertise in data pipelines to join the Data & ML infra group. This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work directly with product teams across the company to design and develop both external and internal products. Handling massive volumes of data for Applied Intuition's platform needs is a critical area and we are looking for someone who can be hands-on in supporting our data products and services across the company. At Applied Intuition, we encourage all engineers to take ownership over technical and product decisions, closely interact with external and internal users to collect feedback, and contribute to a thoughtful, dynamic team culture.

At Applied Intuition, you will:

• Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion.
• Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads.
• Enable product workflows that expose performant query interfaces and offer easy-to-use integration hooks.
• Develop and deploy high-quality software using modern tooling and frameworks.
• Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence.
• Work with products and teams across Applied Intuition.

We're looking for someone who has:

• Experience with large-scale open source data processing frameworks (Spark, Kafka, Airflow, Flink, Hudi, etc.).
• Experience with containerization and other modern software development workflows.
• Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.
• Strong knowledge of data concepts, including experience in using a big data warehouse.

Nice to have:

• Expertise with modern programming languages (Python, C++, GoLang, etc.).
• Experience with enterprise software, including on-prem and/or cloud environments.
• Deep knowledge of data quality, data profiling and cleansing techniques.

The salary range for this position is $65,000 USD to $400,000 USD annually. This salary range is an estimate, and the actual salary may vary based on the Company's compensation practices.