Avatar for Canner

Data-driven Insights Made Simple

Sr. Software Engineer, Big Data

$50k – $75k • 0.5% – 1.0%
Apply now
Responsibilities:
- Develop core components in distributed SQL engine (mainly using Spark and Presto)
- Develop and operate and manage distributed data infrastructure
- Develop new connectors to data-sources and maintain existing connectors
- Write unit tests and contribute to CI/CD
- Constantly read related papers and research on distributed computing and database

Requirements:
- A BS or MS degree in Computer Science or Computer Engineering, or equivalent experience
- Experience with NoSQL databases: Redis, Cassandra, or HBase
- Solid Java experience
- Experience of using/developing Hadoop and/or Spark
- Experience working with scalable systems, large-scale data processing, and ETL pipelines
- Experience with SQL and relational databases such as Postgres or MySQL
- Experience of using Docker
- Experience of using any Distributed SQL Engine (Hive, Presto, Spark SQL …etc)
- Experience of using AWS, Azure, and/or Google Cloud Platform
image

Healthcare benefits

Work-from-home friendly

Company events

More jobs at Canner

View all jobs

Data Engineer

Apply now