Senior Data Engineer
$180k – $220k
Published: 1 week ago
Willow Innovations
We're on a mission to build solutions to mom's most meaningful problems
Job Location
Job Type
Full TimeVisa Sponsorship
AvailableHires remotely in
Relocation
AllowedThe Role
About The Role:
We are building a modern data platform that will allow Willow Innovations the ability to make the most optimal business decisions. We are a growing organization and the Senior Data Engineer will have a huge influence in shaping the data strategy. If you feel a deep sense of ownership for your work, are passionate about data, desire to solve problems, are curious and love learning new things, we’d love to talk to you!
Roles & Responsibilities | What You'll Do:
- Own and drive data integration architecture involving streaming, micro-batch and batch
- Work closely with various business groups to collect business requirements
- Design, develop and deploy high performance data pipelines both inbound and outbound
- Build aggregate and enriched data sets needed to effectively analyze / visualize data
- Document, maintain and support data pipelines
- Measure and monitor quality and availability of data
- Implement data policies - retention, privacy, security, and compliance
- Responsible for maintaining the Data Pipeline framework
- Mentor and guide junior data engineers
Experience | What You'll Bring:
Must Have:
- 5+ years of experience in building data lakes and data warehouses
- Experience working with Google Cloud, BigQuery, GCS, Pub Sub, Data Flow etc
- Expert knowledge on SQL and Python programming
- Good understanding of data formats such as JSON, Parquet, ORC, XML, etc
- Experience in tuning queries for performance and scalability
- Experience working with any workflow management tools (Airflow, Oozie, etc)
- Excellent organizational, prioritization and analytical abilities
- Strong communication and interpersonal skills
Nice to Have:
- Experience in Real Time Data Ingestion using Kafka, Spark, Storm etc
- Knowledge of NoSQL
- Experience with Data visualization tools such as Looker, Tableau, PowerBI
More about Willow Innovations
Similar Jobs
Composable Analytics
Intelligent DataOps
Oncora Medical
Software, data, and ML to help doctors and scientists in the fight against cancer
Box Score
Sports Betting for the Rest of Us
VocaliD
Create custom AI-voices to elevate the way businesses speak to their customers
Open Health Network
Integrated AI powered continuous care framework for chronic disease management
Red Ventures
RV's portfolio of brands and businesses helps millions make informed decisions
Cherre
The real estate industry’s leading data management and analytics platform
Cherre
The real estate industry’s leading data management and analytics platform
Ashana Health
Adding Digital Element to Rehabilitation Process