Data Engineer
(1+ years exp)AllTheRooms
Job Location
Job Type
Full TimeVisa Sponsorship
Not AvailableRelocation
AllowedSkills
The Role
What we are looking for
We are looking for a Data Engineer that will work on collecting, storing and processing huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then implementing, monitoring, and maintaining them. You will also be responsible for integrating them with the architecture used across the company.
Requirements
1/2+ years of experience
Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed
Researching and testing solutions to ensure that they are fit for use
Deep knowledge in Python and Postgres
AWS infrastructure a + linux/terminal + cloud experience + security
Data warehousing, ETL (possibly some apache spark experience
Stream, message-broker infrastructure (ie rabbit)
GIS knowledge
JS / TS knowledge
Understanding of crawling, web requests / graphql
Strong algorithmic skills
Abilities to handle structured/semi-structured/unstructured data
Testing based workflow
Some knowledge of machine learning
Extra = GO / C
A deep interest in big data technologies
Able to communicate ideas effectively and contribute to discussions
Bonus points
Experience with big data technologies such as Apache Spark, Kafka and big data streaming solutions.
Understanding of GIS
Knowledge of NoSQL databases such as MongoDB, DynamoDB
Contributions to open-source projects
A passion for travel and interest in travel technology
Thrives in self-starting entrepreneurial environment
Looking to be with and grow with the company over both the short and long term