Data Engineer
(3+ years exp)€42k – €50k • No equity
Published: 1 week ago
IPlytics
SaaS solution that uses econometric algorithms for an intelligent analysis of public data
Job Location
Job Type
Full TimeVisa Sponsorship
AvailableRelocation
AllowedSkills
Python
Java
Spark
Kubernetes
Airflow
The Role
We’re looking for a Big Data Engineer who can find creative solutions to tough problems. As a Big Data Engineer, you’ll create and manage our data infrastructure and tools, including collecting, storing, processing and analyzing our data and data systems. You know how to work quickly and accurately, using the best solutions to analyze mass data sets, and you know how to get results. You’ll also make this data easily accessible across the company and usable in multiple departments.
What You Will Do:
- Gather and process raw data at scale.
- Design and develop data applications using selected tools and frameworks as required and requested. · Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
- Work closely with the engineering team to integrate your work into our production systems.
- Process unstructured data into a form suitable for analysis.
- Analyze processed data and support business decisions with ad hoc analysis.
- Monitoring data performance and modifying infrastructure as needed.
About You:
- Recent recent experience in data engineering.
- Bachelor’s Degree or more in Computer Science or a related field.
- A solid track record of data management showing your flawless execution and attention to detail.
- Strong knowledge of and experience with statistics.
- Proficient in Java, Python and Spark.
- Ability to optimize/Scale Spark jobs and resolve performance bottlenecks.
- Proven experience with complex, distributed and containerized systems.
- Knowledge / understanding of Airflow, Kubernetes and Docker is a big plus.
- Knowledge / understanding of the Hadoop ecosystem plus some work experience there would be a great plus also.
- Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
- Knowledge of data mining, machine learning, natural language processing, or information retrieval.
- Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
- A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.
- Experience in production support and troubleshooting.
- You find satisfaction in a job well done and thrive on solving head-scratching problems.
What We Offer:
- Open door culture, we progress and learn together and from each other
- No Top-Down-Only approaches, we value your thoughts and ideas and improve by everyone’s input
- Urban Sports Membership options
- A steep learning curve and cross-departmental insight
- A modern workspace within an international tech community office
Interested? Awesome, just send an email to [email protected]. We’re looking forward to hearing from you!
- At IPlytics we embrace diversity and inclusion. We are an equal opportunities employer and believe in our value driven and open minded mindset that promotes a fair and inclusive culture
More about IPlytics
Similar Jobs
Deca Games
Game Ops specialists who breathe new life into older games
Ticombo
The community for selling & buying live event tickets
Technoly
Build software that streamlines and simplifies the travel experience
timum
scheduling provider: appointment booking and automised scheduling
byrd technologies
Your shipping assistant
Construyo
Digital platform in the construction industry - helping to finish projects on time&budget
Blacklane
A global chauffeur service that has all inclusive pricing and ride flexibility
Aignostics
AI-powered precision diagnostics for pathology
NewStore
Combining intuitive iPhone applications with real-time visibility into all your back-end data