Sr. Data Engineer

Job Brief:

We are looking for a seasoned Data Engineer to join a Spanish software development company with offices in Barcelona.

You will be responsible for designing, developing, and maintaining data infrastructure, ensuring efficient data processing, storage and analysis.

Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, transform, and store large volumes of structured and unstructured data.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical solutions.
• Implement data models, database schemas, and data integration workflows to ensure data consistency, integrity, and quality.
• Optimize data processing and storage techniques to enhance performance and reduce latency.
• Develop and maintain data infrastructure and tools to enable efficient data exploration, analysis, and visualization.
• Identify and address data quality issues, data integration challenges, and data pipeline bottlenecks.
• Monitor data systems for performance, stability, and availability, and proactively troubleshoot and resolve any issues.
• Collaborate with software engineers to integrate data pipelines with production systems and ensure seamless data flow.
• Stay updated with the latest data engineering technologies, tools, and industry trends, and recommend their adoption to enhance data infrastructure and processes.
• Implement data security and privacy measures to protect sensitive data and comply with relevant regulations.
• Collaborate with cross-functional teams to define data governance policies, data standards, and best practices.
• Document data architecture, data flows, and technical specifications to ensure comprehensive understanding and maintainability of data systems.
• Participate in code reviews, provide constructive feedback, and ensure adherence to coding standards and best practices.

Requirements and skills:

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
• Proficiency in at least one of the following programming languages: Python, Java, or Scala.
• Experience with big data technologies such as Apache Hadoop, Spark, or Hive.
• Familiarity with cloud-based data platforms and services, preferably AWS or GCP.
• Understanding of data modeling concepts and data integration techniques.
• Knowledge of ETL tools and frameworks such as Apache Airflow.
• Familiarity with data warehousing concepts and technologies, such as Redshift or Snowflake.
• Experience with version control systems, such as Git.
• Strong problem-solving and analytical skills.
• Excellent teamwork and communication abilities.
• Ability to work effectively in a fast-paced and dynamic environment.

Next steps:

Do you consider yourself the ideal candidate for this role? If so, take the next step and apply now. Our team will take care of the rest.