Databricks Data Engineer

About the role

Devoteam, a consulting firm focused on digital transformation, is looking for a Databricks Data Engineer to join its expanding Data & AI team, which is a Databricks partner (50 FTE). You will design, build and maintain data solutions on the Databricks platform, working with clients across different industries and collaborating with internal teams and client stakeholders.

Key responsibilities

• Design, develop and deploy scalable data pipelines using Databricks, extracting data from databases, APIs and streaming platforms, transforming and cleansing it with Spark, and loading it into data lakes and data warehouses.
• Optimise pipeline performance for efficiency and cost-effectiveness.
• Use Databricks SQL, Delta Lake, Databricks Runtime and Databricks Workflows to orchestrate complex data workflows and ensure data quality.
• Integrate Databricks with cloud services such as Azure Data Lake Storage, AWS S3 and Google Cloud Storage.
• Contribute to data models and architectures for data lakes and data warehouses, and implement data quality checks and validation procedures.
• Adhere to data governance policies and work with data scientists, analysts and business stakeholders on their data needs.

Required profile

• University degree in Computer Science, (Business) Engineering or a master's in Machine Learning or AI.
• 3+ years of experience as a Data Engineer with proven expertise in Databricks.
• Fluent English; Dutch or French is mandatory.
• Bonus points: machine learning or AI experience, DevOps knowledge, open-source contributions, data visualisation tools (Tableau, Power BI).

Required skills

• Hands-on experience with at least one cloud platform (Azure, AWS or GCP).
• Strong Python or Scala, with PySpark and Spark SQL.
• Advanced SQL, data warehousing, ETL and data modelling.

What we offer

• A fast-growing, entrepreneurial environment with a collaborative and diverse culture.
• Cloud, Data & AI projects for industry-leading clients.
• Healthy work-life balance in an eco-friendly workplace.
• Competitive compensation package.