Data Engineer – Cloud Pipelines & QA

About the role

As a Data Engineer at Gaming1, you will design, build and optimise end‑to‑end data pipelines and data products that support the company’s growth. You will ensure data quality, reliability and scalability while working closely with the existing data engineering team.

Key responsibilities

• Implement capability‑focused data quality tests (completeness, thresholds, referential checks) and technical validation tests.
• Collaborate with domain‑specific Data Engineers and stakeholders, document solutions (readme.md, Confluence) and conduct knowledge‑transfer sessions.
• Optimise jobs, define data contracts and identify schema or pipeline improvements to reduce compute costs and improve maintainability.
• Investigate and resolve failed loads or QA breaches quickly, coordinating fixes with relevant teams.
• Design, build and maintain cloud‑based data pipelines and data products.

Required profile

• 3+ years of experience building cloud data pipelines.
• Strong command of SQL, Python and PySpark.
• Hands‑on experience with Airflow or a similar scheduler.
• Proven ability to implement idempotent or merge‑based ingestion patterns.
• Familiarity with automated data testing frameworks such as Great Expectations or Soda tests.
• Excellent documentation and collaboration skills.

Required skills

• SQL
• Python
• PySpark
• Airflow
• Great Expectations
• Soda tests