Projet details:
Responsibilities
Design and implement scalable data pipelines within Databricks
Structure and ingest HR data from multiple Prosus portfolio companies
Implement Medallion Architecture (Bronze / Silver / Gold layers) to ensure scalable and governed data flows
Build and maintain pipelines using Python and PySpark
Translate business data requirements into scalable data engineering solutions
Collaborate with stakeholders across the group to define data structures, ingestion patterns, and data standards
Ensure data pipelines support analytics, reporting, and AI use cases

Requirements
5+ years of experience in Data Engineering or Data Platform development
Strong hands-on experience with Databricks, Spark, and distributed data processing
Advanced Python and PySpark programming skills
Experience designing enterprise-scale data pipelines
Experience implementing modern data lake architectures
Familiarity with data governance, quality controls, and scalable ingestion frameworks
Ability to collaborate with technical and business stakeholders across multiple teams
Experience working in cloud-based data environments