Data Architect (Databricks)

Discover the Responsibilities Design and implement scalable data architectures using the Databricks Lakehouse Platform, supporting both analytical and AI workloads. Build and optimise ETL/ELT pipelines for large volumes of structured and unstructured data, including real-time and batch processing. Partner with AI and Data Science teams to deliver the data capabilities required for production ML, predictive analytics and Generative AI applications. Establish best practices across data modelling, governance, quality, security, lineage and metadata management. Optimise data platform performance, scalability and cost efficiency across cloud environments. Collaborate with engineering and business stakeholders to translate requirements into robust technical solutions and support the integration of AI into enterprise applications. Document architecture standards and contribute to the continuous improvement of the organisation s data platforms and engineering practices.

Desired Candidate Profile

Discover the Requirements 7+ years of experience in Data Engineering, Data Architecture or Enterprise Data Platform roles. Extensive hands-on experience designing and delivering enterprise solutions using Databricks and modern lakehouse architectures. Proven experience supporting the delivery of AI and Machine Learning use cases into production, working closely with Data Science and AI Engineering teams. Strong expertise in Python, SQL and PySpark, with experience building scalable. ETL/ELT pipelines using tools such as Airflow, dbt or similar. Strong understanding of distributed computing, data modelling, big data processing and performance optimisation. Experience with cloud-based data platforms, ideally Azure, and familiarity with MLOps and the data requirements of production AI systems. Experience across data governance, quality, security, lineage and metadata management. Excellent problem-solving and stakeholder management skills, with the ability to communicate technical concepts clearly. Bachelor s degree in Computer Science, Engineering, Information Systems or a related discipline.