- Home
- Jobs
- Client of Discovered MENA
- Data Architect (Databricks)
Data Architect (Databricks)
Job Description Roles & Responsibilities Discover the Responsibilities Design and implement scalable data architectures using the Databricks Lakehouse Platform, supporting both analytical and AI workloads. Build and optimise ETL/ELT pipelines for large volumes of structured and unstructured data, including real-time and batch processing. Partner with AI and Data Science teams to deliver the data capabilities required for production ML, predictive analytics and Generative AI applications. Establish best practices across data modelling, governance, quality, security, lineage and metadata management. Optimise data platform performance, scalability and cost efficiency across cloud environments. Collaborate with engineering and business stakeholders to translate requirements into robust technical solutions and support the integration of AI into enterprise applications. Document architecture standards and contribute to the continuous improvement of the organisation s data platforms and engineering practices. Desired Candidate Profile Discover the Requirements 7+ years of experience in Data Engineering, Data Architecture or Enterprise Data Platform roles. Extensive hands-on experience designing and delivering enterprise solutions using Databricks and modern lakehouse architectures. Proven experience supporting the delivery of AI and Machine Learning use cases into production, working closely with Data Science and AI Engineering teams. Strong expertise in Python, SQL and PySpark, with experience building scalable. ETL/ELT pipelines using tools such as Airflow, dbt or similar. Strong understanding of distributed computing, data modelling, big data processing and performance optimisation. Experience with cloud-based data platforms, ideally Azure, and familiarity with MLOps and the data requirements of production AI systems. Experience across data governance, quality, security, lineage and metadata management. Excellent problem-solving and stakeholder management skills, with the ability to communicate technical concepts clearly. Bachelor s degree in Computer Science, Engineering, Information Systems or a related discipline. Company Industry IT - Software Services Department / Functional Area IT Software Keywords Data Architect (Databricks) Get real-time job updates only on our App
Ready to apply?
You are viewing this role on JobSphere AI. Applications are completed on the original employer / source website.
Apply NowOpens the employer's site in a new tab
- CompanyClient of Discovered MENA
- LocationAbu Dhabi, UAE
- CategoryAI
- SourceNaukrigulf
- Listed1h ago
Related AI jobs
Manager – University Placements & Partnerships
Build, develop, and maintain relationships with universities, colleges, and higher education institutions locally and internationally. Facilitate student…
Data Architect
Position: Data & AI Architect Location: KSA (Onsite) Duration: 1 Year Preferred Languages: English; Arabic is a plus Responsibilities Design enterprise data…
AI Engineer
1. Bachelor's degree in Artificial Intelligence, Computer Science or equivalent. 2. At least 3 years of experience in developing generative intelligence…
Data Analyst Shipping Operation Region IME
Led by Rodolphe Saad , the CMA CGM Group, a global leader in shipping and logistics, serves more than 420 ports around the world on five continents. With its…