Data Engineer
Job Description Roles & Responsibilities We are seeking an experienced Data Engineer to design, build, and operate scalable, secure, and reliable data pipelines and platforms that power analytics and AI solutions for companies in the UAE. The role is hands-on and client-facing, owning data solutions end-to-end from architecture and development to production and hypercare on cloud and on-premise. Key Responsibilities Design, build, and maintain scalable batch and streaming data pipelines (ETL/ELT) that move data reliably from source systems to analytics and AI workloads. Build and optimize data models, databases, data warehouses, and lakehouse architectures (e.g., Databricks, Microsoft SQL Server) for performance and cost. Develop and tune distributed processing jobs using Spark/PySpark, including cluster management and optimization. Ensure data quality and data governance across the full data lifecycle (collection, access, storage, transformation, retention). Productionize pipelines with CI/CD, orchestration (e.g., Airflow, Azure Data Factory), monitoring, and alerting. Build the data foundation for analytics and AI use cases, collaborating closely with Data Scientists and AI Engineers (e.g., feature engineering, RAG data processing). Translate client business requirements into data architecture decisions and communicate trade-offs to technical and non-technical stakeholders. Maintain technical documentation, data lineage, and delivery artifacts across Design, Build, UAT, Production & Hypercare. Desired Candidate Profile Candidate Requirements Demonstrated experience delivering AI solutions in an enterprise or client-facing/consulting environment. Prior experience at management consulting firms and/or Big Tech is an advantage. Strong programming in Python and SQL with solid software engineering fundamentals. Hands-on experience with Spark/PySpark and big-data processing at scale. Proven experience building production ETL/ELT pipelines. Practical knowledge of a major cloud data stack Azure, AWS, or GCP. Experience with a modern data platform (Databricks, Snowflake, or equivalent). Familiarity with orchestration, CI/CD, and DevOps (e.g., Airflow, Git, Docker). Understanding of data warehousing concepts, data modeling, data governance, and security best practices. Experience with dashboard or frontend engineering is a plus. Strong collaboration and communication skills, with the ability to work directly with clients. Qualifications Bachelor's or Master s degree in Computer Science, Engineering, Information Technology, or a related field. 3 6 years of experience in data engineering, building and operating data pipelines at scale. Preferred certifications: cloud data certifications such as Azure Data Engineer, AWS Data Engineer, or Databricks Data Engineer. Company Industry ConsultingManagement ConsultingAdvisory Services Department / Functional Area IT Software Keywords Data Engineer Get real-time job updates only on our App
Ready to apply?
You are viewing this role on JobSphere AI. Applications are completed on the original employer / source website.
Apply on original siteOpens the employer's site in a new tab
- CompanyContango
- LocationMuscat - Oman
- CategoryCybersecurity
- SourceNaukrigulf
- Listed5 days ago
Related Cybersecurity jobs
SOC Engineer
Security Monitoring & Threat Detection • Administration, management, and Support deployment and tuning of OT security tools (Nozomi, Forescout). Monitor OT/ICS…
Priority Banking - Customer Service Representative
1. Client Relationship Management ▸ Resolve customer issues efficiently while ensuring first-contact resolution whenever possible. ▸ Manage customer complaints…
Secretary
Manage executive schedules, ensuring optimal time allocation for meetings, deadlines, and travel, to facilitate smooth operations. Prepare and edit…
Senior Full Stack Developer
We are seeking an experienced Full Stack Engineer with strong Java expertise and modern front-end capabilities to design, build and deliver scalable enterprise…