Azure Data Engineer

The Azure Data Engineer is responsible for designing, implementing, and managing robust data solutions to meet business needs. This includes overseeing data pipelines, Azure data platform services, and delivering actionable insights through Power BI dashboards and reports. The specialist will play a critical role in transforming raw data into valuable insights, ensuring data accuracy, and supporting business intelligence initiatives across the organization. Azure Data Platform Management: Design, implement, and manage Azure SQL databases, Azure Data Lake Storage, and related Azure & Fabric services. ETL Processes and Data Pipelines: Create, monitor, and optimize ETL (Extract, Transform, Load) workflows to integrate data from multiple sources into centralized systems, ensuring reliability and performance. SQL and Python Development: Utilize SQL for querying, analysing, and managing relational databases, and develop Python scripts to automate data processes, integrate data sources, and support advanced analytics. Big Data and Advanced Analytics: Leverage Azure Databricks for big data processing, analytics, and machine learning workflows, and utilize tools like Apache Spark and Hadoop for processing large datasets. Data Warehousing: Develop and maintain enterprise data warehouses to support analytics and reporting needs while ensuring seamless integration with visualization tools. Data Security and Compliance: Implement robust data security measures to protect sensitive data, maintain compliance with organizational and regulatory standards, and support disaster recovery processes. Collaboration and Documentation: Collaborate with cross-functional teams to gather requirements and deliver data solutions while maintaining detailed documentation of data architectures, ETL processes, and Power BI standards. AI Enablement: Design, implement and Manage data solutions for the AI needs. IT Policies and IT Processes impacted/addressed by this position: Database Management Process: Adherence to data governance processes and policies to ensure data accuracy and security. Data Security Policy: Ensuring compliance with data protection and security guidelines. Change Management Policy: Following procedures for managing changes in technology and processes. Business Continuity Policy: Supporting business continuity planning and disaster recovery processes. IT Incident Management: Participating in the resolution of IT incidents related to data solutions.

Desired Candidate Profile

Bachelor s degree in Computer Science, Information Technology, Business Administration, or a related field. Advanced certifications in Azure Data Engineering, SQL, or Microsoft Power BI are preferred.