Data Engineer II
Job Description Roles & Responsibilities What's On Your Plate? Design, build, and maintain data pipelines and workflows for batch and streaming use cases. Work with Kafka to manage real-time data ingestion and event-driven architectures. Leverage GCP and AWS services for storage, processing, and orchestration (e.g., BigQuery, Dataflow, S3, Lambda). Orchestrate workflows using tools like Airflow or similar schedulers. Ensure data quality and reliability through monitoring, alerting, and automated validation. Collaborate with analysts, data scientists, and product teams to understand requirements and deliver data solutions that drive business impact. Optimize for cost and performance across cloud environments. Participate in code reviews, documentation, and knowledge sharing to raise the bar for the team. Our Tech Stack Data Ingestion & Streaming: Apache Kafka, Kafka Connect Cloud Platforms: Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage), AWS (S3, Lambda, Glue) Workflow Orchestration: Apache Airflow Programming Languages: Python, SQL, (bonus: Java/Scala) Infrastructure & DevOps: Terraform, CI/CD pipelines, Docker Monitoring & Observability: Grafana, Prometheus, Cloud-native toolsQualifications Desired Candidate Profile What We re Looking For Experience (1-3 years) in data engineering, software engineering, or a related field. Proficiency in SQL and at least one programming language (Python preferred). Understanding of data modeling, ETL/ELT concepts, and cloud-based data warehouses. Familiarity with streaming platforms (Kafka, Kinesis, or similar). Comfort working in cloud environments (GCP, AWS, or Azure). Strong communication skills, able to explain technical concepts to non-technical audiences. Growth mindset, eager to learn, adapt, and take on new challenges.br> Nice-to-Have (But Not Required and willing to learn) Experience with infrastructure-as-code (Terraform, CloudFormation). Exposure to containerization (Docker, Kubernetes). Knowledge of data governance, security, and compliance best practices. Company Industry InternetE-CommerceDotcom Department / Functional Area IT Software Keywords Data Engineer II Get real-time job updates only on our App
Ready to apply?
You are viewing this role on JobSphere AI. Applications are completed on the original employer / source website.
Apply NowOpens the employer's site in a new tab
- Companytalabat
- LocationDubai, UAE
- CategoryCybersecurity
- SourceNaukrigulf
- Listed6 years ago
Related Cybersecurity jobs
Senior System Engineer
Design, implement, and manage enterprise-grade Windows Server environments, including Active Directory, DNS, DHCP, Group Policy, File Services, and Identity…
Project Manager - Cloud Applications
Manage SaaS application deployment and integration initiatives. Manage cloud application migration, rollout, and adoption projects. Coordinate Microsoft Azure…
Cloud Engineer - Officer
The role will be responsible for managing, maintaining, and enhancing our AWS and OCI environments while ensuring high availability, security, and operational…
IT and Project Manager
ROLE SUMMARY We are looking for an experienced Project Manager to lead the end-to-end delivery of technology and digital projects. You will act as the bridge…