Did you apply to Data Solutions Architect?
Data Solutions Architect
Job Overview
The role will also architect a Rules Engine for business validations and transformations and establish a comprehensive Data Governance layer covering security, lineage, quality, compliance, and operational readiness.
Responsibilities
- Lead HLD and LLD for the Lakehouse, covering HDFS/Ozone, YARN, Hive 3/Impala, Spark, Kafka/NiFi, Ranger, Atlas, Knox, KMS, and HMS with HA. Define storage and compute topology, cluster sizing, multi-environment architecture, and network zones
- Design perimeter security using Knox and TLS. Establish Bronze, Silver, and Gold standards, including naming, data contracts, partitioning, data quality checkpoints, schema evolution, retention, and recovery patterns
- Align serving models for BI and analytics using Impala and Phoenix
- Design batch pipelines using Informatica BDM, Spark, and Hive
- Design speed and streaming paths using NiFi, Kafka, Hudi, Kudu, HBase, and Phoenix
- Define the convergence and serving of batch and streaming outputs into governed data stores
- Architect a declarative Rules Engine covering validations, standardization, derivations, survivorship, consent/PII handling, and SLA routing
- Ensure rules are metadata-driven, versioned, testable, and CI/CD integrated
- Implement data governance using Ranger and Atlas, including policies, masking, classifications, lineage, and glossary management
- Define data lifecycle, retention, legal holds, PII/PCI/SOX requirements, and audit trails
- Establish CI/CD for infrastructure, schemas, table evolution, rules packs, and ETL deployments
- Build SLA dashboards, alerts, runbooks, and observability processes
- Architect disaster recovery and business continuity using BDR/Replication Manager and replication strategies
- Partner with Domain SMEs, Platform Administrators, Security, and Compliance teams
- Lead Architecture Review Boards and mentor developers and data engineering teams
Desired Candidate Profile
Requirements 10+ years of experience in data architecture/engineering. Bacheloru2019s or Masteru2019s in Computer Science, Engineering, or related field or equivalent experience. 3u20135+ years of experience architecting on Cloudera CDH/CDP in production. Proven experience delivering on-premises Lakehouse environments using Medallion and Lambda architectures. Strong understanding of industry standards and best practices in Data Engineering. Good understanding of Informatica DEI suite for framework/pattern design and pushdown to Spark/Hive. Deep practical exposure to Apache Iceberg, Apache Hudi, Apache Kudu, HBase, Phoenix, Hive 3, and Impala. Strong SQL expertise, including windowing, partitioning, MERGE/UPSERT, and cost-based tuning. Strong Impala/Phoenix performance tuning experience. Experience with Kerberos, TLS, AD/LDAP, Ranger policies, Atlas lineage/glossary, and SDX concepts. Experience designing metadata-driven Rules Engines and data quality frameworks for both batch and streaming environments. Solid Linux fundamentals. Experience with Git and CI/CD. Strong documentation and stakeholder communication skills. Experience with Kafka patterns and CDC from RDBMS is preferred. Familiarity with Ozone, KMS/Key Trustee, and air-gapped deployments is preferred. SRE experience, including SLOs, error budgets, RCA, and disaster recovery exercises, is preferred. Cloudera CDP, Informatica, and Security certifications are a plus. Regulatory experience in PII/PCI/SOX/GDPR environments is preferred.
Ready to apply?
You are viewing this role on JobSphere AI. Continue on naukrigulf.com to apply.
Opens the original job posting in a new tab
Saved on this device. Log in to keep your saved jobs on all your devices.
Log in Create account- CompanyClient of Ethra Hr
- LocationRiyadh, Saudi Arabia
- CategorySales
- Listing sourceNaukrigulf
- Apply onnaukrigulf.com
- Listed2 months ago