Technical Lead-Azure Databricks

We are looking for an experienced Technical Lead – Azure Databricks to lead the delivery of a modern Azure Databricks data platform.

Responsibilities

• Lead the discovery phase covering source-system profiling, ingestion requirements and delivery planning.
• Own Azure Databricks platform architecture, configuration and technical delivery.
• Design environments, Unity Catalog governance, security, access controls, monitoring and cost controls.
• Lead development of metadata-driven ingestion frameworks and pipelines.
• Manage integration of on-premise SQL Server and Oracle Fusion HCM/Finance data.
• Establish CI/CD using Azure DevOps.
• Oversee semantic-layer development and Databricks Genie Agents.
• Lead two-week Agile sprints and client demonstrations.
• Conduct code/design reviews and knowledge transfer.

Qualifications

• 10+ years in Data Engineering/Data Platform delivery.
• Minimum 4+ years hands-on Azure Databricks.
• Led at least one complete Azure Databricks Lakehouse implementation from design through production.
• Strong PySpark, SQL, Delta Lake and Unity Catalog.
• On-premise database-to-Azure integration experience.
• Azure DevOps CI/CD and Databricks deployment experience.
• Experience leading remote/offshore Agile teams.
• Strong client-facing communication skills.
• Fluent English.
• UAE-based or willing to relocate to Abu Dhabi.

Preferred

• Delta Sharing, Lakeflow Connect/ADF, Genie Agents, Oracle Fusion HCM/Financials and UAE/GCC government experience.