Halian | Managed Services, Recruitment Agency & Contract Staffing
Data Engineer (m/f/d)
About the role
Data Engineer
-
12-month extendable contract
-
Abu Dhabi | Office Based
I am seeking an experienced Data Engineer to join a growing data and analytics team responsible for building scalable, secure, and high-performance data platforms. The successful candidate will design, develop, and optimize modern data solutions that support advanced analytics, business intelligence, and machine learning initiatives.
This role requires expertise in large-scale data engineering, cloud technologies, and modern data architectures, with a strong focus on reliability, performance, security, and data governance.
Key Responsibilities
-
Design, develop, and maintain scalable data pipelines and ETL/ELT processes to ingest, transform, and process large-scale datasets.
-
Build and optimize data processing frameworks using technologies such as Spark, Delta Lake, Kafka, and other modern big data platforms.
-
Develop and maintain data models, schemas, data lakes, lakehouses, and data warehouses that support analytics and reporting requirements.
-
Implement data quality, validation, monitoring, and observability frameworks to ensure data accuracy and reliability.
-
Design and support real-time and batch data processing solutions using streaming technologies and distributed systems.
-
Ensure compliance with security, privacy, access control, and regulatory requirements for sensitive data.
-
Collaborate closely with data scientists, analysts, architects, and business stakeholders to deliver high-value data products and services.
-
Manage and enhance distributed data platforms to ensure scalability, availability, and performance.
-
Contribute to data governance, master data management, metadata management, and data catalog initiatives.
-
Stay current with emerging technologies, industry best practices, and innovations in cloud and data engineering.
Required Qualifications
-
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
-
Minimum 5 years of experience designing, building, and operating enterprise-scale data platforms and pipelines.
-
Strong proficiency in SQL and Python.
-
Hands-on experience with Apache Spark, distributed data processing frameworks, workflow orchestration tools, and messaging platforms such as Kafka.
-
Experience with cloud-based data solutions on Azure
-
Strong knowledge of data warehousing, data lakes, lakehouse architectures, and data modeling methodologies.
-
Experience working with containerization and orchestration technologies such as Docker and Kubernetes.
-
Understanding of data governance, data quality, security, and privacy best practices.
-
Strong analytical, problem-solving, and communication skills.
Data Engineer in Abu Dhabi, United Arab Emirates
… more