Data Engineer – Azure / Databricks / Delta Lake Experience: 4+ year's experience
6-month extendable contract
Abu Dhabi - Office based
Role Overview:
We are seeking a skilled Data Engineer with strong expertise in Azure-based data platforms, including Databricks and Delta Lake. The ideal candidate will be responsible for building, validating, and maintaining scalable data pipelines while ensuring high data quality and reliability across the data lifecycle.
Key Responsibilities:
Develop, validate, and optimize ETL/ELT pipelines using Azure Databricks, Delta Lake, and Azure Data Factory (ADF)
Perform data profiling, cleansing, and reconciliation between source and target systems
Identify and resolve data issues such as duplicates, null values, schema mismatches, and incremental load failures
Ensure data consistency and integrity across Bronze, Silver, and Gold layers in a Lakehouse architectur
Design and implement automated data quality checks, validation frameworks, and monitoring solution
Troubleshoot data pipeline issues and support defect resolution in collaboration with cross-functional team
Work closely with Data Engineers, BI developers, and business stakeholders to ensure accurate data deliver
Maintain data governance standards, documentation, and best practices
Required Skills:
Strong proficiency in SQL and data analysis
Hands-on experience with Azure Databricks and Delta Lake
Experience with Azure Data Factory (ADF) for pipeline orchestration
Knowledge of incremental data load strategies (CDC, watermarking, SCD)
Experience in data profiling, validation, and reconciliation techniques
Understanding of data governance and data quality frameworks collaborative environment
#LI-MW1
Data Engineer in Abu Dhabi, United Arab Emirates
Êtes-vous prêt pour demain?
Inscrivez-vous en ligne - cela ne prend que 10 minutes.
