Senior Data Engineer
- 12 month extendable contract
- Abu Dhabi | Office Based
I am seeking an experienced Senior Data Engineer to join a growing data and analytics team responsible for building scalable, secure, and high-performance data platforms. The successful candidate will design, develop, and optimize modern data solutions that support advanced analytics, business intelligence, and machine learning initiatives.
This role requires expertise in large-scale data engineering, cloud technologies, and modern data architectures, with a strong focus on reliability, performance, security, and data governance.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes to ingest, transform, and process large-scale datasets.
- Build and optimize data processing frameworks using technologies such as Spark, Delta Lake, Kafka, and other modern big data platforms.
- Develop and maintain data models, schemas, data lakes, lakehouses, and data warehouses that support analytics and reporting requirements.
- Implement data quality, validation, monitoring, and observability frameworks to ensure data accuracy and reliability.
- Design and support real-time and batch data processing solutions using streaming technologies and distributed systems.
- Ensure compliance with security, privacy, access control, and regulatory requirements for sensitive data.
- Collaborate closely with data scientists, analysts, architects, and business stakeholders to deliver high-value data products and services.
- Manage and enhance distributed data platforms to ensure scalability, availability, and performance.
- Contribute to data governance, master data management, metadata management, and data catalog initiatives.
- Stay current with emerging technologies, industry best practices, and innovations in cloud and data engineering.
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Minimum 5 years of experience designing, building, and operating enterprise-scale data platforms and pipelines.
- Strong proficiency in SQL and Python.
- Hands-on experience with Apache Spark, distributed data processing frameworks, workflow orchestration tools, and messaging platforms such as Kafka.
- Experience with cloud-based data solutions on Azure, AWS, or Google Cloud Platform.
- Strong knowledge of data warehousing, data lakes, lakehouse architectures, and data modeling methodologies.
- Experience working with containerization and orchestration technologies such as Docker and Kubernetes.
- Understanding of data governance, data quality, security, and privacy best practices.
- Strong analytical, problem-solving, and communication skills.
#LI-MW1