production environments  Key Responsibilities You will define, design, and develop services for large-scale data ingestion, storage, and management across relational databases, NoSQL systems, log files, and event streams. You will design, build, and operate robust batch and streaming data pipelines in production environments, ensuring scalability, performance, and reliability. The role involves developing highly concurrent, low-latency systems and working extensively with structured and unstructured datasets. You will design and implement workflows and pipelines using tools such as Apache NiFi, Kafka, Spark, Flink, and Airflow, supporting both batch and real-time processing use cases. You will collaborate with internal product teams and third-party service providers to enable integrations and continuously improve data platforms. You will participate in sprint planning and delivery activities, ensuring solutions are deployable, observable, and operationally manageable in live environments. Education, Experience & Required Skills Educational Qualification
Bachelor’s degree in Computer Science, Software Engineering, or a related field is preferred. Experience
Minimum 3–5 years of professional experience as a Data Engineer or Big Data Engineer. Essential Skills
Strong experience designing and operating data pipelines using Apache NiFi, Kafka, Spark, Flink, and Airflow. Solid understanding of distributed data architectures, data modeling, OLAP design, and change data capture (CDC) using tools such as Debezium. Experience working with large-scale storage and messaging platforms including MinIO/S3 and Kafka. Proficiency in handling batch and real-time data processing, familiarity with data formats such as Avro, Parquet, and ORC, and strong scripting or programming capabilities. Experience working in Agile environments with version control systems such as Git. Desirable Skills
Experience delivering enterprise-scale analytics and reporting platforms, strong understanding of infrastructure and container-based deployments, and the ability to advise on emerging data technologies and best practices.

Copilot said:

Data Engineer

Location: Abu Dhabi, UAE
Employment Type: Full-Time

About the Role

We are seeking a talented Data Engineer to join a high-performing technology team focused on building and operating modern data platforms. This position offers the opportunity to work on large-scale data ecosystems that power analytics, reporting, AI, and business-critical decision-making.

You will play a key role in designing, developing, and maintaining scalable data pipelines and platforms that process both batch and real-time data. Working closely with engineering, product, and analytics teams, you will help deliver robust, high-performance data solutions across enterprise environments.

Key Responsibilities

• Design, develop, and maintain scalable data platforms supporting large-scale data ingestion, storage, and processing.
• Build and operate robust batch and real-time data pipelines across production environments.
• Develop solutions for processing structured and unstructured datasets from a variety of sources.
• Design and implement data workflows using technologies such as Apache NiFi, Kafka, Spark, Flink, and Airflow.
• Develop highly concurrent, scalable, and low-latency data processing systems.
• Ensure data platforms are reliable, secure, observable, and operationally efficient.
• Work with relational databases, NoSQL databases, event streams, log-based systems, and cloud storage platforms.
• Collaborate with product, engineering, and analytics stakeholders to deliver business-critical data solutions.
• Support integrations with third-party platforms and services.
• Participate in Agile ceremonies, sprint planning, and delivery activities.
• Drive continuous improvement across data architecture, engineering practices, and platform performance.

Required Skills & Experience

• 3-5 years of experience in a Data Engineering, Big Data Engineering, or similar role.
• Strong hands-on experience with:
  • Apache Kafka
  • Apache Spark
  • Apache Flink
  • Apache NiFi
  • Apache Airflow
• Experience designing and operating enterprise-scale data pipelines and distributed data architectures.
• Strong understanding of data modelling, data warehousing, OLAP concepts, and large-scale data processing.
• Experience implementing Change Data Capture (CDC) solutions using technologies such as Debezium.
• Experience with object storage platforms such as MinIO or Amazon S3.
• Strong knowledge of both batch and streaming data processing.
• Familiarity with data formats including Avro, Parquet, and ORC.
• Strong programming and scripting skills.
• Experience working with Git and modern software development practices.
• Excellent problem-solving and analytical skills.
• Strong communication skills and the ability to work effectively within cross-functional teams.

Desirable Skills

• Experience delivering enterprise-scale analytics, reporting, and business intelligence platforms.
• Exposure to cloud-native architectures and modern data platforms.
• Knowledge of containerisation technologies such as Docker and Kubernetes.
• Understanding of infrastructure and platform engineering concepts.
• Experience supporting AI and machine learning data workloads.
• Ability to evaluate emerging technologies and recommend best practices for data platform evolution.