Data Engineer

About ******

****** is seeking a Data Engineer to join its team in Riyadh, Riyadh Province. This is a full-time position focused on building and maintaining data pipelines and models essential for downstream operations.

Role Overview

The Data Engineer will be responsible for constructing and overseeing the pipelines that transfer data from client operational systems into the data warehouse. This role also involves developing the data models that support subsequent processes. Key activities include data ingestion, processing, and modeling, along with comprehensive documentation. The Data Engineer will also perform analytical tasks to ensure data accuracy.

Key Responsibilities

• Profile new data sources, including databases, APIs, files, and open data (structured and unstructured), before pipeline construction.
• Build, schedule, and monitor data ingestion and processing pipelines using existing client tools, extending them as necessary.
• Design and implement warehouse models, such as star schemas and conformed dimensions, to support dashboards and machine learning applications.
• Implement data quality checks and lineage capture within all pipelines, and maintain current conceptual, logical, and physical model documentation.
• Collaborate with business owners to reconcile figures, define Key Performance Indicators (KPIs), and assist in preparing monthly progress reports.

Required Qualifications and Skills

• Strong proficiency in Python and SQL, with experience in production environments.
• Experience with Spark (Databricks or Hadoop) and BigQuery, demonstrating comfort with both data lake and data warehouse patterns.
• Hands-on experience with at least two of the following tools: Talend, Informatica, NiFi, and Denodo.
• Ability to extract and capture changes from MS SQL Server, Oracle, MySQL, and PostgreSQL.
• Experience ingesting data from APIs, files (SFTP, Excel, CSV), and open data, in both batch and streaming modes.
• Expertise in dimensional modeling, including star schemas, conformed dimensions, and slowly changing dimensions, along with the ability to document models at conceptual, logical, and physical levels.
• Proficiency in orchestration, monitoring, retry mechanisms, data quality checks, and data lineage.
• Experience in profiling, reconciliation, and defining KPIs in collaboration with business users.

Work Type

This is a full-time position.