Job Description
Work Location: Cairo,Egypt.
As a Data Engineering Supervisor , you will play a crucial role in designing, implementing, and maintaining our organization's data infrastructure. The role will contribute to the efficient storage, retrieval, and analysis of data, enabling informed decision-making across our organization.
Key Accountabilities
Gather and analyze data from multiple sources to generate actionable insights and recommendations.
Collaborate with cross-functional teams to understand data requirements to design efficient data warehouse solutions
Develop and maintain a robust data warehouse architecture that ensures scalability, performance, and data integrity
Develop and maintain Data Warehouse modeling using ETL, Including Azure Data Factory, Azure Synapse, Azure Data Fabric, Azure Purview
Work closely with business stakeholders to understand requirements and translate them into technical solutions.
Data Quality Assurance - ensure data accuracy, consistency, and integrity throughout all processes, and implement data governance best practices.
Monitor and tune the data warehouse performance to ensure optimal query execution and data retrieval times
Identify and resolve bottlenecks in the ETL pipelines and data warehouse infrastructure
Develop and maintain data models, including dimensional and star schemas, to support efficient querying and reporting
Collaborate with reporting and analytics teams to understand requirements and translate them into effective data structures
Implement security measures to protect sensitive data within the data warehouse
Work closely with developers, analysts, and other stakeholders to understand their data needs and provide necessary support
Document data warehouse processes, data dictionaries, and ETL workflows for knowledge sharing and future reference
Design, implement, and document data architecture and data modeling solutions
Participate with Data Analyst(s) as needed to define minimal viable data assets in support of the visual needs.
Review and provide architectural guidance for analytic solutions
Triage and troubleshoot data anomalies submitted by the user community
Ensure data accuracy, integrity, and consistency by implementing data quality controls and best practices.
Stay current with cloud technologies and best practices to continuously improve data engineering capabilities.
Participate in projects related to data governance, data warehousing, and data integration.
Apply CICD automation over the data pipelines implementations.
Knowledge, Skills, and Experience
We are Looking for:
Bachelor's degree in Computer Science, Information Systems, Statistics, or related field.
3 years of experience in data engineering, or related role.
Proficiency in Python and SQL, Spark, Kafka, CDC, Batch and streaming analytics.
Experience with Microsoft ecosystems such SQL Server Management Studio, Visual Studio, SQL Server Reporting Services.
Experience with data engineering workflow tools eg. DBT, Airflow.
Experience with DWH and ETL tools Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Data Fabric, Azure Purview. And Data Lakhouse
Strong analytical and problem-solving skills, with the ability to translate complex data into actionable insights.
Excellent communication and presentation skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.
Ability to work independently and collaboratively in a fast-paced environment.
Experience Data Management Concepts and technologies.
Knowledge of DevOps, CICD, Git concepts and technologies.
Knowledge of Agile, Scrum, Jira concepts and methodologies
Desired Candidate Profile
Education:
Bachelor of Technology/Engineering
Gender:
nm
Nationality:
Any Nationality