The Role
This role is part of Vezeeta technology team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. You will collaborate with cross-functional teams to ensure the availability, reliability, and performance of our data systems. Your expertise in data engineering and your ability to work with large, complex datasets will be instrumental in driving data-driven decision-making across the organization.
- Design and develop robust and scalable data pipelines, ensuring the efficient extraction, transformation, and loading (ETL) of data from various sources into data warehouses or data lakes.
- Collaborate with data analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
- Implement data models and database schemas that optimize data storage and retrieval.
- Monitor and optimize the performance of data systems, identifying and resolving bottlenecks and ensuring data quality and integrity.
- Evaluate and implement new technologies and tools to improve data engineering processes and enhance the overall data infrastructure.
- Collaborate with DevOps and infrastructure teams to ensure the availability, scalability, and security of data platforms.
- Stay updated with the latest advancements in data engineering and industry best practices, proactively identifying opportunities to enhance data processes and systems.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems or a related field.
- Proven experience as a Data Engineer, with at least 3 years of experience in designing and implementing large-scale data solutions.
- Strong programming skills in languages such as Python, Java, or Scala, with expertise in SQL, relational and non-relational databases.
- Extensive experience with data modeling, database design, and performance optimization techniques.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with AWS or similar cloud providers: S3, MSK, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming.
- Solid understanding of data warehousing concepts and ETL processes.
- Familiarity with data governance, data security, and compliance requirements.
- Strong problem-solving skills and ability to work in a fast-paced, dynamic environment.
- Excellent communication and collaboration skills, with the ability to effectively present complex technical concepts to non-technical stakeholders.
