OVERALL JOB PURPOSE
- The Senior Specialist Data Engineering will be responsible to design, build, and maintain scalable data pipelines and architectures. This role requires a deep understanding of data processing, data warehousing, and big data technologies as well as the ability to effectively analyze and interpret large datasets to drive strategic business decisions.
KEY ACCOUNTABILITIES
- Architect, design, and implement scalable and efficient data pipelines to process large volumes of data from various sources.
- Ensure data pipelines are robust, fault-tolerant, and optimized for performance.
- Develop and maintain data models and schemas to support business requirements.
- Design and implement data storage solutions, including data lakes, data warehouses, and databases.
- Choose appropriate database systems, optimize data schemas, and ensure data quality and integrity
- Implement best practices for data processing, storage, and retrieval to ensure high performance and low latency.
- Design ETL pipelines to transform raw data into a format suitable for analysis.
- Ensure compliance with data governance policies and data security standards.
- Continuously evaluate and improve existing data infrastructure and processes.
- Develop and maintain data models and schemas to support business requirements.
QUALIFICATIONS, EXPERIENCE & SKILLS:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- At least 6 years of experience in data engineering or a related role.
- Strong proficiency in programming languages such as Python, Java etc.,
- Extensive experience with big data technologies (e.g., Hadoop, Spark, Kafka).
- Proficiency in SQL and experience with relational and NoSQL databases.
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and cloud-based data solutions.
- Strong understanding of data warehousing concepts and ETL processes
