Job Purpose
Design, implement, and maintain robust data solutions that support our business objectives and enhance our data-driven decision-making capabilities.
Key Accountabilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other relevant tools.
- Implement and manage data warehousing solutions on Azure Synapse Analytics.
- Build sophisticated dashboards using Microsoft Power BI
- Ensure data quality and integrity by performing data validation, cleansing, and transformation.
- Optimize database performance and manage MSSQL databases, including tasks such as indexing, query optimization, and performance tuning.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs.
- Develop and implement data governance and security measures to ensure compliance with industry standards and regulations.
- Monitor and troubleshoot data pipeline and database issues to ensure seamless data flow and system reliability.
- Stay current with industry trends and best practices in data engineering & cloud technologies and apply this knowledge to continuously improve our data infrastructure.
- Document requirements and design, technical specifications including workflows, integrations, and configurations.
- Continually update technical knowledge and skills by attending courses, reading manuals, exploring new applications, studying state-of-the-art data engineering tools, reading professional publications and participating in professional networks.
- Work closely with other business users, software engineers and provide help when needed.
- Provide timely and professional responses to other Enovians.
- Ensure the proper understanding and adoption of the work-related processes, policies and procedures.
- Perform other related duties or assignments as directed.
Qualifications, Experiences, & Skills
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Minimum of 5 years of experience in data engineering, with a strong focus on Azure cloud technologies.
- Proficiency in Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and other Azure data services.
- Strong experience with Microsoft Power BI.
- Strong experience with MSSQL, including database design, performance tuning, and optimization.
- Knowledge with Google Big Query is an advantage.
- Hands-on experience with data modeling, ETL processes, and data warehousing concepts.
- Proficient in programming languages such as SQL, Python.
- Knowledge of data governance, security, and compliance best practices.
- Excellent problem-solving skills and the ability to work independently as well as part of a team.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
