Job Summary: We are seeking a highly skilled Data Architect to join our team. The ideal candidate will be responsible for defining, setting up, developing, and managing data platforms, primarily leveraging the Azure. This role will involve designing and implementing scalable and secure data architectures, optimizing data storage and processing, and ensuring data availability and quality across the organization.
Key Responsibilities:
Data Platform Architecture and Design:
- Define and design data architecture solutions to meet the business needs of the organization.
- Develop and manage scalable and secure data platforms using Azure technologies such as Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Event Hubs, Power BI, Azure Fabric
- Establish data governance and best practices for data management and architecture.
- Collaborate with stakeholders to understand technical and business requirements and translate them into High Level Designs, Low Level Designs, and Technical Requirement Specifications related documentations.
- Suggest and brainstorm with client and internal teams on various data platforms designs like Data warehouse, data lakes, data lake house, data mesh and data fabrics etc.
- Coordinate with client infrastructure team to size the infrastructure requirements and support setting up the infrastructure for Data Platforms.
Data Integration and Management:
- Develop data integration solutions to consolidate data from various sources into a centralized data platform.
- Design and implement ETL/ELT processes using Azure Data Factory and Azure Databricks.
- Ensure data quality, consistency, and security across all data platforms.
- Lead and Guide team of Data Engineers, BI Engineers to implement end to end Data Platforms.
Performance Optimization and Monitoring:
- Optimize data storage and retrieval processes for performance and scalability.
- Monitor and troubleshoot data platform issues to ensure high availability and reliability.
- Implement data monitoring and alerting solutions using Azure Monitor, Log Analytics, and other relevant tools.
Data Analytics and Reporting:
- Work closely with business intelligence and analytics teams to provide robust data solutions that support reporting and analytics needs.
- Design and implement data models in Azure Synapse Analytics and Power BI.
- Enable self-service data access and visualization capabilities for business users.
Collaboration and Leadership:
- Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to deliver end-to-end data solutions.
- Provide technical guidance and mentorship to junior team members.
- Stay current with industry trends and advancements in data architecture and Azure technologies.
Azure Fabric Add-On Skills:
- Experience with Azure Fabric services for developing and deploying microservices and distributed systems.
- Integrate Azure Fabric capabilities into the overall data architecture to enhance scalability and resilience.
Required Qualifications
- Degree in computer science, Information Technology, or a related field.
- 10+ years of experience in data architecture, data engineering, or related roles.
- Strong expertise in designing solutions using Azure data services, including Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Event Hubs, and Power BI.
- Proficiency in SQL, Python, and other programming languages relevant to data engineering.
- Experience with data modelling, data warehousing, and data lakes.
- Knowledge of data governance, data security, and compliance standards.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Experience with Azure Fabric and microservices architecture is a plus.
Preferred Certifications:
