We are looking for an experienced Senior Data Engineer with deep expertise in Oracle Databases, Apache NiFi, and Tableau, to lead our data engineering initiatives.
The ideal candidate will have a strong background in designing scalable data solutions, optimizing data architectures, and developing robust data pipelines that support advanced analytics and business intelligence reporting. You will play a critical role in leading technical project, mentoring junior engineers, and ensuring our data infrastructure aligns with the strategic objectives of the business.
Responsibilities:
- Design, build and maintain complex data pipelines using Apache NiFi to enable seamless data flow and transformation across multiple systems.
- Oversea the optimization and management of large-scale Oracle Database environments, ensuring high availability, performance, and data integrity.
- Lead efforts to integrate data from diverse sources into centralized repositories, working closely with cross-functional teams to align data strategy with business goals.
- Develop advanced Tableau dashboards and data visualizations that provide actionable insights to stakeholders, driving data-driven decision making.
- Design and implement complex ETL (Extract, Transform, Load) workflows to process, transform, and load data efficiently across various data platforms.
- Implement and enforce data quality checks, validation processes, and data governance best practices to ensure data accuracy, consistency, and security.
- Continuously optimize data pipelines and database queries for speed and scalability and troubleshoot complex data issues as they arise.
- Mentor and provide technical guidance to junior data engineers, fostering a collaborative and innovative team culture.
- Work closely with data scientists, analysts, and business teams to understand their needs and deliver reliable data solutions that support their projects.
- Maintain thorough documentation for all data processes, architectures, and systems, and set engineering standards across the team.
- Perform any other tasks given by the line management or senior management.
- Comply with HR laws, confidentiality policies, and other policies applicable in the DeG.
- Maintain information assets and ensure information security and confidentiality.
Skills:
- Experience with Cloud platforms (AWS, Azure, Google Cloud) for data storage and processing.
- Familiarity with real-time data processing tools such as Kafka or Spark.
- Experience with machine learning workflows and integrating data pipelines with data science teams.
- Certifications with Data Database or Cloud platforms are a plus.
Qualifications & Work Experience:
- Extensive experience (5+ years) as a Data Engineer, with a focus on Oracle Database, Apache NiFi, and Tableau.
- Experience in Oracle Database management, including advanced data modeling, query optimization, partitioning, and performance tuning.
- Proven proficiency in Apache NiFi, with the ability to build and maintain large-scale data flow pipelines and integration workflows.
- Advanced Tableau skills, with a track record of developing sophisticated, interactive data visualizations and dashboards.
- Strong knowledge of ETL processes and best practices for data transformation and integration.
- Proficiency in SQL and scripting languages like Python or Java for data processing.
- Experience in data architecture design, including data warehousing, big data solutions, and clous-based storage systems.
- Solid understanding of data governance, privacy, and security practices.
- Leadership skills, with experience managing and mentoring technical teams.
- Excellent communication skills, with the ability to translate technical concepts for non-technical stakeholders.
