Senior Big Data Engineer

Early Applicant

Exp: 4-7 Years

Job Description

Design and implement large-scale data processing systems and pipelines
Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka
Optimize data storage and retrieval strategies for performance and efficiency
Collaborate with data scientists, analysts, and stakeholders to understand data requirements
Ensure data quality, integrity, and security across big data platforms
Lead efforts in data modeling, schema design, and data warehousing
Perform data extraction, transformation, and loading (ETL) from various data sources
Monitor and troubleshoot data processing jobs to ensure reliability and performance
Mentor junior engineers and provide technical guidance to the team
Stay current with emerging big data technologies and best practices to drive continuous improvement

Requirements

Personal Skills

Strong communication, interpersonal, and presentation skills
Ability to multi-task and work under pressure.
Excellent command of English.
Excellent verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team
Bachelor's degree of Engineering

Technical Skills:

Years of Experience: Min: 4 Max: 7
Big Data Technologies: Expertise in Hadoop, Spark, Kafka, and related ecosystems.
Programming: Proficient in Java, Scala, and Python for data processing and pipeline development.
Data Modeling: Strong skills in designing data models and schema for big data applications.
ETL Processes: Advanced knowledge of ETL (Extract, Transform, Load) techniques and tools.
Database Management: Experience with NoSQL databases like Cassandra, MongoDB, and HBase.
Cloud Platforms: Proficient in using AWS, Azure, or Google Cloud for big data solutions.
Performance Tuning: Ability to optimize data processing systems for performance and scalability.
Data Security: Understanding of data security principles and best practices
Collaboration: Strong teamwork and communication skills for cross-functional collaboration.
Problem-Solving: Excellent analytical and problem-solving abilities to address complex data challenges