Big Data Expert

Early Applicant

Exp: 7-12 Years

Job Description

Design and implement scalable big data architectures to handle large volumes of data
Develop and optimize data processing pipelines using technologies such as Hadoop, Spark, and Kafka
Collaborate with data scientists and analysts to provide data insights and support advanced analytics
Manage and maintain big data platforms, ensuring high availability and performance
Perform data extraction, transformation, and loading (ETL) tasks from various data sources
Implement data security measures to protect sensitive information
Monitor and troubleshoot data processing systems to ensure reliability and efficiency
Evaluate and integrate new big data technologies to enhance data processing capabilities
Provide technical leadership and guidance to the data engineering team
Stay abreast of industry trends and advancements in big data technologies to drive innovation

Requirements

Personal Skills

Technical Skills

Years of Experience Min: 7 Max: 12
Programming Languages: Strong coding skills in Java, Scala, Python, or R.
Data Processing: Expertise in ETL processes and data pipeline development.
Database Management: Knowledge of NoSQL databases like Cassandra, MongoDB, and HBase.
Cloud Platforms: Experience with cloud services such as AWS, Azure, or Google Cloud for big data solutions.
Data Analysis: Advanced analytical and problem-solving skills.
Performance Optimization: Ability to optimize big data architectures for performance and scalability.
Data Security: Understanding of data security practices and tools to safeguard data.
Collaboration: Strong team collaboration skills, working with data scientists, analysts, and other stakeholders.
Continuous Learning: Commitment to staying updated with the latest trends and advancements in big data technologies