Senior Data Engineer (Temporary Project - Must Have Visa)

PLEASE APPLY ONLY IF YOU HAVE A UAE RESIDENT VISA AND NOT CURRENTLY EMPLOYED

We're looking for a Data Engineer for anup to 6 monthsON SITE project in Abu Dhabi. The candidate must havetheir own residency visa.

• Important Skills:

Programming skills: Python and SQL

Strong API developmentfrom scratch

Strong skills inmanaging the data warehouse cloud.

Knowledge with creating / debugging stored procedures,SQL statements,views, triggers, and functions forAzure/MS SQL Server

Experience with Database administration:Azure/MS SQL Server and MS Azure Cloud

Must be well familiar with Visual Studio and Team Foundation ServerGitHub.

Data Modelingexpertise is important: Tools such as Erwin

Strong skills indeploying ML models solutionsin the cloud

Knowledge with with MDM solutions & customer profiling

• Skills considered as a PLUS:

Experience with machine learning algorithms(python, Databricks and/or Azure ML)

• Important Experience:

At least5 yearsof experience with:

ETL development using Talend / Airflow,

developing SQL queries, stored procedures, and views

At least3 yearsof experience with:

developing/coding in Python

database administration

working with any cloud solutions

• Expertise as a PLUS:

At least3 yearsof experience withAzure Databricks or any cloud data warehousesuch as (Snowflake, redshift)

At least 2yearsexperience of Azure DF

Must well understand ETL methodologies, Big Data and Data Warehousing principles, approaches, technologies, and architectures including the concepts, designs, and usage of data warehouses

Works with teams to understand, document, design, develop, code, and test ETL processes. Also, write, implement, and maintain appropriate ETL processes

Demonstrate experience with ETL design and options to improve load and extract performance

Translate source to target mapping documents into ETL processes

Build and integrating APIs

Deploy ML solutions in the cloud

Design, Develop, Test, Optimize and Deploy ETL code and stored procedures to perform all ETL related functions.

Works in Agile environment and utilizes best principles of CI/CD and DevOps

Design Big Data model

Responsible to design, implement and manage ETL processes using Talend and Azure Data Factory and administer and maintain the Azure/MS SQL server Databases and Microsoft Enterprise Data warehouse

Develop Spark Job in Scala or Java

Designs, codes in Python and SQL, orchestrates and monitors jobs in Azure Databricks / Snowflake or any data warehouse cloud

Qualifications:

Bachelor's Degree in Computer Science, Engineering, or a related field

As a PLUS:

Advanced certification in Azure (Azure DF, Azure ML)

Certification in Azure Databricks or any cloud warehouse

Any certification in data science is a big plus.