Senior Python Data Engineer (Azure)

Бенгалуру

Ако сте получили информация за тази свободна позиция от нашите рекрутери, прочетете нашата Политика за поверителност на личните данни.

Client

Our client is a leading global investment management firm.

Position overview

We are seeking a Senior Python Data Engineer (Azure) with 10+ years of experience to join our team. In this role, you will be responsible for designing and implementing ETL/ELT pipelines for investment data in a hybrid cloud environment. The position involves building Microsoft Fabric pipelines and working with Azure data services to support analytics and business intelligence initiatives for a leading investment management company.

Technology stack

Lambda, Glue, Step Functions, RDS (Aurora), Secrets Manager, CloudFormation, DynamoDB, S3, ECS, SQS
Additional: Snowflake, Jenkins, Docker

Responsibilities

Develop, deploy, and maintain data pipelines using Azure Data Factory, Microsoft Fabric, and other Azure data services
Design, implement, and optimize SQL queries and stored procedures to ensure high performance and data accuracy
Write efficient, scalable Python (or Java) code for data processing, transformation, and analysis
Build and maintain Spark and PySpark workflows for distributed, large-scale data processing
Organize and manage ETL/ELT processes for structured and semi‑structured data
Collaborate with data engineers, data scientists, and business stakeholders to define data requirements and design data models
Implement data warehousing solutions and dimensional data models
Ensure data governance, metadata management, and security best practices
Manage access controls using Azure Security services and Azure Portal
Monitor, troubleshoot, and optimize data infrastructure performance
Work with relational and non-relational databases, including MS SQL, PostgreSQL, and Redshift
Support reporting and visualization needs using Power BI
Recommend and implement improvements based on evolving cloud and data engineering technologies

Requirements

Strong SQL skills (expert-level preferred)
Practical experience with ETL and ELT processes
Strong hands-on experience with Python (Java is acceptable)
Experience with Azure data services, especially Azure Data Factory or Microsoft Fabric
Practical experience with Spark (preferably PySpark)
Knowledge of data warehousing concepts
Knowledge of data governance and data management
Practical development experience in cloud environments

Nice to have

Hands-on experience with MS SQL
Experience with PostgreSQL
Experience with Amazon Redshift
Experience with Microsoft Fabric
Experience with AWS
Experience with Informatica or Pentaho
Experience with metadata management
Experience with Java or Scala
Experience with Power BI

Търсите сходни възможности?

Try AI chatbots with our ready-made prompt to discover similar roles that match your skills and interests.

Най-търсени позиции

1 of 1

Senior Data Designer

БългарияКипърЛатвияПолшаРумънияСърбияУкрайна

Accountable for creating high-quality Enterprise Data Warehouse data designs by understanding and documenting data sources, ingestion methods, mappings, modeling, and defining required data harmonization, calculations, derivations, and transformation logic

Python Data Engineer (Azure), Investment Management

САЩ

We are seeking a Python Data Engineer (Azure) to join our team. In this role, you will be responsible for creating Microsoft Fabric pipelines and organizing ETL/ELT processes supporting a leading investment management company

Data Quality Engineer, Data Reliability Platform

GeorgiaАрменияБългарияКипърЛатвияПолшаРумънияСърбия

The project includes implementing monitoring rules, building automated validation workflows, and supporting data teams with insights that help maintain data quality at scale

Senior Data Engineer

САЩ

We are looking for an experienced Senior Data Engineer to design, build, and maintain scalable data solutions in the Azure cloud.