You are opening our Polish language website. You can keep reading or switch to other languages.

Senior Python Data Engineer (Azure)

  • Bengaluru
Gorąca ofertaŚredni zespół (10-20 osób)

Jeśli otrzymałeś tę ofertę pracy od naszych rekruterów, zapoznaj się z naszą Polityką prywatności.

Client

Our client is a leading global investment management firm.

Dołącz do świetnej firmy, a nie tylko do indywidualnego projektu

Position overview

We are seeking a Senior Python Data Engineer (Azure) with 10+ years of experience to join our team. In this role, you will be responsible for designing and implementing ETL/ELT pipelines for investment data in a hybrid cloud environment. The position involves building Microsoft Fabric pipelines and working with Azure data services to support analytics and business intelligence initiatives for a leading investment management company.

Technology stack

Lambda, Glue, Step Functions, RDS (Aurora), Secrets Manager, CloudFormation, DynamoDB, S3, ECS, SQS
Additional: Snowflake, Jenkins, Docker

Responsibilities

  • Develop, deploy, and maintain data pipelines using Azure Data Factory, Microsoft Fabric, and other Azure data services
  • Design, implement, and optimize SQL queries and stored procedures to ensure high performance and data accuracy
  • Write efficient, scalable Python (or Java) code for data processing, transformation, and analysis
  • Build and maintain Spark and PySpark workflows for distributed, large-scale data processing
  • Organize and manage ETL/ELT processes for structured and semi‑structured data
  • Collaborate with data engineers, data scientists, and business stakeholders to define data requirements and design data models
  • Implement data warehousing solutions and dimensional data models
  • Ensure data governance, metadata management, and security best practices
  • Manage access controls using Azure Security services and Azure Portal
  • Monitor, troubleshoot, and optimize data infrastructure performance
  • Work with relational and non-relational databases, including MS SQL, PostgreSQL, and Redshift
  • Support reporting and visualization needs using Power BI
  • Recommend and implement improvements based on evolving cloud and data engineering technologies

Requirements

  • Strong SQL skills (expert-level preferred)
  • Practical experience with ETL and ELT processes
  • Strong hands-on experience with Python (Java is acceptable)
  • Experience with Azure data services, especially Azure Data Factory or Microsoft Fabric
  • Practical experience with Spark (preferably PySpark)
  • Knowledge of data warehousing concepts
  • Knowledge of data governance and data management
  • Practical development experience in cloud environments

Nice to have

  • Hands-on experience with MS SQL
  • Experience with PostgreSQL
  • Experience with Amazon Redshift
  • Experience with Microsoft Fabric
  • Experience with AWS
  • Experience with Informatica or Pentaho
  • Experience with metadata management
  • Experience with Java or Scala
  • Experience with Power BI

Looking for Similar Opportunities?

Try AI chatbots with our ready-made prompt to discover similar roles that match your skills and interests.
Image

Co oferujemy

Image

Dni wolne

Zgodne z lokalnym prawem

Image

Dbamy o Twoje zdrowie

Zapewniamy szeroki wachlarz usług w ramach prywatnego ubezpieczenia medycznego

Image

Płatne chorobowe

Zgodnie z lokalnym prawem

Image

Wakacje i specjalne dni wolne

Zgodnie z oficjalnym kalendarzem, niezależnie od kalendarza klienta

Image

Komfortowe warunki pracy

Elastyczny czas pracy oraz pomoc w wyposażeniu komfortowego miejsca pracy

Image

Wewnętrzna platforma edukacyjna

Dostęp do profesjonalnych kursów i szkoleń

Image

Wewnętrzne kursy języka angielskiego

Firmowe szkolenia z wysoko wykwalifikowanymi nauczycielami

Najbardziej poszukiwane
1 of 1