Lead Data Engineer
- Remote.Bulgaria
- Remote.Georgia
- Remote.Poland
- Варна
- Варшава
- Вроцлав
- Ереван
- Клуж-Напока
- Краков
- Ларнака
- Лодз
- Люблин
- Рига
- София
- Тбилиси
Ако сте получили информация за тази свободна позиция от нашите рекрутери, прочетете нашата Политика за поверителност на личните данни.
Client
Project overview
Position overview
Responsibilities
- Design and lead the implementation of an AWS native lakehouse platform using Medallion architecture with S3 and Iceberg
- Define and maintain Infrastructure as Code using Terraform, including environment setup and CI CD pipelines
- Design and implement Change Data Capture and streaming ingestion frameworks for migrating legacy data workloads
- Establish engineering standards including code reviews, automated testing, data quality validation, and reusable pipeline design
- Evaluate AWS services and align architecture with Well Architected principles
- Collaborate with product management to break down data products and guide engineering execution
- Mentor data engineers and support knowledge transfer to build internal capabilities
- Ensure platform observability, monitoring, and reliability across the data ecosystem
Requirements
- 8+ years of experience in data engineering including at least 2 years in a technical leadership role
- Hands on experience with AWS data services including S3, Glue, Redshift, Athena, MSK Kafka, EMR Spark, Lake Formation, IAM
- Strong experience with Infrastructure as Code using Terraform and implementing CI CD pipelines
- Proficiency in Python and SQL for building data pipelines and data models across batch and streaming workloads
- Experience with open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi
- Experience designing and implementing Change Data Capture and real time streaming pipelines using Kafka, Flink, or Spark Structured Streaming
- Experience delivering end to end data platforms or leading large scale data migrations
- Experience migrating on premises data systems to cloud environments
- Ability to communicate technical decisions clearly to both engineering and business stakeholders
- Experience mentoring engineers and supporting team capability development
Nice to have
- Experience migrating legacy platforms such as ClickHouse, Apache NiFi, or PostgreSQL
- AWS certifications such as Data Engineer or Solutions Architect
- Experience working in regulated industries with high volume real time data processing
- Exposure to data governance tools such as AWS Lake Formation, AWS Glue Data Catalog, or Amazon Macie
- Experience with business intelligence tools such as Tableau
Търсите сходни възможности?
