Вакансии

Data Engineer

  • Уровень дохода не указан
  • г.Астана

Краткое описание

DigitalTeam is hiring. We are a worldwide software service provider and currently looking for a Data Engineer to join our team. 

Обязанности

  • Design, develop, and maintain efficient, scalable data pipelines for both batch and real-time processing
  • Build and manage workflows using Airflow and ensure robust orchestration of ETL processes
  • Work extensively with Apache Spark (preferably PySpark) to process large datasets
  • Implement and manage data lakehouse solutions using Delta Lake and Databricks
  • Integrate and optimize data pipelines into Snowflake or other cloud data warehouses
  • Apply medallion architecture principles (Bronze → Silver → Gold layers) to structure and organize data
  • Cleanse, standardize, and transform complex and semi-structured datasets
  • Stay up-to-date with best practices in data engineering, infrastructure, and governance

Требования

  • 7+ years of hands-on experience as a Data Engineer or in a similar role 
  • Strong expertise with Apache Spark (preferably PySpark)
  • Solid experience using Airflow for orchestration of data workflows
  • Proven work with Delta Lake and Databricks environments
  • Hands-on experience with Snowflake or other cloud-based data warehouses (e.g., BigQuery, Redshift)
  • Deep understanding of data pipelines, including real-time streaming and batch ingestion
  • Experience implementing medallion/lakehouse architecture
  • Proficient in data modeling, cleansing, and transformation techniques
  • Comfortable working with semi-structured and messy datasets
  • Strong understanding of data lineage, quality controls, and monitoring best practices
  • Excellent communication skills and experience working in distributed and cross-functional teams

Условия

  • Official employment;
  • Flexible work schedule;
  • Professional growth and development with friendly team;
  • Remote work;
  • Detailed onboarding.

avatar
ТОО DIGITAL TEAM (ДИДЖИТЛ ТИМ)
DigitalTeam is a software development company with a strong presence in Kazakhstan. With years of experience in the IT industry, we translate our clients' technical and business needs into robust, high-quality software solutions. We work with businesses of all sizes and across various industries, offering a tailored approach to each business case. DigitalTeam is dedicated to custom software development, taking full responsibility for your project implementation. If you need analysis or research, we also provide expert IT consulting services. Most of our tech specialists are at the middle and senior levels, with extensive experience across a wide range of technologies, including Java, Python, Node.js, .NET, PHP, JavaScript, React, Angular, and more. They are proficient in modern software architecture, API integration, cloud computing, and data solutions.
IT-компания
Участник Astana Hub
  • График работы

    Удаленная работа

  • Направление

    Информационные технологии

  • Необходимая степень образования

    Высшее - Бакалавр

  • Опыт работы

    Не менее 6 лет

  • Статус вакансии

    Открытая

  • Дата публикации

    07 июль 2025