Data Engineer
Almaty
Full-time
Remote work
Project work
The vacancy has been archived and is no longer active
Main requirements
A vacancy for a Data Engineer has been opened in an IT company/Date engineer.
Requirements:
At least 2 years of experience in the field of big data warehouse development;
Knowledge of data and analytics concepts (e.g. modeling, ETL, reporting tools, data management, data storage;
Experience working with regulatory reporting (in banks), creating reports, understanding the difference in attributes;
Knowledge of the fundamental foundations of Computer Science, in particular the architecture of distributed file systems;
Experience working with ETL/ELT systems (Informatica, Airflow, Dagster, Apache Nifi, Apache Spark, PXF), DBT transformation;
Experience working with Apache Kafka and Rabbit MQ streaming data processing services;
Experience working with reports and business intelligence packages, for example: Tableau, QlikView, SAP , etc.;
Experience working with programming languages, such as writing bash scripts in UNIX or programming in Python;
Experience using a data transformation tool (DBT, Spark, Python);
Experience working with relational databases (Oracle, MS SQL Server/MySQL);
Experience working with non-relational, columnar databases (Greenplum, Vertica, Vector databases, Clickhouse, Scylla DB);
Experience in building repositories for the financial sector;
Experience working with DataGovernance tools;
Experience in data schema, database, and storage design;
Experience working with big data platforms (e.g. HBase, ClickHouse, Druid, MemSQL, Hive, Minio);
Experience of integration with CDC technologies (GoldenGate, Informatica, Debezium)
Experience working with the development of the Credit Register report will be a significant advantage.
What you will do
Responsibilities:
Building data streams for storage;
Optimization of data uploads from source systems;
Implementation of transformations in target storage data models;
Uploading data to other systems for further processing;
Implementation of verification reports.
What we offer
the possibility of a hybrid work schedule, competitive salary
Remote work
| Name | Work Experience | Contacts | Response date | Notes | Response status |
|---|
There are no responses yet
When someone responds to a vacancy, a list of candidates will appear here
