#jobs City: Аlmaty Position: Data Engineer DWH Company:EXNESS | KZ Jobs Data Science & Engineering

#jobs
City: Аlmaty
Position: Data Engineer DWH
Company:EXNESS Global Limited
Salary: from 5 000 EUR

Responsibilities:
• Develop and maintain the Data Warehouse (Vertica) frameworks;
Implement and operate Data Lake (S3 MinIO + Spark);
• Deploy and maintain Spark on k8s
• Maintain and enrich an environment for the creation of the data assets such as (ETL/ELT pipelines, DDL, etc.) via the development of the data transformation tool (DBT);
• Implement and maintain Data Catalog, Data lineage, and Business Glossary.

Requirements:
• Strong knowledge of Spark architecture; deployment and maintaining Spark on Hadoop, k8s or standalone experience;
•Experience with relational databases like Vertica, PostgreSQL, ClickHouse and similar.
•Experience with Big Data Processing & Data Lake building;
•Experience building ETLs/ELTs to take data from various data sources;.
Contacts