[ad_1]

The main activities of the All-round Data Engineer are:

* Gathering and clarifying requirements from the business in collaboration with the Product Owner;
* Making functional and technical designs in collaboration with Solution Architects and your colleagues;
* Building ingestions, cleaning, parsing, modelling, dashboarding applications
* Exposing and analysing data;
* Converting raw data from various sources into applicable solutions;
* Writing and maintaining program and system documentation;
* Day-to-day management and monitoring of the data products;

Tech Stack:

* Python;
* Docker;
* Kubernetes;
* Jenkins + Argocd (CICD tooling);
* Data visualization techniques;
* Requirement gathering and analysis;
* Streaming data;
* (Relational) databases;
* Knowledge of Data lake;
* Experience with Kafka
* Experience with/or knowledge of Azure;
* Object storage
* Security in Data ETL
* Scrum and / or DevOps experience / certification…

[ad_2]

Source link