[ad_1]

We are currently looking for an experienced Big Data Engineer for one of the leaders in the transport industry based in Belgium.

Project Overview:
The Big Data System Engineer is included in a team of system administrators responsible for the Big Data infrastructure of our client, which includes:
• Managing and monitoring the software and hardware in the Big Data landscape
• Installing, configuring, testing and maintaining operating systems (Red Hat) and Big Data middleware
• Performance management of the installed systems and applications
• Management of security, backup and HA strategies
• Providing 2nd and 3rd line support
• Contacts with vendors and developers for systems management and troubleshooting

What our client is looking for:
• At least 5 years of relevant experience as a Big Data Administrator /Engineer
• Elastic as a search engine (Elastic, logstash, beats, Kibana)
• The Hadoop ecosystem (Cloudera, HDFS, Yarn, Spark, Hive, Druid)
• Thorough experience with ETL Tools, Workflow management Nifi, Airflow, Streaming Kafka
• Machine Learning (Spark ML, H2O, scikit-learn, Keras, TensorFlow)
• Big Data Security Frameworks
• Cloud experience (preferably with Azure)
• Virtualization and containerization (e…

[ad_2]

Source link