[ad_1]

The Senior Data engineer will work alongside the Data Science Lead and will be responsible to support the development of cutting edge algorithms using the latest big data and machine learning technology. As the Senior Data engineer, you will ingest structured, semi-structured and unstructured batch- and real-time data from numerous data sources into the newly yet to be designed data platform.  The Senior Data engineer will use the latest auto deployment, testing and monitoring techniques. The Senior data engineer will work closely with the Solution Architect and Data Architect to design the big data platform.
Purpose and Accountabilities:

• Work together with the Solution- and Data Architect to design the next generation big data platform to support the digital marketing platform.
• Design and implement a new big data solution which supports high amounts- and velocity of data, supports future growth, use latest big data technologies/techniques, is cloud supported and in-line with the company’s strategies.
• Design and implement modern data pipelines to extract, clean and process data in batch and real-time from different data sources.
• Use the latest development, testing and deployment techniques to quickly deploy new releases to e.g. deploy new data pipelines and add data sources.
• Help establish best practices around data governance, data security- and privacy (GDPR).
• Work together with the solution- and data architect to the define the target data strategy.
• Drives and applies Agile Framework within his/her operating environment. Will take direct reports, when applicable, through Agile Framework and its respective tools.

Dimensions

• The Data Engineer will report into the Data Engineering Manager
• Commercial Awareness – Influence on programme scope of $USD 2M+
• Stakeholder management – typically works within cross-functional teams.
• Strong collaboration skills to ensure teams are all working towards the same goals.
• Highly customer focused and fast paced environment.
• Passion to lead others directly and indirectly into the new Data Engineering career development
• Exposure to Predictive Maintenance technologies and Developments such as Computer Vision.
• Cross disciplinary interaction with other Disciplines in Shell outside Advance Analytics, for instance, control and automation, robotics, instrumentation others.
• In occasions, acting as the Deputy Engineering Manager

 
Special Challenges

• Able to deal with state of the art, differentiated and often unproven technologies which require some learning on the job
• Comfortable with sometimes vague and changing scope and priorities in a rapidly changing environment
• Ability to interact and build relationships both within Shell (IT & Business teams) and external software suppliers.
• Ability to ensure one team mind set across TACIT, functional IT, product vendors and business colleagues in order to drive more effective delivery.
• Fast adaptability to the every fast and changing environment within Shell-Digital and in the external market.

[ad_2]

Source link