DirecciónAbout the role
Our team will be responsible for migrating legacy analytic & business intelligence solutions and their associated data pipelines across Vodafone onto the Google Cloud Platform, enhancing and developing new solutions.
The Data Engineer delivers data pipelines and data service components. This will be at an industrial scale delivering 20+ countries' local data to a central Data Ocean hosted in the cloud.
The data engineer will design highly efficient pipelines for performance and reliability. Custom components will need to be developed to ensure privacy and integrity of the data.
As the data ocean is established the data engineer will also expose data with a common interface allowing the monetization of data across the whole of Vodafone in a controlled and secure fashion.
Key focus for and engineer will be :
- Work with Business Analyst, Test Engineer and Product Owner in an Agile Squad to create data pipelines for each local market migration.
- Integrate the necessary diverse and distributed data from multiple sources transforming this to a central data format for each country.
Replacing existing EDW with a central solution on Google Cloud Platform.
- Build data pipelines that make use of large volumes of data and generate outputs that allow commercial and business actions that generate incremental value.
- Create semantic layers for Business Intelligence users and feature engineering for data science.
- Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up the Local Markets delivery in the BI and Analytics in the Cloud
- Designing and producing high-performing stable end-to-end data pipelines to perform complex processing of batch and massive volumes of data in a multi-tenancy Big Data environment and output insights back to business systems according to their requirements.
- Design and implement core platform capabilities, tools, processes, and ways of working under agile development to support the integration of local markets data sourcing and use cases implementation, towards reusability, to easily deliver and ensure standardization across Local Markets deliverables in the platform.
- Working with the architecture team to define the strategy for evolving the data movement and transformation capability, including solution architectural decisions aligned with the platform architecture
- Defining the technologies to be used on the Data Ocean and investigating new technologies to identify where they can bring benefits
What do you bring?
- At least 2-3 years of experience as a Big data engineer or similar roles.
- Expertise in SQL (preferably knowledge of Big Query) and data modeling (DWH models)
- English level required : B2+. Nice to have : Italian.
- Very nice have : knowledge of Cloud environments in Datawarehousing (GCP, Azure or AWS)
- Experience in Python programming languages; and other functional languages will be a plus.
- Experience working in an Agile environment.
- Experience working in EDW or Data Warehouse solutions and ETL
- Bits of knowledge in designing, building and managing data pipelines to process large amounts of data in a Big Data ecosystem.
- Some of experience or knowledge in functional analysis and data validation process.
What's in it for you
