The Role
Create your future. As part of Corporate Risk and Broking (CRB) the Data, Acquisition, Validation, and Enrichment team focuses on ingesting data from various sources, enriching the data, storing the data, and serving the data to our various systems and stakeholders. We work heavily with other technical teams in CRB to ensure that what is collected is fit for use. The CRB Data Lake is a culmination of data sources with our CRB Data Ecosystem and plays a vital role in the collection, transformation, governance, and availability of data.
Explore an opportunity. As a CRB Data Lake Support associate, you will work beside some of the companies’ top teams within CRB to facilitate the culmination of the strategic data in consumable packages and managing the distribution channels through pipelines and monitoring, while you progress toward becoming an experienced member of the team and CRB Technical community through your interactions with the data and teams.
You will have immediate exposure to real client data and technical teams which will draw on your imagination and creativity as well as your ability to analyze data, manage the data flows related to distribution to draw conclusions and present results of capacity, usage, availability. These experiences will help build your technical knowledge and overall industry expertise. You will be trained in how to plan, manage, prioritize, and communicate effective resolutions of the pipelines to ensure continued data flows.
- Incident management - including initial root cause analysis, break-fix support, and communications with L2 and L3 Data Lake Support team
- Environment monitoring - Daily monitoring of production Azure environments and resources, including storage, pipelines, databases, data lakes, Machine Learning models, SFTP services, networking, logging, monitoring & alerts.
- Production monitoring - Daily monitoring of production data ingestion and enrichment processes (Synapse notebooks & Python scripts) including integration with third party data extraction services and other internal data sources and systems.
- Problem management - working with the project team to enhance the D.A.V.E. Platform, including option appraisal, proof of concept and technical pilots.
- Configuration management – day to day configuration of the operational data ingestion service, including performance tuning and capacity management.
- Release management – Supporting production deployments and post-deployment checks
The Requirements
- Basic understanding Azure Synapse, Azure Key Vault, Azure Data Lake Storage v2, and Azure DevOps
- Some knowledge with Python and reading pySpark notebooks through Azure Synapse
- Knowledge of large data sets and co-mingling the data for business/system consumption as it relates to the Azure Cloud Modern Data Warehouse or similar data structures
- Experience with data presentation to the user using reporting tools like Power BI for various data quality, presentations, and confidence reviews of ticket submissions and resolutions metrics
- Dev-ops experience using GIT, developing, deploying code to production
- Able to manage multiple tasks with as required to review and resolve issues
- Able to collaborate with multiple teams to meet needs on a daily basis
- Able to work with a globally distributed team
- Ability to solve problems through critical thinking techniques and decision trees
- This is a remote position; you will be working from your home
Philippines
