Job Purpose:
The DevOps Engineer is a key enabler of efficient, secure, and automated data extraction, data transformation and data loading from various internal and external data sources, with the aim to create a single centralised Data Warehouse for integrated real-time or near real-time reporting and data visualisation.
This role is responsible for Data Warehouse Creation and Administration, Data Pipeline Automation, Data Infrastructure Management, Data Warehouse Monitoring and Performance Optimisation, Security and Compliance, and collaborating with the Data Strategist and Data Analyst in the development and support of the required data assets.Formal Education:
- Grade 12
- Bachelor’s Degree in Computer Science, Software Engineering, or a related field.
- Preferred: Microsoft DevOps certifications, Microsoft SQL Server, Microsoft SQL Sever Integration Services Certification and IaC (Infrastructure as Code)
Work Experience
- Minimum of 3–5 years experience in DevOps, Data Extract-Transform and Load (ETL), Database Services and Data Integration Services.
- Proven experience in Database Development and Maintenance.
- Proven Experience in Data Extraction, Transformation and Load (ETL).
- Experience working with MS SQL Server, Power BI, MS SQL Server Integration Services, MS Power Automate and IaC.
- Familiarity with agile development environments.
Key Skills and Capabilities Required
The DevOps Engineer will use both technical and interpersonal skills, including:
- Ability to translate Business Strategy and Objectives into Data Requirements.
- Ability to function across Business Units and engage with key data stakeholders.
- Data exploration and data modelling capabilities.
- Database creation, maintenance and optimisation skills.
- Technical Skills in terms of Data Extraction, Data Transformation and Data Load (ETL).
- Data Integration skills.
- System Development Skills.
- Project Management Skills.
Technical and Legal Certification
- MS SQL Certification
- MS SQL Server Integration Services
- Microsoft Power Automate
- MS Power BI
- DevOps Foundation Certification
Key Responsibilities
- Data Warehouse
- Create and maintain Data Warehouse (Databases, Data Tables).
- Create and maintain Data Views.
- Monitor and optimise database performance.
- Track and manage changes using version control.
- Automation
- Automate the Extraction, Transformation and Load of data from various internal and external data sources.
- Setup of automated data pipelines to ensure data flows optimally between data sources and the Data Warehouse.
- Monitor, manage and optimise data loads, and attend to extract, transform or load errors.
- Maintain and improve pipeline performance, reducing deployment time and error rates.
- Develop APIs for the extraction of information, making use of API Factory standards, patterns and guidelines.
- Manage APIs throughout the API lifecycle.
- Data Integration and Security
- Securely connect the Data Warehouse to internal and external data sources.
- Securely extract data via API Gateway.
- Implement User Access Controls and Row Level Security.
- Collaboration and Integration
- Collaborate with Data Strategist and Data Analyst in the design and implementation of data models, entity relationships diagrams.
- Support Power BI Team with data operations, improving feedback loops, and reducing deployment bottlenecks.
- Work closely with security and compliance teams to ensure DevSecOps principles are applied.
- Monitoring, Logging & Incident Support
- Implement system observability and monitor data warehouse health and infrastructure performance.
- Set up logging and alerting mechanisms using industry-standard tools (VMWare Aria, Splunk, BMC Helix).
- Assist in troubleshooting production issues, performing root cause analysis, and implementing preventive fixes.
- Optimise query performance and data loading times.
- Implement and manage data refresh cycles and improve efficiency.
- DevOps Governance & Best Practices
- Document and maintain DevOps standards and SOPs.
- Advocate for automation, reuse, and continuous improvement in deployment and operations practices.
- Participate in internal DevOps community of practice, sharing knowledge and aligning on tooling and strategies.
Personal Attributes
- Problem-solving and analytical skills
- Creativity and innovation
- Effective communication
- Collaboration and teamwork
- Strategic thinking and vision
- Integrity
- Dependable