JOB PURPOSE
SPECIFIC RESPONSIBILITIES
The purpose of this role is to support, develop, and maintain the organisation’s data integration and reporting solutions, with primary responsibility for Azure Data Factory pipelines and efficient, well-structured SQL development. The position ensures that existing data solutions operate reliably in production, are continuously improved for performance and scalability, and are delivered in line with standard development lifecycle practices. The role also applies GitHub-based version control, code review, testing, documentation, and other engineering best practices to ensure secure, maintainable, and high-quality data products that meet business needs.
Specific Responsibilities
* Support, develop, and maintain existing data integration and reporting solutions to ensure stability, accuracy, and availability for business users.
* Design, build, enhance, and operate Azure Data Factory (ADF) pipelines, including linked services, datasets, triggers, parameterisation, scheduling, and monitoring.
* Troubleshoot and resolve ADF pipeline failures and data issues; perform root-cause analysis and implement preventive fixes, including improved logging and alerting.
* Develop, support, and optimise SQL queries, views, and stored procedures to ensure efficient and reliable data extraction, transformation, and reporting.
* Perform performance tuning of SQL workloads (e.g., query rewrites, indexing recommendations, execution plan analysis) to reduce runtimes and improve overall efficiency.
* Ensure data quality through validation controls, reconciliation checks, and consistent error-handling patterns across pipelines and SQL logic.
* Maintain and improve documentation for pipelines, data flows, dependencies, and operational runbooks to enable effective support and knowledge transfer.
* Follow standard development processes and best practices, including requirements clarification, solution design, development, testing, release management, and post-deployment support.
* Use GitHub for version control and collaboration, including branching strategies, pull requests, peer code reviews, and traceable change history.
* Contribute to continuous improvement initiatives by identifying opportunities to automate manual steps, reduce operational effort, and increase solution robustness and scalability.
* Ensure compliance with internal governance, security, and data handling standards across all developed and supported solutions.
PERFORMANCE INDICATORS
* ADF pipeline stability (successful scheduled runs; low failure rate).
* ADF performance improvements (reduced runtime and fewer manual interventions).
* SQL efficiency (optimized queries; improved execution times).
* Production support effectiveness (incidents resolved within SLA; root-cause analysis completed).
* Release quality (minimal post-release defects; stable deployments).
* Development discipline (GitHub used consistently; code reviews and documentation maintained).
GENERAL RESPONSIBILITIES
MANAGEMENT
None
SUPERVISORY
None
BUDGETARY
None
HEALTH & SAFETY
General
CUSTOMERS
Internal
3RD PARTIES
Auditors as required
SKILLS/QUALS
* Advanced SQL skills (complex queries, stored procedures/views, troubleshooting, performance optimization).
* Strong Azure Data Factory capability (develop, support, monitor pipelines; scheduling and error handling).
* Experience integrating and supporting multiple data sources (databases, files, APIs, operational systems).
* Production support skills (incident handling, root-cause analysis, and implementing preventive fixes).
* Proficiency with GitHub workflows (branching, pull requests, code reviews, version control).
* Ability to implement and maintain logging/monitoring for data processes and integrations.
* Strong documentation skills (data flows, dependencies, technical/operational documentation).
* Understanding of data quality controls (validation, reconciliation, consistency checks).
INTERPERSONAL SKILLS
* Maintain up-to-date knowledge of business processes and company objectives to ensure reports meet evolving needs.
* Collaborate with team members and departments to promote data-driven solutions.
* Foster a collaborative and friendly working environment.
* Excellent communication skills essential, ability to understand clear written and verbal instructions.
* Self-motivated
* Good understanding of procedures and processes.
* Highly responsible, reliable and flexible with a strong work ethic
* Quality and safety conscious
* Punctual, presentable and with good attendance
Core Values
Integrity - Acts with honesty in actions and in communicating with others. Leads by example. Keeps promises, meets commitments and takes pride in work. Respects policies and lives up to the trust others place in them.
Relationships - Has a positive attitude. Communicates in an open and direct manner. Considers the needs of others before taking action. Uses differences as an opportunity to explore new ideas, increase understanding and combine strengths.
Accountability - Takes personal responsibility for doing the job to the best of their ability. Acts with initiative, learns from experiences, shares knowledge and strives to continually improve performance. Is dependable and can be counted on to deliver results. Looks out for the safety of others. Effectively utilizes resources.
Teamwork - Shares goals and works with others to achieve them. Encourages others to be involved and supports their ideas. Helps others without being asked. Reaches across departments and Business Units to increase knowledge and gain experience. Celebrates success.
Respect - Values the unique skills and abilities of others. Actively listens to other employee's ideas and honors diverse opinions. Appreciates everyone's contributions and recognizes accomplishments. Shows common courtesy to others and customers. Actively works to maintain an environment that is open, honest, supportive and fulfilling.