JOB PURPOSE
The purpose of this role is to support, develop, and maintain the organisation’s data integration and reporting solutions, with primary responsibility for Azure Data Factory pipelines and efficient, well-structured SQL development. The position ensures that existing data solutions operate reliably in production, are continuously improved for performance and scalability, and are delivered in line with standard development lifecycle practices. The role also applies GitHub-based version control, code review, testing, documentation, and other engineering best practices to ensure secure, maintainable, and high-quality data products that meet business needs.
SPECIFIC RESPONSIBILITIES
* Support, develop, and maintain existing data integration and reporting solutions to ensure stability, accuracy, and availability for business users.
* Design, build, enhance, and operate Azure Data Factory (ADF) pipelines, including linked services, datasets, triggers, parameterisation, scheduling, and monitoring.
* Troubleshoot and resolve ADF pipeline failures and data issues; perform root-cause analysis and implement preventive fixes, including improved logging and alerting.
* Develop, support, and optimise SQL queries, views, and stored procedures to ensure efficient and reliable data extraction, transformation, and reporting.
* Perform performance tuning of SQL workloads (e.g., query rewrites, indexing recommendations, execution plan analysis) to reduce runtimes and improve overall efficiency.
* Ensure data quality through validation controls, reconciliation checks, and consistent error‑handling patterns across pipelines and SQL logic.
* Maintain and improve documentation for pipelines, data flows, dependencies, and operational runbooks to enable effective support and knowledge transfer.
* Follow standard development processes and best practices, including requirements clarification, solution design, development, testing, release management, and post‑deployment support.
* Use GitHub for version control and collaboration, including branching strategies, pull requests, peer code reviews, and traceable change history.
* Contribute to continuous improvement initiatives by identifying opportunities to automate manual steps, reduce operational effort, and increase solution robustness and scalability.
* Ensure compliance with internal governance, security, and data handling standards across all developed and supported solutions.
PERFORMANCE INDICATORS
* ADF pipeline stability (successful scheduled runs; low failure rate).
* ADF performance improvements (reduced runtime and fewer manual interventions).
* SQL efficiency (optimised queries; improved execution times).
* Production support effectiveness (incidents resolved within SLA; root‑cause analysis completed).
* Release quality (minimal post‑release defects; stable deployments).
* Development discipline (GitHub used consistently; code reviews and documentation maintained).
SKILLS / QUALIFICATIONS
* Advanced SQL skills (complex queries, stored procedures/views, troubleshooting, performance optimisation).
* Strong Azure Data Factory capability (develop, support, monitor pipelines; scheduling and error handling).
* Experience integrating and supporting multiple data sources (databases, files, APIs, operational systems).
* Production support skills (incident handling, root‑cause analysis, and implementing preventive fixes).
* Proficiency with GitHub workflows (branching, pull requests, code reviews, version control).
* Ability to implement and maintain logging/monitoring for data processes and integrations.
* Strong documentation skills (data flows, dependencies, technical/operational documentation).
* Understanding of data quality controls (validation, reconciliation, consistency checks).
INTERPERSONAL SKILLS
* Maintain up‑to‑date knowledge of business processes and company objectives to ensure reports meet evolving needs.
* Collaborate with team members and departments to promote data‑driven solutions.
* Foster a collaborative and friendly working environment.
* Excellent communication skills essential, ability to understand clear written and verbal instructions.
* Self‑motivated.
* Good understanding of procedures and processes.
* Highly responsible, reliable and flexible with a strong work ethic.
* Quality and safety conscious.
* Punctual, presentable and with good attendance.
#J-18808-Ljbffr