Mission of the Role
The Data Engineer will be responsible for collecting, transforming, and storing data to ensure it is accessible, reliable, and secure. This role plays a key part in supporting data-driven decision-making by maintaining high-quality data pipelines and infrastructure.
Key Responsibilities
* Data Acquisition: Identify, evaluate, and integrate the most suitable data sources for business and operational needs.
* Pipeline Development: Design and automate data collection and transformation workflows using modern orchestration tools.
* Data Cleaning: Ensure data integrity and quality by implementing cleansing and validation processes to prevent analytical misinterpretations.
* Data Modeling: Develop and maintain logical and physical database models for both structured and unstructured data.
* Database Optimization: Perform routine maintenance, monitoring, and performance tuning of company databases to ensure efficiency and scalability.
* Cloud Integration: Implement cloud-based data solutions with a focus on availability, scalability, and security.
* Collaboration: Work closely with data analysts, scientists, and other stakeholders to understand data requirements and translate them into scalable solutions.
Qualifications & Skills
Education & Experience:
* Academic background in Computer Science, Engineering, Mathematics, or related scientific disciplines.
* Proven experience in data engineering, preferably in cloud environments.
Technical Skills:
* Proficiency in working with relational and non-relational databases.
* Experience with cloud platforms (e.g., Azure, AWS, or GCP) and data orchestration tools (e.g., Azure Data Factory, Apache Airflow).
* Familiarity with CI/CD tools and version control systems (e.g., Git, Azure DevOps).
* Understanding of IT infrastructure and basic coding practices (soft coding).
Languages:
* Intermediate level of English (spoken and written) required.
Benefits:
* Opportunity to work on impactful projects in a dynamic and collaborative environment.
* Access to modern technologies and cloud platforms.
* Ongoing training and career development.
#J-18808-Ljbffr