Mission of the Role
The Data Engineer will be responsible for collecting, transforming, and storing data to ensure it is accessible, reliable, and secure. This role plays a key part in supporting data-driven decision-making by maintaining high-quality data pipelines and infrastructure.
Key Responsibilities
- Data Acquisition: Identify, evaluate, and integrate the most suitable data sources for business and operational needs.
- Pipeline Development: Design and automate data collection and transformation workflows using modern orchestration tools.
- Data Cleaning: Ensure data integrity and quality by implementing cleansing and validation processes to prevent analytical misinterpretations.
- Data Modeling: Develop and maintain logical and physical database models for both structured and unstructured data.
- Database Optimization: Perform routine maintenance, monitoring, and performance tuning of company databases to ensure efficiency and scalability.
- Cloud Integration: Implement cloud-based data solutions with a focus on availability, scalability, and security.
- Collaboration: Work closely with data analysts, scientists, and other stakeholders to understand data requirements and translate them into scalable solutions.
Qualifications & Skills
Education & Experience:
- Academic background in Computer Science, Engineering, Mathematics, or related scientific disciplines.
- Proven experience in data engineering, preferably in cloud environments.
Technical Skills:
- Proficiency in working with relational and non-relational databases.
- Experience with cloud platforms (e.g., Azure, AWS, or GCP) and data orchestration tools (e.g., Azure Data Factory, Apache Airflow).
- Familiarity with CI/CD tools and version control systems (e.g., Git, Azure DevOps).
- Understanding of IT infrastructure and basic coding practices (soft coding).
Languages:
- Intermediate level of English (spoken and written) required.
Benefits:
- Opportunity to work on impactful projects in a dynamic and collaborative environment.
- Access to modern technologies and cloud platforms.
- Ongoing training and career development.
#J-18808-Ljbffr