In SOTEC Consulting (Astek Group) we are looking for a Data Engineer to design and build scalable data solutions on AWS. You will work with business and technology teams to create robust pipelines and modern data architectures.
- Design, develop, and maintain data pipelines
- Implement architectures such as data lakes and data warehouses
- Work with AWS (S3, Glue, Athena, EMR, Lambda)
- Collaborate with analysts, data scientists, and DevOps teams
- Ensure data quality, security, and governance
- Resolve issues and optimize processes
- Lead end-to-end data projects
- Experience with Python and SQL
- Knowledge of Spark/Scala
- Experience with AWS
- Experience with ETL and data modeling
- Analytical mindset and problem-solving skills
- C1 level of English
- Experience with modern architectures (lakehouse)
- Familiarity with CI/CD tools (e.g., GitHub Actions)
- Experience with Apache Iceberg or similar table formats
- Exposure to data quality frameworks (e.g., Great Expectations, Deequ)
- Knowledge of Bash and HCL would be an added advantage
- Experience with orchestration tools (Airflow)
#J-18808-Ljbffr