In SOTEC Consulting (Astek Group) we are looking for a Data Engineer to design and build scalable data solutions on AWS. You will work with business and technology teams to create robust pipelines and modern data architectures.
Responsibilities
Design, develop, and maintain data pipelines
Implement architectures such as data lakes and data warehouses
Work with AWS (S3, Glue, Athena, EMR, Lambda)
Collaborate with analysts, data scientists, and DevOps teams
Ensure data quality, security, and governance
Resolve issues and optimize processes
Lead end-to-end data projects
Requirements
Experience with Python and SQL
Knowledge of Spark/Scala
Experience with AWS
Experience with ETL and data modeling
Analytical mindset and problem-solving skills
C1 level of English
Plus
Experience with xcskxlj modern architectures (lakehouse)
Familiarity with CI/CD tools (e.g., GitHub Actions)
Experience with Apache Iceberg or similar table formats
Exposure to data quality frameworks (e.g., Great Expectations, Deequ)
Knowledge of Bash and HCL would be an added advantage
Experience with orchestration tools (Airflow)
#J-18808-Ljbffr