In SOTEC Consulting (Astek Group) we are looking for a Data Engineer to design and build scalable data solutions on AWS. You will work with business and technology teams to create robust pipelines and modern data architectures.
Responsibilities
* Design, develop, and maintain data pipelines
* Implement architectures such as data lakes and data warehouses
* Work with AWS (S3, Glue, Athena, EMR, Lambda)
* Collaborate with analysts, data scientists, and DevOps teams
* Ensure data quality, security, and governance
* Resolve issues and optimize processes
* Lead end-to-end data projects
Requirements
* Experience with Python and SQL
* Knowledge of Spark/Scala
* Experience with AWS
* Experience with ETL and data modeling
* Analytical mindset and problem-solving skills
* C1 level of English
Plus
* Experience with xcskxlj modern architectures (lakehouse)
* Familiarity with CI/CD tools (e.g., GitHub Actions)
* Experience with Apache Iceberg or similar table formats
* Exposure to data quality frameworks (e.g., Great Expectations, Deequ)
* Knowledge of Bash and HCL would be an added advantage
* Experience with orchestration tools (Airflow)
#J-18808-Ljbffr