AWS Data Engineer
DevOps (nice to have) Apache Kafka (nice to have) Airflow (nice to have) Snowflake (nice to have) Databricks (nice to have) Apache Spark (nice to have) Amazon AWS (junior) SQL (regular) Python (regular) As an AWS Data Engineer you’ll be part of the project focused on building large, enterprise Data Lake on top of AWS. You will participate in many aspects such as integration of data from multiple sources, applying transformations using Python and SQL and taking care of the performance aspects. The candidate needs to be able to effectively translate business requirements into technical specification, experience with Python and/or SQL and he’s willing to get some hands-on experience with AWS. Your responsibilities:Being able to effectively convert business requirements into technical solutionsPromote software development best practices / have an DevOps mindsetUse AWS Data Engineering services like AWS Glue, Lambda, Athena to build scalable data solutionsDesigning and building Data Lakes / Data Platforms using modern solution and data architecturesBuilding data pipelines with Apache AirflowJob scheduling, execution and supporting during UAT/go live. Leverage AWS analytical services to build data applicationsOur requirements:At least 2 years of experience with Python language and understanding the concept of OOP and best coding standardsGood knowledge of SQL for data transformation (including complex queries with analytical functions)Ability to perform data manipulations, load, extract from several sources of data into another schema. Ability to work with multiple file formats (JSON, xml, csv, reports, etc. ) and analyze data, if required for further processingWilling to learn AWS architecture (we support certification!)Experience with Apache Spark (preferably Databricks) would be a plusSnowflake experience would be a plus (or similar cloud DWH technology like e. g. AWS Redshift)Hands-On experience with Apache Airflow would be a plusWhat we offer:100% remote work B2B contractA competitive salaryMultiple opportunities to gain new knowledge from AWS / Data Engineering area in our internal knowledge sharing meetupsMoney refund for Data Engineering certification expensesTraining budget
Katowice, Silesian Voivodeship, Polska
|Praca na stanowisku:||AWS Data Engineer|
|Dodano:||3. 8. 2022
Praca na stanowisku - aktualna
Bądź pierwszy, który ubiega się o to miejsce pracy!