Senior Data Engineer - Big Data
technologies-expected :
- Python
- SQL
- Terraform
- Scala
about-project :
- As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions. Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).
- A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.
responsibilities :
- Working in a task orientated and Test Driven Team to investigate our Product and choose the candidates for On-Premise to Cloud migration
- Implement and maintain cloud-native landing and solutions
- Develop future-proof software solutions to Connect cloud and on-premise and viseversa
- Integrate security standards, policies and controls into service offerings
- Alternative tasks:
- Focusing on stability, performance tuning and innovation of the applications
- Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture
requirements-expected :
- Cloud Data Development:
- Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub
- Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing
- Optimize data infrastructure for performance, scalability and reliability
- Infrastructure as Code (IaC):
- Utilize Terraform to create and manage cloud resources efficiently
- Implement CI/CD pipelines for automated deployment and continuous integration
- Microservices and API:
- Work with microservices architecture and design APIs for seamless data integration
- Scripting and Testing:
- Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning
- Develop, test, and deploy solutions using Dataproc, Dataflow, and Cloud Functions
- Scala Expertise:
- Leverage Scala for Dataproc pipeline development, enhancement and performance tuning
offered :
- Friendly and multicultural environment
- 26 days of holiday from the very beginning
benefits :
- private medical care
- sharing the costs of professional training & courses
- life insurance
- remote work opportunities
- flexible working time
- integration events
- corporate sports team
- retirement pension plan
- preferential loans
- no dress code
- video games at work
- coffee / tea
- leisure zone
- pre-paid cards
- redeployment package
- employee referral program
- extra leave
- Multisport
- Skills@Work - personal & professional development program
- Employee Assistance Program (psychological support)
- E-learning platform: O'Reilly, library, tutorials
Bądź pierwszy, który ubiega się o to miejsce pracy!
-
Dlaczego szukać pracy na HitPraca.pl?
Subskrybuj oferty pracy
Codziennie nowe oferty pracy Możesz wybierać z bardzo szerokiej gamy ofert pracy - naszym celem jest posiadanie jak najszerszej oferty pracy Otrzymuj nowe oferty e-mailem Bądź pierwszym, który odpowie na nowe oferty pracy Wszystkie oferty pracy w jednym miejscu (od pracodawców, agencji pośrednictwa pracy i innych portali) Wszystkie usługi dla kandydatów do pracy są bezpłatne Pomożemy Ci znaleźć nową pracę