Senior Data Engineer (Azure / Databricks)
Senior Data Engineer (Azure / Databricks)
Technologies we useExpected
- Python
- Scala
- Java
- Databricks
- Kafka
- Git
- Microsoft Azure
- Docker
- Terraform
- Azure DevOps
Optional
- Apache Airflow
- Azure Data Factory
- Prefect
- Dagster
Expected
- Python
- Scala
- Java
- Databricks
- Kafka
- Git
- Microsoft Azure
- Docker
- Terraform
- Azure DevOps
Optional
- Apache Airflow
- Azure Data Factory
- Prefect
- Dagster
About the projectWe run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e. g. , media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories here - https://getindata.com/blog/.
About role
We're excited to share that we're seeking a Data Engineer to join our team! This role plays a vital part in our company, and we're looking for candidates with exceptional skills and expertise. While there isn't a project ready to start at the moment, we'd love to connect and explore potential opportunities together in the future.
A Data Engineer's role involves the design, construction, and upkeep of data architecture, tools, and procedures facilitating an organization's collection, storage, manipulation, and analysis of substantial data volumes. This position involves erecting data platforms atop commonly provided infrastructure and establishing a streamlined path for Analytics Engineers who rely on the system.
We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e. g. , media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories here - https://getindata.com/blog/.
About role
We're excited to share that we're seeking a Data Engineer to join our team! This role plays a vital part in our company, and we're looking for candidates with exceptional skills and expertise. While there isn't a project ready to start at the moment, we'd love to connect and explore potential opportunities together in the future.
A Data Engineer's role involves the design, construction, and upkeep of data architecture, tools, and procedures facilitating an organization's collection, storage, manipulation, and analysis of substantial data volumes. This position involves erecting data platforms atop commonly provided infrastructure and establishing a streamlined path for Analytics Engineers who rely on the system.
Your responsibilities- Working together with Platform Engineers to assess and choose the most suitable technologies and tools for the project
- Development and committing of new functionalities and open-source tools
- Executing intricate data intake procedures
- Implementing and enacting policies in line with the company's strategic plans regarding utilized technologies, work organization, etc.
- Ensuring compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer
- Conducting training and knowledge-sharing
- Working together with Platform Engineers to assess and choose the most suitable technologies and tools for the project
- Development and committing of new functionalities and open-source tools
- Executing intricate data intake procedures
- Implementing and enacting policies in line with the company's strategic plans regarding utilized technologies, work organization, etc.
- Ensuring compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer
- Conducting training and knowledge-sharing
Our requirements- Proficiency in a programming language like Python / Scala or Java
- Knowledge of Lakehouse platforms - Databricks
- Experience working with messaging systems - Kafka
- Familiarity with Version Control Systems, particularly GIT
- Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions
- Extensive experience in Microsoft Azure
- Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Azure Data Factory, Prefect, Dagster
- Familiarity with DevOps practices and tools, including Docker, Terraform, CI/CD, Azure DevOps
- Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement
- Proficiency in a programming language like Python / Scala or Java
- Knowledge of Lakehouse platforms - Databricks
- Experience working with messaging systems - Kafka
- Familiarity with Version Control Systems, particularly GIT
- Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions
- Extensive experience in Microsoft Azure
- Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Azure Data Factory, Prefect, Dagster
- Familiarity with DevOps practices and tools, including Docker, Terraform, CI/CD, Azure DevOps
- Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement
Division of working time- 100% Remote work
- 100% Remote work
This is how we organize our workThis is how we work
- in house
- at the client's site
This is how we work
- in house
- at the client's site
This is how we work on a project- Continuous Deployment
- Continuous Integration
- DevOps
- Continuous Deployment
- Continuous Integration
- DevOps
Development opportunities we offer- external training
- technical knowledge exchange within the company
- external training
- technical knowledge exchange within the company
What we offer- Salary: 160 - 200 PLN net + VAT/h B2B (depending on knowledge and experience)
- 100% remote work
- Flexible working hours
- Possibility to work from the office located in the heart of Warsaw
- Opportunity to learn and develop with the best Big Data experts
- International projects
- Possibility of conducting workshops and training
- Certifications
- Co-financing sport card
- Co-financing health care
- All equipment needed for work
- Salary: 160 - 200 PLN net + VAT/h B2B (depending on knowledge and experience)
- 100% remote work
- Flexible working hours
- Possibility to work from the office located in the heart of Warsaw
- Opportunity to learn and develop with the best Big Data experts
- International projects
- Possibility of conducting workshops and training
- Certifications
- Co-financing sport card
- Co-financing health care
- All equipment needed for work
Recruitment stages- HR Interview
- Tech Interview
- Manager Meeting
- HR Interview
- Tech Interview
- Manager Meeting
What else do we do besides working on projects? We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference Big Data Technology Warsaw Summit, meetup Warsaw Data Tech Talks, Radio Data podcast, and DATA Pill newsletter.
Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career.
If you want to be up to date with the latest news from us, please follow up on our LinkedIn profile.
We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference Big Data Technology Warsaw Summit, meetup Warsaw Data Tech Talks, Radio Data podcast, and DATA Pill newsletter.
Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career.
If you want to be up to date with the latest news from us, please follow up on our LinkedIn profile.
GETINDATA POLAND sp. z o. o.
GetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with Xebia Group to broaden our horizons and bring new international opportunities.
GETINDATA POLAND sp. z o. o.
GetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with Xebia Group to broaden our horizons and bring new international opportunities.
Twoje dane osobowe będą przetwarzane w oparciu o następujące podstawy prawne: (a) aby podjąć działania na Twoje żądanie przed zawarciem umowy (np. informacje o oczekiwanym wynagrodzeniu i dostępności do rozpoczęcia pracy); (b) w oparciu o nasz prawnie uzasadniony interes (np. imię, nazwisko, data urodzenia, dane kontaktowe, wykształcenie, kwalifikacje zawodowe, przebieg dotychczasowego zatrudnienia); c) w oparciu o Twoją zgodę, która wyrażona jest poprzez przeslanie dokumentów aplikacyjnych zawierających takie informacje jak np. wizerunek czy zainteresowania.
Podanie wszystkich danych osobowych, o których mowa powyżej jest dobrowolne, natomiast dane wymienione w lit. a) i b) są niezbędne do wzięcia udziału w rekrutacji. Niepodanie danych skutkuje brakiem możliwości rozpatrzenia kandydatury. Podanie pozostałych danych jest dobrowolne, ale może pomóc w sprawnym przeprowadzeniu procesu rekrutacji.
Masz prawo żądać dostępu do Twoich danych (w tym uzyskania ich kopii), sprostowania danych, ich usunięcia, ograniczenia przetwarzania, przeniesienia, jak również wniesienia sprzeciwu wobec ich przetwarzania. Masz także prawo wniesienia skargi do Prezesa Urzędu Ochrony Danych Osobowych.
Twoje dane osobowe mogą zostać przekazane dostawcom usługi publikacji ogłoszeń o pracę, dostawcom systemów do zarządzania rekrutacjami, dostawcom usług IT (hosting), dostawcom systemów informatycznych.
Podane przez Ciebie dane osobowe nie będą wykorzystywane w celu profilowania albo podejmowania decyzji w sposób zautomatyzowany.
Twoje dane osobowe będą przetwarzane przez okres maks. 1 roku od zakończenia publikacji ogłoszenia, chyba, że wyraziłeś odrębną zgodę na wykorzystanie Twoich danych osobowych w przyszłych rekrutacjach.
W celu realizacji praw lub w przypadku jakichkolwiek pytań związanych z przetwarzaniem Twoich danych osobowych skontaktuj się z nami pod adresem: adam. nowicki@getindata.com.
Bądź pierwszy, który ubiega się o to miejsce pracy!
-
Dlaczego szukać pracy na HitPraca.pl?
Codziennie nowe oferty pracy Możesz wybierać z bardzo szerokiej gamy ofert pracy - naszym celem jest posiadanie jak najszerszej oferty pracy Otrzymuj nowe oferty e-mailem Bądź pierwszym, który odpowie na nowe oferty pracy Wszystkie oferty pracy w jednym miejscu (od pracodawców, agencji pośrednictwa pracy i innych portali) Wszystkie usługi dla kandydatów do pracy są bezpłatne Pomożemy Ci znaleźć nową pracę