Senior GenAI Data Engineer
responsibilities :
- Collect and centralize data from various sources, working with IT, business stakeholders and subject matter experts
- Develop & maintain scalable ETL pipelines and data transformations required for data science & GenAI projects, based on specific business needs
- Develop and optimize data storage solutions, data models and queries for efficient data storage and retrieval.
- Develop GenAI app prototypes and MVPs utilizing available pre-trained models and APIs
- Bridge the gap between an MVP and production-ready application by working in an agile manner and seeking constant feedback from the stakeholders & internal customers
- Work closely with IT, Security and Compliance teams to ensure that the challenges associated with using proprietary data in GenAI models are addressed for all new projects
- Take the ownership of data quality and integrity by implementing data validation and cleansing processes.
- Develop tools and tests to ensure quality and help diagnose issues
- Perform analysis on business processes and data to identify opportunities for improvement
- Domain expertise, leading to proactive identification of use cases and activities to benefit the team and the business.
- Stay updated on emerging technologies, tools, and best practices in data engineering and applied generative AI to drive continuous improvement initiatives.
- Mentor other team members and contribute to the development of data engineering & GenAI capabilities within the organization.
- Contribute to the development and maintenance of documentation related to data architecture, processes, and standards.
requirements-expected :
- Bachelor's degree in Data Science, Computer Science, Software Engineering / Information Technology or a related discipline.
- 3-5 years of experience working as a Data Engineer, ML Engineer or in a similar role.
- Proven track record of working effectively in a fast-paced, collaborative environment.
- Proficiency in SQL and Python.
- Practical experience with developing applications using Large Language Models and LLM APIs
- Hands-on experience with popular frameworks used for LLM app development, such as Langchain, Huggingface, Pinecone, Neo4j or similar.
- Strong knowledge of data modelling concepts, e. g. dimensional modelling
- Experience with practical use of cloud platforms and services, e. g. AWS, GCP or Azure.
- Experience with use and management of relational databases, ideally Oracle
- Experience with at least one popular ETL/ELT tools and frameworks, e. g. Kafka, Airflow
- Familiar with use and management of columnar databases, e. g. Vertica or similar.
- Familiarity with data visualization tools, particularly PowerBI.
- Ability to react quickly to new demands in a dynamic business environment.
- Experience in working on global projects with resources based across multiple continents and time zones.
- Capable of working autonomously, with minimal assistance from other team members
- Team player, excelling in collaboration and sharing knowledge with peers and other teams
offered :
- We are seeking a skilled and experienced Mid-Level GenAI Data Engineer with expertise in data modelling and data transformation for ML & AI models to join our client dynamic team. You will play a pivotal role in designing, developing, and maintaining data infrastructure and deploying cutting-edge LLM models to support the organization's needs. Your contributions will shape the data-driven decision-making processes of company and enhance the value we provide to our clients.
- The position will suit a flexible, self-starter, who is passionate about technology, and has an ability to develop on a variety of projects, depending on business priorities. The ideal candidate will be confident working and communicating with stakeholders at all levels, across global locations, in an impactful manner.
Bądź pierwszy, który ubiega się o to miejsce pracy!
-
Dlaczego szukać pracy na HitPraca.pl?
Subskrybuj oferty pracy
Codziennie nowe oferty pracy Możesz wybierać z bardzo szerokiej gamy ofert pracy - naszym celem jest posiadanie jak najszerszej oferty pracy Otrzymuj nowe oferty e-mailem Bądź pierwszym, który odpowie na nowe oferty pracy Wszystkie oferty pracy w jednym miejscu (od pracodawców, agencji pośrednictwa pracy i innych portali) Wszystkie usługi dla kandydatów do pracy są bezpłatne Pomożemy Ci znaleźć nową pracę