Senior Data Engineer
Capgemini
Data Science
Poland
Posted on Dec 6, 2024
We are looking for accountable Data Engineer passionate about AI and cloud technologies to join our team to assist our Client in integrating AI solutions.
Your Tasks
In this role, you will be responsible for supporting processes by solving maintenance and data quality issues and ensuring the efficient operation of Client’s organization systems.
- Design and Build: Develop infrastructure that supports efficient access, analysis, and processing of large-scale data.
- Optimize Frameworks: Refactor and improve existing systems to enhance performance and scalability.
- Validate Solutions: Test data structures and pipelines to ensure reliability and fitness for purpose.
- Data Preparation: Prepare and transform raw data to enable seamless use by data scientists.
- Maintain Quality: Identify, troubleshoot, and resolve data issues to uphold high-quality standards.
- Collaborate with Stakeholders: Engage with end users to clarify requirements and ensure data solutions are well-documented, accessible, and properly backed up for team use.
Your Profile:
- Experience: 4–5 years in data engineering with expertise in handling large databases and data warehouses.
- Cloud Proficiency: Deep knowledge of Databricks (Delta Tables, DLT, Unity Catalog), Azure Data Factory, Azure SQL Database, and Azure Key Vault. Familiarity with Azure OpenAI Service is a plus.
- Programming Skills: Strong experience with Python and PySpark.
- Version Control: Ability to work with Git and Azure DevOps.
- AI Knowledge: Understanding of model training, prompt engineering, and the RAG pattern.
- MLOps Expertise: Experience with CI/CD pipelines tailored for AI applications.
- Soft Skills: Strong problem-solving abilities, collaboration, and adaptability in fast-paced environments.
- Industry Knowledge: Familiarity with automotive processes is a bonus.
What You'll love about working here?
- Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern Wrocław office with work from home. Ask your recruiter about the details.
- Early support thanks to Buddy Programs: learn in the flow of work alongside our experts who collaborate on top-tier solutions for global enterprises, including 145 Fortune 500 companies.
- Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.