Data Engineer
Capgemini
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
Job Description
We are seeking a skilled Data Engineer to join our Project team.
You will work under the supervision of a Project Lead and a Tech Lead / Data Architect.
Responsibilities:
- Design, develop and maintain scalable data pipelines on the Databricks platform
- Manage data ingestion processes from various sources into the Databricks environment.
- Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration.
- Ensure data quality, integrity, and security across all data pipelines.
- Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates.
- Document data pipeline processes, technical specifications and best practices.
- Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future
Required Skills:
- Strong skills in SQL (and other relevant programming languages like Python) and in Datawarehouse / Lakehouse project
- Proven expertise in Databricks and in with AWS services such as S3, Redshift, Lambda.
- Analytical mindset with attention to detail
- Strong communication and collaboration skills (within a Project team and with a Data engineer team)
Your Profile
- You are a tenacious problem solver, with great customer focus and passionate about data
platforms and automation. - A minimum of 3 years' experience working as data platform technical expert of MLOps role.
- Good understanding of automation techniques and integration with enterprise systems.
- Familiarity with monitoring techniques and key metrics for platform performance.
- Excellent programming skills (Python) and familiarity with common DevOps tools (Git,
Terraform). - Good understanding of AWS infrastructure and deployment practices (IaC tools, such as
Terraform are considered a big plus).
What You Will Love About Working here
- At Capgemini Belgium we offer flexibility in more than one way: next to our hybrid way of working, where we offer you can work 70% from home, we also offer our flex abroad program. With this program you can work up to 45 days abroad, this to maintain a good work-life balance.
- Our mission is your career path. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.
- OUTfront, Women@Capgemini or CapAbilityare 3 examples of employee led networks dedicated to advance diversity, equity and inclusion within workplace and society.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.