Senior Data Engineer
Capgemini
ABOUT CAPGEMINI
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
ABOUT YOUR ROLE
Capgemini is seeking a Senior Data Engineer to support a leading global financial institution in developing and optimizing data solutions. The role involves designing scalable ETL pipelines, integrating diverse data sources, and ensuring high data quality and performance. Candidates will work in a dynamic, agile environment using tools like Python, DataBricks, and Snowflake. This is an exciting opportunity to contribute to impactful data-driven initiatives within a high-profile financial services ecosystem.
- Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks
- Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business needs.
- Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.
- Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations
- Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.
- Conducting code reviews, provide constructive feedback, and enforce coding standards to maintain a high quality.
- Developing and maintain tooling and automation scripts to streamline repetitive tasks.
- Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes
- Utilizing REST APIs and other integration techniques to connect various data sources
- Maintaining documentation, including data flow diagrams, technical specifications, and processes.
YOUR PROFILE:
- Proficiency in Python programming, including experience in writing efficient and maintainable code.
- Hands-on experience with cloud services, especially DataBricks, for building and managing scalable data pipelines
- Proficiency in working with Snowflake or similar cloud-based data warehousing solutions
- Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices
- Familiarity with agile methodologies and the ability to work collaboratively in a fast-paced, dynamic environment.
- Experience with code versioning tools (e.g., Git)
- Knowledge of Linux operating systems
- Familiarity with REST APIs and integration techniques
You might also have:
- Familiarity with data visualization tools and libraries (e.g., Power BI)
- Background in database administration or performance tuning
- Familiarity with data orchestration tools, such as Apache Airflow
- Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing
WHAT YOU WILL LOVE ABOUT WORKING HERE?
- Open access to learning platforms for all: All employees have access to hundreds of thousands of learning assets and curated programs from Harvard Business Review, Coursera, Pluralsight, Udemy, Microsoft, AWS, Google and many more;
- Well-being Hub: The global Well-Being Hub connects employees across various facets of well-being: work-life balance, working hours and network growth;
- Hybrid working: We encourage flexibility when it comes to when and where works gets done. Employees work with their managers to determine an arrangement that works best for their role and personal circumstances;
- We also offer additional benefits such as Employee referral bonus and Company shares program.
This position requires 50% onsite presence in Budapest.
Explore data expertise at Capgemini https://www.capgemini.com/careers/career-paths/professions/data-and-ai/
Capgemini Hungary is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment, and all offers of employment and promotions are made on the basis of performance, competence and ability.