Data Engineer - AWS Databricks
Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Job Description
The AWS Databricks Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and platform solutions using AWS and Databricks. This role supports enterprise-grade data engineering initiatives, including ingestion, transformation, and orchestration of large-scale datasets for analytics and AI workloads.
Key Responsibilities
- Design and implement robust data pipelines using Databricks, Delta Lake, and AWS services (e.g., S3, Glue, Redshift, Lambda).
- Develop and optimize ETL/ELT workflows using PySpark, SQL, and orchestration tools like Airflow or Jenkins.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Monitor and troubleshoot Databricks jobs and platform-level issues to ensure performance and reliability.
- Implement CI/CD pipelines using GitHub, Terraform, and Jenkins for infrastructure and code deployments.
- Ensure data quality, security, and compliance across the platform.
- Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming.
Required Skills & Experience
- 3+ years of hands-on experience with AWS (EC2, S3, IAM, VPC, RDS, Glue).
- 2+ years of experience with Databricks (including DLT, Delta Lake, and workspace management).
- Strong programming skills in Python and SQL; experience with PySpark is essential.
- Experience with DevOps practices and tools (Terraform, Git, Jenkins).
- Familiarity with data warehousing concepts and tools (e.g., Redshift, Snowflake).
- Experience working in Agile/Scrum environments.
- Strong analytical and problem-solving skills with attention to detail.
What you’ll love about working here
- We recognise the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance.
- At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.
- Equip yourself with valuable certifications in the latest technologies such as AWS and Microsoft Azure.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.