DATA 部門 - Lead Data Engineer
Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Job Description
- Collaborate with users and project team on requirements and expectations
- Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
- Design and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of data
- Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
- Create scripts for test automation, CI/CD, data migrations, data validations
- Provide technical support for incident recovery
Job Description - Grade Specific
Experience:
- Minimum 3~6 years of working experience as developer or data engineer
Skills:
- Strong programming skills and has software development experience in Scala, Java or Python
- Deep understanding of distributed systems (Hadoop, Spark, etc.) and its optimization
- Experience in public cloud technologies, preferably Azure
- Good knowledge of Oracle database, MS-SQL Server, Linux, networking
- Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
- Understanding of design principles, coding standards and best practices
- Strong learning ability and problem-solving skills
- Excellent communication, presentation, and interpersonal skills
Preferable:
- Understanding of REST API, NoSQL, micro-services, ETL
- Hand-on experience with Cloud services is preferred
- Understanding of streaming data processing and change data capture is preferred
- Experience with BI tools is preferred
Language:
- Japanese: Business Level (Optional)
- English: Business Level
Personality:
- Detailed and precise, able to drive alone the design and development of complex system.
- Able to articulate technical aspects in an easy-to-understand way for non-developers
- Strong performer with focus on delivery, fast learning and able to apply his knowledge in various domains.
- Willing to learn new technologies and pick up challenging work
- Team player
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.