Connecting people I'd hire with companies I'd work at

Matt Wallaert
Matt Wallaert
Want me to connect you? Sign up below. If you are hiring and would like me to consider your open roles, please email

Gen AI Engineer



Software Engineering, Data Science
United States
Posted on Tuesday, July 2, 2024

Job Title: Gen AI Engineer
Job location: New York, NY.

Job Role And Responsibility

  • This role requires versatility and expertise across a wide range of skills.
  • Someone with a unique background experience and an engineer at heart will fit into this role seamlessly.
  • The Generative AI team is comprised of a multiple multi-functional group that works in unison and ensures a sound move from our research activities to scalable solutions.
  • You will collaborate closely with our cloud security infrastructure enterprise architecture and data science team to conceive and implement crucial functionalities.
  • Responsibilities:
  • Design and build fault tolerant infrastructure to support the Generative AI Ref architecture RAG Summarization Agent etc.
  • Ensure code is delivered without vulnerabilities by enforcing engineering practices code scanning etc.
  • Build and maintain IAC terraform Cloud Formation CICD Jenkins scripts CodePipeline uDeploy GitHub Actions Partner with our shared service teams like Architecture Cloud Security etc to design and implement platform solutions.
  • Collaborate with the DS team to develop a self-service internal developer Generative AI platform.
  • Design and build the Data ingestion pipeline for Finetuning LLM Models Create templates.
  • Architecture As Code implementing Ref architecture application s topology Build a feedback system using HITL for Supervised finetuning.


  • Bachelor s degree in Computer Science Computer Engineering or a technical field 4 years of experience with AWS cloud.
  • At least 8 years of experience designing and building data intensive solutions using distributed computing.
  • 7 years building and shipping software and or platform infrastructure solutions for enterprises.
  • Experience with CI CD pipelines Automated Testing Automated Deployments Agile methodologies.
  • Unit Testing and Integration Testing Tools
  • Experience with building scalable serverless application real time batch on AWS stack Lambda step function.
  • Knowledge of distributed NoSQL database systems Experience with data engineering ETL technology and conversation UX is a plus.
  • Experience with HPCs vector embedding and Hybrid Semantic search technologies.
  • Experience with AWS OpenSearch Step Lambda Functions SageMaker API Gateways ECS Docker is a plus.
  • Proficiency in customization techniques across various stages of the RAG pipeline including model fine tuning retrieval re ranking and hierarchical navigable small world graph HNSW is a plus.
  • Strong proficiency in embeddings ANN KNN vector stores database optimization performance tuning.
  • Extensive programming experience with Python Java Experience with LLM orchestration frameworks like Langchain LlamaIndex etc.
  • Foundational understanding of Natural Language Processing and Deep Learning.
  • Experience with CI CD pipelines Automated Testing Automated Deployments Agile methodologies.
  • Unit Testing and Integration Testing tools Excellent problem-solving skills and the ability to work in a collaborative team environment.
  • Superb communication skills.

Life at Capgemini:

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs.
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave.
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching, and learning programs.
  • Employee Resource Groups.
  • Disaster Relief.

About Capgemini:
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, its clients to unlock the value of technology to address the entire breadth of their business needs trust Capgemini. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, and combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get the future you want |

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant

Salary Transparency:

Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to the highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $***** - $***** / yearly.

This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees.


No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.