Software Engineer
Capgemini
Job Description
- 5-8 years of proven experience as ETL (Extract Transform and Load) Developer.
- Strong experience in Python programming language.
- Extensive experience with SQL, NoSQL technologies like mongoDB, Time Series DB, AWS DynamoDB
- Understands evolution of databases for in-memory, SQL, NoSQL & indexing technologies along with experience on real-time & stream processing systems like AWS streaming technologies, Spark Streaming, Kafka.
- Good experience in AWS with enterprise implementations including expertise with services such as AWS Batch Processing, Glue, Spark Processing, S3, Data/ML Pipeline, EMR
- Strong Experience on REST APIs for creating and managing data integration job.
- DevOps experience using tools like Jira, Github, Jenkins and CICD pipelines
- Experience on various AWS cloud services: CloudWatch, lambda, ECS, Kinesis, Compute, Storage, Database Services
- Experience with AWS Core services SNS, SQS etc. is a plus.
- Good to have experience on Distributed computing services like Databricks, Pyspark, Delta Lakes Ecosystem
- Good to have experience on Nodejs/Typescript, ReactJS, GraphQL interfaces
- Experience using monitoring solutions like Datadog, Grafana and Prometheus
- Access Control Automation - Unity Catalogue, AWS Lake Formation
- Understanding of Kubeflow, Kubernetes