Job Description

The Data Platform Architect will be responsible for the end-to-end design, development, and management of scalable and secure data platforms. This role includes handling end-to-end platform solutions, from infrastructure design to data security and deployment.

Key Responsibilities:
• End-to-End Platform Solutions:
- Design, implement, and manage the entire lifecycle of the data platform, from infrastructure setup to the deployment of data services.
- Ensure that the platform meets business requirements and is scalable, secure, and cost-effective, providing an end-to-end solution for enterprise-wide data management needs.
- Oversee platform integration with enterprise applications, tools, and services while ensuring a seamless user experience.

• Platform Strategy & Architecture:
- Architect a robust and scalable data platform that supports data lakes, data warehouses, and real-time analytics solutions.
- Leverage Terraform for Infrastructure as Code (IaC) to automate infrastructure deployment and management processes.
- Align platform architecture with the overall enterprise data strategy and ensure it supports current and future data needs.

• Security & Landing Zone Implementation:
- Lead the implementation of data security best practices, including data encryption, access control, and auditing across the platform.
- Design and deploy secure landing zones in cloud environments (GCP, Azure) to ensure compliance with regulatory requirements and safeguard sensitive data.
- Implement security controls that monitor and protect data assets across both cloud and on-premise environments.

• Performance Optimization & Scalability:
- Monitor and enhance the performance and scalability of the data platform, ensuring minimal downtime and optimized resource utilization.
- Utilize Terraform scripting to automate infrastructure management and deployment, ensuring scalability and agility.
- Design and manage efficient data pipelines for large-scale datasets, focusing on batch and real-time data processing.

• Networking & Data Security:
- Use fundamental networking skills to ensure secure and reliable data communication across on-premise and cloud environments.
- Implement security mechanisms such as encryption, network isolation, and access controls to protect data throughout its lifecycle.
- Collaborate with security teams to ensure data platform complies with governance policies and industry regulations.

Qualifications

• 8+ years of experience in data architecture, platform engineering, or related fields, with a strong focus on designing and managing end-to-end platform solutions.
• Proven expertise in Terraform scripting, Infrastructure as Code (IaC), and cloud-based platforms (GCP, Azure).
• Solid experience in DevOps fundamentals and CI/CD pipeline implementation.
• Strong understanding of fundamental networking concepts (e.g., TCP/IP, DNS, VPNs, firewalls) for secure data transmission.

Technical Skills

• Expertise in Terraform scripting for automating infrastructure management.
• Strong knowledge of cloud platforms and services (e.g., GCP, Azure) and data technologies like Snowflake, Databricks, and Hadoop.
• Proficiency in DevOps tools such as Jenkins, Kubernetes, Docker, and CI/CD frameworks.
• In-depth understanding of data security best practices, including encryption, access control, and regulatory compliance.
• Experience designing and implementing secure landing zones for cloud platforms.