Data Platform Architect

Job Description

The Data Platform Architect will be responsible for the end-to-end design, development, and management of scalable and secure data platforms. This role includes handling end-to-end platform solutions, from infrastructure design to data security and deployment.

• End-to-End Platform Solutions:
• Design, implement, and manage the entire lifecycle of the data platform, from infrastructure setup to the deployment of data services.
• Ensure that the platform meets business requirements and is scalable, secure, and cost-effective, providing an end-to-end solution for enterprise-wide data management needs.
• Oversee platform integration with enterprise applications, tools, and services while ensuring a seamless user experience.
• Platform Strategy & Architecture:
• Architect a robust and scalable data platform that supports data lakes, data warehouses, and real-time analytics solutions.
• Leverage Terraform for Infrastructure as Code (IaC) to automate infrastructure deployment and management processes.
• Align platform architecture with the overall enterprise data strategy and ensure it supports current and future data needs.
• Security & Landing Zone Implementation:
• Lead the implementation of data security best practices, including data encryption, access control, and auditing across the platform.
• Design and deploy secure landing zones in cloud environments (GCP, Azure) to ensure compliance with regulatory requirements and safeguard sensitive data.
• Implement security controls that monitor and protect data assets across both cloud and on-premise environments.
• Performance Optimization & Scalability:
• Monitor and enhance the performance and scalability of the data platform, ensuring minimal downtime and optimized resource utilization.
• Utilize Terraform scripting to automate infrastructure management and deployment, ensuring scalability and agility.
• Design and manage efficient data pipelines for large-scale datasets, focusing on batch and real-time data processing.
• Networking & Data Security:
• Use fundamental networking skills to ensure secure and reliable data communication across on-premise and cloud environments.
• Implement security mechanisms such as encryption, network isolation, and access controls to protect data throughout its lifecycle.
• Collaborate with security teams to ensure data platform complies with governance policies and industry regulations.

• 8+ years of experience in data architecture, platform engineering, or related fields, with a strong focus on designing and managing end-to-end platform solutions.
• Proven expertise in Terraform scripting, Infrastructure as Code (IaC), and cloud-based platforms (GCP, Azure).
• Solid experience in DevOps fundamentals and CI/CD pipeline implementation.
• Strong understanding of fundamental networking concepts (e.g., TCP/IP, DNS, VPNs, firewalls) for secure data transmission.

• Expertise in Terraform scripting for automating infrastructure management.
• Strong knowledge of cloud platforms and services (e.g., GCP, Azure) and data technologies like Snowflake, Databricks, and Hadoop.
• Proficiency in DevOps tools such as Jenkins, Kubernetes, Docker, and CI/CD frameworks.
• In-depth understanding of data security best practices, including encryption, access control, and regulatory compliance.
• Experience designing and implementing secure landing zones for cloud platforms.