Databricks Platform Architect Job at ClifyX, INC, New York, NY

  • ClifyX, INC
  • New York, NY

Job Description

Job Description

Job Description

Key Responsibilities
Platform Engineering & Architecture
" Design, implement, and maintain Databricks platform architecture to support enterprise-scale data workloads
" Establish best practices for workspace setup, cluster management, and job orchestration
" Optimize platform performance, scalability, and cost efficiency
" Define and enforce standards for data engineering and analytics workloads within Databricks
Developer Enablement
" Support development teams by providing guidance, documentation, and reusable frameworks
" Enable developers with CI/CD pipelines, automation, and deployment standards
" Troubleshoot and resolve platform-related issues impacting development teams
" Provide technical mentorship and onboarding support to engineers using Databricks
Governance, Security & Compliance
" Implement and manage data governance, access controls, and security models (Unity Catalog, RBAC, etc.)
" Ensure compliance with enterprise data policies and regulatory requirements
" Monitor and audit platform usage, access patterns, and data lineage
Integration & Ecosystem Management
" Integrate Databricks with cloud platforms (AWS/Azure/GCP), data lakes, and enterprise systems
" Manage connectivity with tools such as Power BI, APIs, data ingestion frameworks, and orchestration tools
" Support ingestion and processing frameworks (e.g., batch, streaming, Delta Lake)
Operational Excellence
" Monitor platform health, performance, and usage metrics
" Implement automation for provisioning, monitoring, and scaling
" Drive continuous improvements in platform reliability and developer experience

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
  • 5 years of experience in data engineering or platform engineering roles
  • 3 years of hands-on experience with Databricks (architecture, administration, or platform engineering)
  • Strong understanding of distributed data processing (Spark)
  • Experience with cloud platforms (Azure preferred, or AWS/GCP)
  • Knowledge of data lake architecture, Delta Lake, and modern data platforms
  • Experience implementing security, governance, and access control frameworks
  • Familiarity with CI/CD pipelines, DevOps practices, and infrastructure as code (Terraform, etc.)

Job Tags

Similar Jobs

PWCampbell

Branding Installer Job at PWCampbell

 ...Job Description Job Description We are seeking to add a Branding Installer to our Branded Environments team in Huntingdon Valley, PA . This team member must be hard working, communicative, hands on and motivated. Objectives of this Role Work with a collaborative... 

Chenega Corporation

Red Hat Linux System Administrator Job at Chenega Corporation

 ...Secret Service (USSS) status meetings to provide updates and gather requirements. Register for and allocate subscriptions from Red Hat Satellite services. Maintain Red Hat Satellite at current vendor-supported release levels. Ensure Red Hat Enterprise Linux servers... 

Manpower

Electrical Engineering Technician Job at Manpower

 ...Electrical Engineering Technician Our client, an industry leader in autonomous mobility, is seeking an Electrical Engineering Technician to join their team. As an Electrical Engineering Technician, you will be part of the Sensor Engineering department supporting the... 

Capital One

Manager, Digital Product Management - Commercial Bank CRM Transformation Job at Capital One

Manager, Digital Product Management - Commercial Bank CRM TransformationProduct Management at Capital One is a booming, vibrant craft that requires reimagining the status quo, finding value creation opportunities, and driving innovative and sustainable customer experiences... 

Randstad Digital

Agile Scrum Master Job at Randstad Digital

 ...Previous Banking experience required. - 5+ years on the ability to guide and coach one or more teams on Scrum practices and develop their understanding of Agile/Waterfall principles. - 5+ years on stakeholder management. Sets agenda and defines the artifacts needed...