Databricks Architect Job at Q1 Technologies, Inc, Aurora, IL

  • Q1 Technologies, Inc
  • Aurora, IL

Job Description

Job Description

Job Description

Databricks Architect - 14 years
Malvern PA
Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing.

Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning

  • What is the Databricks Lakehouse architecture, and how is it different from a traditional Data Warehouse?
  • What is Delta Lake, and what benefits do ACID transactions provide in Databricks?
  • How have you optimized Spark/Databricks jobs for performance and cost?
  • Can you explain the difference between Spark transformations and actions?
  • What is Unity Catalog, and how have you used it for data governance and security?
  • How would you design a real-time data ingestion pipeline in Databricks?
  • Look for: Kafka, Structured Streaming, Delta Live Tables.
  • What is your experience with AWS services integrated with Databricks?
  • Look for: S3, Glue Catalog, IAM, Redshift, Lambda.

Job Tags

Similar Jobs

City of Lemoore

Records Supervisor Job at City of Lemoore

 ...supervise, assign and review the work of staff responsible for police records services, activities, and operations; to oversee and...  ...records management according to established regulations. Modern office procedures, methods and computer equipment. Principles and procedures... 

Capital One

Senior Associate, Product Manager-Small Business Bank Job at Capital One

Product Management at Capital One is a booming, vibrant craft that requires reimagining the status quo, finding value creation opportunities...  ...our society and our industry.In the Small Business Bank, our customers are the lifeblood of the US economy, making up 9... 

Science Applications International Corporation

Scrum Master Job at Science Applications International Corporation

DescriptionSAIC is seeking experienced, results-oriented Scrum Master to support a high visibility data engineering environment. The candidate will contribute to and coordinate efforts supporting the customers strategic direction, daily operations, and Agile framework... 

Confidential

Warehouse Picker Packer - Now Hiring Job at Confidential

Do you have a knack for packaging quality and ensuring items arrive safely? We are hiring dedicated picker packers who excel at the final, crucial step of the supply chain. This role prioritizes the integrity and presentation of every shipment, offering a stable position... 

State of Massachusetts, USA

Assistant District Attorney / Records Access Officer, Public Records Unit Job at State of Massachusetts, USA

DescriptionPosition Title: Assistant District Attorney / Records Access Officer, Public Records UnitReports To: Second Assistant District Attorneys Supervises: Public Records Paralegal Summary:The Plymouth County District Attorneys Office (PCDAO) seeks a motivated, organized...