Databricks Engineer

Required Qualifications

• 6 years of experience in data engineering, big data, or cloud data platform roles.
• Hands-on experience with Apache Spark and Databricks (notebooks, workflows, jobs, clusters).
• Strong proficiency in PySpark, SQL, and data engineering fundamentals.
• Experience with Delta Lake, ACID transactions, schema evolution, and optimization techniques.
• Solid understanding of cloud platforms: Azure Databricks, AWS Databricks, or GCP Databricks.
• Experience with version control (Git), CI/CD, and DevOps practices.

Preferred Qualifications

• Databricks certifications (e.g., Databricks Data Engineer Associate/Professional).
• Experience with Unity Catalog, MLflow, or Databricks Model Serving.
• Knowledge of streaming technologies such as Kafka, EventHub, or Kinesis.
• Experience with workflow orchestration tools (Airflow, ADF, Glue, dbt).
• Knowledge of data quality frameworks like Great Expectations or Deequ.