Job Description – Databricks Engineer

Role: Databricks Engineer
Experience: 4–6 Years (Minimum 2+ years of hands-on Databricks experience)
Location: Hybrid / Remote (as per business requirement)
Employment Type: Full-Time

Job Summary

We are looking for a skilled Databricks Engineer with strong expertise in Databricks, PySpark, Python, SQL, and Delta Lake to build and optimize scalable data pipelines and Lakehouse solutions. The ideal candidate should have hands-on experience with Unity Catalog, Delta Live Tables (DLT), MLflow, and cloud platforms (Azure/AWS/GCP) .

Key Responsibilities

• Develop and optimize data pipelines using Databricks, PySpark, Python, and SQL .
• Design and maintain Delta Lake and Lakehouse architectures using Medallion (Bronze, Silver, Gold) layers.
• Configure and manage Databricks Workspaces, Clusters, Jobs, Workflows, and Unity Catalog .
• Build batch and streaming data pipelines with Delta Live Tables (DLT) and Spark.
• Integrate Databricks with cloud storage services such as ADLS, S3, or GCS .
• Optimize Spark performance, cluster utilization, and query execution.
• Implement CI/CD pipelines and follow data governance, security, and best practices.
• Collaborate with cross-functional teams to deliver scalable data engineering solutions.

Required Skills

• Databricks (2+ years hands-on)
• PySpark
• Python
• SQL
• Delta Lake & Delta Live Tables (DLT)
• Unity Catalog
• Azure/AWS/GCP Cloud
• Spark Performance Tuning

Good to Have

• MLflow
• dbt
• Apache Kafka
• Terraform
• Power BI / Tableau
• Databricks Certifications

Notice Period: Immediate to 30 Days Preferred.