Data Engineer

Experience: 6–10 Years
Location: Bengaluru (Preferred)
Openings: 1

Job Description

We are looking for an experienced Data Engineer with strong expertise in DBT Cloud, Apache Airflow, and GCP BigQuery . The ideal candidate should have hands-on experience in designing scalable data pipelines, implementing modern data transformation frameworks, and orchestrating complex workflows. Experience in the Investment Management domain is preferred but not mandatory.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using DBT Cloud and Apache Airflow.
• Build and optimize data transformation models in DBT using Macros, Snapshots, Tests, Hooks, and Seeds.
• Develop and manage workflow orchestration using Airflow DAGs, Operators, Sensors, and dynamic task generation.
• Work with GCP BigQuery for data storage, transformation, and optimization.
• Implement data quality checks and validation frameworks.
• Handle Slowly Changing Dimensions (SCD Type 2) and Late Arriving Data scenarios.
• Collaborate with cross-functional teams to deliver reliable and scalable data solutions.
• Troubleshoot production issues and optimize pipeline performance.

Required Skills

• DBT Cloud (Macros, Snapshots, Tests, Hooks, Seeds)
• Apache Airflow
• GCP BigQuery
• SQL
• Python
• Data Warehousing
• ETL/ELT Development

Preferred Skills

• Experience with File System (FS) integrations.
• Investment Management domain experience.
• Knowledge of modern Data Engineering best practices.