Senior Data Engineer / Azure Data Engineer

Job Summary:

As a Senior Data Engineer, you will play a pivotal role in designing and implementing data solutions on Microsoft Azure. Your expertise in data engineering will ensure the seamless flow of information that drives data-driven decision-making throughout the organization.

Key Responsibilities:

• Design, implement, and manage robust data solutions on Azure to support business operations.
• Develop and maintain efficient data pipelines leveraging Databricks for optimal performance.
• Ensure effective data storage and retrieval systems using Azure Storage and Data Lake.
• Automate infrastructure and application deployments with Ansible to enhance deployment speed and reliability.
• Write clean, maintainable code in Python to facilitate data manipulation and automation tasks.
• Collaborate with team members using Git and GitLab for version control and CI/CD to ensure smooth development processes.
• Gather and document business requirements through stakeholder interviews and workshops to align solutions with business needs.

Requirements:

• 8+ years of experience in data engineering or data analysis.
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proficient in deploying and managing services on Microsoft Azure cloud platform.
• Hands-on experience with Databricks for data processing and analytics workflows.
• Solid understanding of Azure Storage concepts and best practices.
• Strong programming skills in Python for data manipulation and automation.
• Excellent verbal and written communication skills to interact effectively with stakeholders and team members.

Preferred Qualifications:

• Experience in designing, implementing, and managing data lakes on Azure.
• Familiarity with Microsoft Fabric concepts and best practices.
• Proficiency in using Ansible for automation and configuration management, including YAML scripting.
• Experience with CI/CD pipelines using GitLab to streamline deployment processes.
• Strong analytical abilities to interpret data and provide actionable insights that support data-driven decision-making.

Location: Pune