Job Title: Azure DevOps Engineer with Databricks
Experience Required: 5–10 years
Location: Hyderabad, Pune, Bangalore
Mode of Hire: Contractor / Permanent (Full-Time)
Primary Skills:
- Azure DevOps
- CI/CD Pipelines
- Databricks
- Data pipeline integration and automation
Role Overview
We are looking for an experienced Azure DevOps Engineer with a strong background in data engineering and CI/CD pipeline implementation. The ideal candidate will have hands-on experience in integrating data applications using Azure DevOps and Databricks, and will play a key role in streamlining development and deployment workflows.
Key Responsibilities
- Design, build, and maintain CI/CD pipelines for Azure Data Factory and Databricks notebooks
- Implement and manage DevOps practices for schema updates and data integration workflows
- Automate unit testing, integration testing, and QA workflows within Databricks
- Maintain infrastructure as code using tools such as Terraform or ARM templates
- Troubleshoot pipeline failures and resolve deployment issues across environments
- Collaborate with Data Engineers and Platform teams to manage development, staging, and production setups
- Ensure best practices are followed in configuration, security, and version control
Technical Requirements
- 5+ years of DevOps experience, with a focus on data pipelines
- Strong experience with Azure DevOps Pipelines, YAML builds, and release workflows
- Deep expertise in Databricks and Azure Data Factory (ADF)
- Proficiency in scripting languages such as Python and PowerShell
- Working knowledge of Azure services including ADLS Gen2, Key Vault, Azure DevOps (ADO), and DABs
- Solid understanding of data architecture and deployment automation in cloud environments
- Note: Candidates must have prior experience integrating data-related applications through CI/CD