Company Overview
Annex IT Solutions is one of the leading IT Placement & Service Providing Company in Canada. No previous IT background is required We Provide Training & Placement Assistance for those who want to build their career in IT field.
About the job
Overview:
We are seeking a highly skilled Databricks Developer with hands-on experience in the Databricks platform and Azure data ecosystem. The candidate should possess strong expertise in converting Microsoft SQL to Databricks SQL, managing CICD pipelines, and implementing release processes. Ideal candidates should have a solid background in big data technologies, excellent communication skills, and a collaborative mindset.
Responsibilities:
- Develop and optimize Databricks notebooks, clusters, and SQL scripts.
- Convert Microsoft SQL queries into Databricks SQL with high efficiency.
- Implement and manage CICD pipelines for release processing.
- Integrate and orchestrate workflows using Azure Data Factory (ADF) and Synapse.
- Leverage PySpark for large-scale data processing in a modern data lake environment.
- Collaborate with teams to address business challenges and propose innovative solutions.
- Document processes and maintain high-quality code and artifacts.
- Engage in troubleshooting, debugging, and optimizing data workflows.
- Provide subject matter expertise in capital markets and data management.
Qualifications:
Experience:
- 10-12 years of total experience in data engineering and development.
- Proven experience working on the Databricks platform, including SQL and PySpark.
- Strong background in Azure data services such as ADF and Synapse.
Technical Expertise:
- Exceptional hands-on skills with Databricks SQL, CICD pipelines, and release management.
- Proficiency in capital markets or financial services domains is a plus.
Soft Skills:
- Excellent written and verbal communication skills.
- Strong team player with a structured and analytical mindset.
- Self-motivated, results-driven, and open to innovative approaches.
How to Apply
APPLY