| Job Description: |
Roles & Responsibilities
· Experience in generating data pipelines in Azure ADB
· Experience in ingesting data from different Sources using in Azure ADB
· Experience in transforming the data using Azure Databricks & Delta lake and Pyspark
· Experience in Azure DevOps CI/CD – Stories, Bugs, and Issue management
· Implement Integration solution in Microsoft Azure
· Performs data analysis required to troubleshoot data related issues and assist in the resolution
of data issues
· Experience working in agile development projects and sprint deliver
· Collaborate with cross-functional teams to elicit data requirements and architect effective
data pipelines.
· Perform data transformations and cleansing operations to ensure data accuracy and
consistency.
· Evolve existing scripts and notebooks to meet client needs.
· Monitor, troubleshoot, and optimize data pipelines for seamless functionality.
· Ensure data solutions align with security and compliance standards
· Work closely with data architects to harmonize data models with project objectives.
· Document programming efforts and processes, technical specifications, and best practices.
Role Descriptions: Azure Databricks
Essential Skills: Azure Databricks
Desirable Skills:
Keyword:
Skills: Digital : Databricks
Experience Required: 8-10 |
