Apply Now

Role Descriptions: Sr. Databricks LeadJob role and Responsibilities A Sr. Databricks Developer designs| builds| and optimizes big data ETLELT pipelines using PySpark| SQL| and Delta Lake within cloud environments (Azure| AWS| or GCP). Key ResponsibilitiesKey responsibilities include creating scalable data solutions| optimizing Spark jobs| and managing data workflows to support analytics. Required skills include proficiency in PythonSQL| Spark| and experience with data warehousing concepts. Pipeline Development Design| develop| and maintain robust| scalable ETLELT data pipelines using Databricks and PySpark.Data Processing Work with structured and unstructured data| utilizing Delta Lake for efficient storage and management.Optimization Perform performance tuning and optimization on Databricks clusters and Spark jobs for cost-efficiency.Orchestration Use tools like Azure Data Factory (ADF) or Airflow for workflow orchestration and scheduling.Integration Integrate Databricks with cloud data sources (Azure Data Lake Gen2| S3) and BI tools.Data Quality  Security Implement data quality checks| validation| and security protocols. Required Skills  QualificationsTechnical Skills Expert-level knowledge of PySpark| Apache Spark| and SQL.Cloud Platforms Hands-on experience with Azure Databricks (most common)| AWS Databricks| or GCP.Data Engineering Strong understanding of Data Modeling| ETLELT patterns| and Data Warehousing https://urldefense.proofpoint.com/v2/url?u=http-3A__concepts.Tools&d=DwIGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=uPVyrU0-wRkYMC7tELyR3Z2KXITAdfezxPfpSF43vug&m=lhnYUic8CjFamf9Sld-EexTIMzJ4OmfoqWz4HZrskj0jiVVL2ekHvnPH4bLgnPZ4&s=PpyhbIcdqWt4I2TZcMiBGmBT-S2KUoHUiHt4IQlKsgc&e=  Languages Python| Azure Data Factory (ADF)| Delta Lake| GitAzure DevOps.Experience 6-8 years of experience in data engineering or software development.
Essential Skills: Sr. Databricks LeadJob role and Responsibilities A Sr. Databricks Developer designs| builds| and optimizes big data ETLELT pipelines using PySpark| SQL| and Delta Lake within cloud environments (Azure| AWS| or GCP). Key ResponsibilitiesKey responsibilities include creating scalable data solutions| optimizing Spark jobs| and managing data workflows to support analytics. Required skills include proficiency in PythonSQL| Spark| and experience with data warehousing concepts. Pipeline Development Design| develop| and maintain robust| scalable ETLELT data pipelines using Databricks and PySpark.Data Processing Work with structured and unstructured data| utilizing Delta Lake for efficient storage and management.Optimization Perform performance tuning and optimization on Databricks clusters and Spark jobs for cost-efficiency.Orchestration Use tools like Azure Data Factory (ADF) or Airflow for workflow orchestration and scheduling.Integration Integrate Databricks with cloud data sources (Azure Data Lake Gen2| S3) and BI tools.Data Quality  Security Implement data quality checks| validation| and security protocols. Required Skills  QualificationsTechnical Skills Expert-level knowledge of PySpark| Apache Spark| and SQL.Cloud Platforms Hands-on experience with Azure Databricks (most common)| AWS Databricks| or GCP.Data Engineering Strong understanding of Data Modeling| ETLELT patterns| and Data Warehousing https://urldefense.proofpoint.com/v2/url?u=http-3A__concepts.Tools&d=DwIGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=uPVyrU0-wRkYMC7tELyR3Z2KXITAdfezxPfpSF43vug&m=lhnYUic8CjFamf9Sld-EexTIMzJ4OmfoqWz4HZrskj0jiVVL2ekHvnPH4bLgnPZ4&s=PpyhbIcdqWt4I2TZcMiBGmBT-S2KUoHUiHt4IQlKsgc&e=  Languages Python| Azure Data Factory (ADF)| Delta Lake| GitAzure DevOps.Experience 6-8 years of experience in data engineering or software development.
Desirable Skills:
Keyword:
Skills: Digital : Databricks
Experience Required: 8-10