| Job Description: |
Detailed Job Description:
As Azure Data Engineer you will be responsible for building and managing data pipelines on Microsoft Azure, integrating, transforming, and loading data for analytics using services like Azure Data Factory, Databricks, and Synapse, requiring strong SQL, Python, and cloud skills for creating reliable, scalable data solutions for analysts and scientists. The field is shifting towards Microsoft Fabric, a unified data platform, and demands expertise in big data, data modeling, and cloud architecture.
Core Responsibilities:
• Build Data Pipelines: Design, develop, and maintain ETL/ELT processes to move and transform data.
• Data Transformation: Cleanse, map, and optimize data for analysis.
• Manage Data Stores: Work with data lakes, data warehouses (like Synapse), and databases.
• Automate Tasks: Deploy production code and automate data workflows.
• Collaborate: Support data scientists, analysts, and developers.
Key Skills & Technologies:
• Languages: SQL (essential for querying), Python (for scripting, PySpark).
• Azure Services: Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure Cosmos DB, Azure DevOps.
• Big Data: Apache Spark, DataBricks, Hadoop (foundational knowledge).
• Concepts: Data Warehousing, Data Modeling, ETL, CI/CD.
Minimum years of experience: 8+ years |
