| Job Description: |
Primary Responsibilities
Design, develop, and maintain ETL frameworks
Build and optimize data pipelines using:
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Architect scalable and efficient data integration solutions
Essential Skills
Strong expertise in:
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Experience in architecting ETL frameworks
Experience Required
4–6 years of experience in Data Engineering
Desirable Skills
3–5 years of experience in Data Analysis
Strong knowledge of:
SQL and data querying tools (SQL Developer, TOAD)
Azure Big Data technologies
Data mapping and reporting
Understanding of:
Data management methodologies and systems
ETL processes and data warehousing concept
Technical & Functional Skills
Experience with tools and platforms:
MySQL
PySpark
MS Office
Jira / Confluence (Agile tools)
Familiarity with:
Data encryption
Logging & monitoring
Security tools
Ability to read and understand architecture and network documentation
Soft Skills
Strong analytical and problem-solving skills
Effective oral and written communication
Ability to work independently and within a team
Strong organizational and prioritization skills
Capability to manage multiple deadlines
Sound decision-making and judgment
Ability to handle confidential information with discretion
Strong collaboration and relationship-building skills
Ability to identify, assess, and escalate risks/issues
|
