Role Descriptions: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance
Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka Hands on with AWS Kendra would be good
.Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tools
Essential Skills: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines
Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka
Hands on with AWS Kendra would be good.
Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tools
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : Amazon Web Service(AWS) Cloud Computing
Experience Required: 8-10 |
