**Senior Data EngineerPermanent |**

We’re looking for an experienced **Senior Data Engineer** to join our growing team. In this role, you’ll work on building and scaling modern data platforms, leveraging cloud technologies to support analytics and machine learning use cases.

**About the Role**

You’ll be responsible for designing, building, and optimizing robust data pipelines that support both real-time and batch processing. Your work will help ensure reliable, high-quality data access across the organization.

**Key Responsibilities**

*   Design, build, and maintain scalable data pipelines using **PySpark and Python**
*   Develop and manage **ETL/ELT workflows**, ensuring data quality and reliability
*   Orchestrate workflows using **Apache Airflow**
*   Implement and manage **AWS services** (Lambda, Redshift, S3)
*   Manage infrastructure using **Terraform**
*   Build and maintain **CI/CD pipelines** with GitHub Actions
*   Optimize Spark jobs and troubleshoot performance issues

**Required Qualifications**

*   10+ years of experience in **Data Engineering**
*   Strong proficiency in **Python, PySpark, SQL, Spark, and Airflow**
*   Hands-on experience with **AWS cloud services** and **Terraform**

Senior Data Engineer

Job Description

Apply now

Athsai

RemoteITJobs.app