12 Nov
|
Trigent Software
|
India
12 Nov
Trigent Software
India
Role Overview:
We are looking for a skilled Data Engineer with experience in AWS, Apache Spark, Python, and CI/CD pipelines to build, optimize, and maintain scalable data pipelines.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Process and transform large datasets using Python and Apache Spark.
- Build and manage cloud-based data solutions using AWS services.
- Implement CI/CD pipelines for automated testing and deployment.
- Optimize data processing performance, reliability, and quality.
Required Skills:
- Robust proficiency in Python and SQL.
- Hands-on experience with Apache Spark and PySpark.
- Experience with AWS data services such as S3, Glue, and EMR.
- Knowledge of CI/CD tools and DevOps best practices.
- Understanding of data warehousing, ETL processes, and distributed computing.
📌 Data Engineer (India)
🏢 Trigent Software
📍 India