09 Oct
|
TRIGENT SOFTWARE PRIVATE
|
India
09 Oct
TRIGENT SOFTWARE PRIVATE
India
Role Overview:
We are looking for a skilled Data Engineer with experience in AWS, Apache Spark, Python, and CI/CD pipelines to build, optimize, and maintain scalable data pipelines.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Process and transform large datasets using Python and Apache Spark.
- Build and manage cloud-based data solutions using AWS services.
- Implement CI/CD pipelines for automated testing and deployment.
- Optimize data processing performance, reliability, and quality.
Required Skills:
- Solid proficiency in Python and SQL.
- Hands-on experience with Apache Spark and PySpark.
- Experience with AWS data services such as S3, Glue, and EMR.
- Knowledge of CI/CD tools and Dev Ops best practices.
- Understanding of data warehousing, ETL processes, and distributed computing.
📌 Data Engineer (India)
🏢 TRIGENT SOFTWARE PRIVATE
📍 India