06 Sep
|
Trigent Software
|
Bengaluru
06 Sep
Trigent Software
Bengaluru
Job Summary:
We are seeking a highly skilled and experienced Data Engineer with robust expertise in AWS services, PySpark, EMR and SQL. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines and analytics solutions in a cloud-native environment.
Key Responsibilities:
• Design and implement scalable data pipelines using AWS services (EMR, S3, Lambda, Glue, etc.)
• Develop and optimize PySpark scripts for large-scale data processing.
• Manage and monitor AWS EMR clusters for performance and cost efficiency.
• Integrate and manage data in Snowflake and PostgreSQL databases.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Ensure data quality, integrity, and security across all stages of the pipeline.
• Automate workflows and implement CI/CD for data engineering solutions.
• Troubleshoot and resolve issues related to data ingestion, transformation, and storage
📌 AWS Data Engineer (Bengaluru)
🏢 Trigent Software
📍 Bengaluru