03 Aug
|
Innova Solutions
|
Telangana
03 Aug
Innova Solutions
Telangana
Role - Data Engineer
Location Hyderabad /chennai/Noida/pune,Bangalore- IndiaAbout the
Specialization :
Valuable to have : AWS - RedShift
Key Responsibilities :
We are seeking a highly skilled Data Engineer with solid expertise in Amazon Redshift, Apache Airflow, and Python, with a primary focus on query tuning, performance optimization, and scalable data pipeline development. The ideal candidate will have hands-on experience working with large-scale datasets (10M+ records) and possess excellent communication skills to collaborate effectively with cross-functional teams.
Key Responsibilities
Design, develop, and maintain scalable and reliable data pipelines using Python and Apache Airflow.
Optimize and tune complex SQL queries in Amazon Redshift to improve performance, scalability, and cost efficiency.
Process and manage large-scale datasets (10M+ records) while ensuring data accuracy, integrity, and high performance.
Build, enhance,
and maintain robust ETL/ELT workflows for structured and semi-structured data sources.
Monitor data pipeline performance, identify bottlenecks, and troubleshoot production issues proactively.
Implement data modeling, partitioning, indexing, and query optimization best practices.
Collaborate with Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand and deliver data requirements.
Ensure adherence to data quality, governance, security, and documentation standards across all data processes.
Support performance monitoring, capacity planning, and continuous improvement initiatives within the data platform.
Develop and maintain technical documentation for data workflows, architectures, and operational procedures.
📌 Data Engineer Aws Redshift, Python, Airflow Telangana
🏢 Innova Solutions
📍 Telangana