Job Summary:
We are looking for an experienced Data Engineer with 5+ years of experience to design, develop, and maintain scalable data solutions. The ideal candidate should have expertise in building and optimizing data pipelines, working with cloud-based data platforms, and delivering high-quality data engineering solutions in an Agile setting.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
Build and optimize data engineering solutions for performance, scalability, and reliability.
Develop and maintain data integration processes across multiple systems.
Work with cloud-based data platforms and distributed computing frameworks.
Optimize data storage, processing, and database performance.
Collaborate with cross-functional teams to understand business requirements and deliver data solutions.
Troubleshoot and resolve complex data engineering issues.
Mentor junior team members and support technical decision-making.
Follow Agile development methodologies and software engineering best practices.
Mandatory Skills:
Data Engineering
Data Pipeline Development
ETL/ELT Development
Cloud Data Platforms (AWS/Azure/GCP)
SQL
Python or Scala
Distributed Computing Frameworks (Spark/PySpark preferred)
Database Management
Data Warehousing
Scripting and Automation
Preferred Skills
Apache Spark / PySpark
Airflow or other workflow orchestration tools
Big Data technologies
Performance tuning and optimization
CI/CD knowledge
Agile/Scrum methodology
.
📌 Data Engineer Hyderabad (India)
🏢 Experis
📍 India