Job Title: Cloud Data Engineer
Experience: 5+ Years
We are looking for an experienced Cloud Data Engineer with strong hands-on experience in Databricks, AWS, data lake architecture, SQL/PL-SQL, and data engineering.
The role will focus on supporting data warehouse migration and consolidation, developing scalable data lake solutions, reverse-engineering legacy data processes, and building up-to-date data pipelines using AWS S3, Databricks, Spark SQL, and Delta Lake.
Key Responsibilities
- Analyze and understand existing data warehouse implementations to support migration and consolidation initiatives.
- Reverse-engineer legacy PL/SQL and SQL stored procedures and translate business logic into scalable Spark SQL code within Databricks.
- Design and develop data lake solutions on AWS using S3 and Delta Lake.
- Build and maintain data pipelines using ETL tools, with ingestion into S3 and processing/transformation in Databricks.
- Work with data architects to implement standardized ingestion and transformation frameworks.
- Evaluate and optimize data models including Star, Snowflake, and Flattened models.
- Optimize data solutions for performance, scalability, and maintainability.
- Document ETL processes, data flows, mappings, and transformation logic.
- Perform data administration activities including job scheduling, error troubleshooting, performance tuning, and backup coordination.
- Work with cross-functional teams to support the migration and integration of data sources into a unified platform.
- Triage, debug,
and resolve technical issues related to data lake and data processing environments.
- Maintain and manage code repositories using Git.
- Participate in Agile ceremonies including sprint planning, retrospectives, backlog grooming, and daily stand-ups.
- Contribute to iterative development and continuous improvement of data engineering solutions.
Required Skills
- 5+ years of experience working with Databricks.
- Strong experience with Spark SQL and Delta Lake.
- 3+ years of experience designing and implementing data lake architectures using Databricks.
- Strong SQL and PL/SQL skills.
- Ability to understand, reverse-engineer, and refactor legacy stored procedures.
- Hands-on experience with data modeling and data warehouse design principles.
- Proficiency in at least one programming language: Python, Scala, or Java.
- Strong understanding of AWS data services, particularly S3.
- Experience working with ETL/data pipelines and modern data engineering practices.
- Experience working in Agile development environments.
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
Good to Have
- Databricks certification.
- Exposure to enterprise data governance.
- Knowledge of metadata management practices.
- Experience with large-scale data migration or consolidation projects.
- Experience with cloud-based data platforms and modern data lake architectures.
Interested candidates can share their updated resume at
[email protected]. Pay: ₹1,000,000.00 - ₹2,500,000.00 per year
Work Location: Hybrid remote in Hyderabad, Telangana
📌 Cloud Data Engineer (Hyderabad)
🏢 Spasnik Solutions
📍 Hyderabad