Hiring for a MNC - client
Hyderabad and Bengaluru
3- 7 years experience

Software Development Engineer (SDE) – Data Engineering & Data LakeExperience: 4–8 Years
Employment Type: Full-Time
Role: Software Development Engineer – Data Engineering
About the RoleWe are looking for a hands-on Software Development Engineer (SDE) with strong experience in Data Engineering, Data Lakes and large-scale data migration. The ideal candidate should have strong programming and SQL fundamentals, practical experience with Apache Spark/PySpark, and a proven track record of working on data migration, reconciliation, validation and data quality initiatives.
The role involves designing, developing and optimizing scalable data pipelines and supporting data lake/lakehouse migration initiatives.
Key Responsibilities• Design, develop and maintain scalable data engineering pipelines and data lake solutions.
• Develop complex and optimized SQL queries for large datasets.
• Build and maintain data processing applications using Python or Java and Apache Spark/PySpark.




• Work on data migration and data lake migration projects, including source-to-target mapping and migration validation.
• Perform data reconciliation, validation and data quality checks across source and target systems.
• Implement SCD Type 2 and temporal data models for historical data management.
• Work with large-scale datasets in distributed data environments.
• Design solutions involving partitioning, clustering and performance optimization.
• Work with Snowflake, Hadoop/HDFS/Hive and up-to-date lakehouse technologies.
• Work with Apache Iceberg and lakehouse architectures.
• Handle structured and semi-structured data formats including Parquet, Avro and JSON.
• Support schema evolution and changes in data structures.
• Participate in CI/CD processes for data engineering applications.
• Troubleshoot performance, data quality and pipeline issues.
• Collaborate with data architects, developers, QA teams and business stakeholders.

Man

📌 SDE- Data Engineer (Hyderabad)
🏢 Magneton Technologies
📍 Hyderabad