12 Sep
|
Thinkwise Consulting
|
Hyderabad
12 Sep
Thinkwise Consulting
Hyderabad
Job Description
Senior Data Engineer
nWe are hiring a Senior Data Engineer to design, develop, and optimize scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake.
nThe role involves building and maintaining data lakehouse and data warehouse solutions, developing high-performance data pipelines, enabling analytics and reporting, and contributing to data engineering best practices.
nStrong hands-on experience in PySpark, SQL, Python/Scala, and cloud data platforms is required.
nWhat You Will Do
nFollowing are the high-level responsibilities that you will play, but are not limited to:
n
- n
- Design, develop, and maintain scalable data pipelines, data models, and ETL/ELT processes.n
- Build and optimize data lake, lakehouse, and data warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.n
- Develop data processing solutions using PySpark, Python, Scala, and SQL.n
- Work with large and complex datasets to improve data processing performance, reliability, and scalability.n
- Develop and maintain batch and real-time data pipelines as required.n
- Implement data transformation, cleansing, validation, and integration processes.n
- Work with Delta Lake, Spark, Snowflake, Microsoft Fabric, and other up-to-date data engineering technologies.n
- Support business analytics and self-service reporting through Power BI and other visualization platforms.n
- Collaborate with data scientists, analysts, BI developers, and business stakeholders to deliver reliable data solutions.n
- Implement data quality, governance, security, and monitoring practices across data pipelines.n
- Troubleshoot and resolve data pipeline, performance, and production issues.n
- Contribute to the development of coding standards, reusable frameworks, and data engineering best practices.n
- Participate in code reviews and ensure high-quality, maintainable, and scalable solutions.n
- Implement CI/CD practices for data engineering
📌 Senior Data Engineer (Hyderabad)
🏢 Thinkwise Consulting
📍 Hyderabad