Responsibilities:
Partner closely with business to understand problems, shape requirements, and define data solutions with explicit
outcomes.
Lead and mentor the data engineering team, driving engineering best practices and delivery excellence.
Provide technical leadership across architecture, development, troubleshooting, and delivery to drive execution speed
and quality.
Collaborate with Data Architects, Data Scientists, and Product Owners to enable business adoption of AI and advanced
analyticsdriven decision making.
Drive innovation and continuous improvement by challenging existing processes and proposing new solutions.
Maintain and evolve the data platform for business reporting and AI workloads.
Partner with Data Product Owners to define clear technical designs and execution plans aligned with business
outcomes.
Design and maintain scalable data ingestion frameworks supporting both batch and streaming use cases.

Experience & Skills:
10 years of experience in Data & Analytics, including hands-on experience with Azure data engineering technologies.




Strong hands-on experience with Python, SQL, and PySpark.
Strong understanding of Databricks Unity Catalog for data governance and security, along with CI/CD using DevOps.
Experience in designing scalable, secure data architectures and building AI-ready data platforms.
Proven ability to work with business and technical stakeholders to gather requirements and translate them into high-
impact data solutions.
Strong sense of ownership, accountability, and execution discipline across multiple initiatives.
Excellent communication skills, with the ability to handle high-impact business stakeholder interactions effectively.

EXPERTISE AND QUALIFICATIONS
Mandatory Skillset:
Recent 8+ years of experience in Azure services/tools

ADF Pipelines
Pyspark

ETL
SQL
PySpark.
Databricks Unity Catalog for data governance and security
Strong sense of ownership, accountability, and execution discipline across multiple initiatives.

📌 Principal Senior Data Engineer Databricks (Hyderabad)
🏢 Crescendo Global Leadership Hiring India
📍 Hyderabad