Job Summary

IntelliCredence Pvt. Ltd. is looking for an experienced Lead Data Engineer / Data Platform Lead to design, build, and optimize scalable enterprise data platforms.

The ideal candidate should have strong hands-on experience with modern cloud data technologies such as Microsoft Fabric, Azure Databricks, Snowflake, Power BI, Python, PySpark, and SQL. The role requires a combination of technical expertise, data architecture knowledge, leadership capability, and experience delivering secure and high-performance data solutions.

The selected candidate will lead data engineering initiatives, define technical standards, mentor team members, and work closely with business stakeholders, analysts, and data science teams.

Key Responsibilities

- Lead the design, development, and implementation of scalable data pipelines, data models, and ETL/ELT processes.
- Architect and optimize enterprise data lake, lakehouse, and data warehouse solutions.
- Build modern data platforms using Microsoft Fabric, Databricks, Snowflake, or related cloud technologies.
- Design batch and real-time data-processing workflows.
- Develop and optimize complex SQL queries, stored procedures, and data-transformation logic.
- Enable business analytics and self-service reporting through Power BI and other visualization tools.
- Create efficient semantic models and datasets for enterprise reporting.
- Collaborate with data scientists, analysts, application teams, and business stakeholders to understand data requirements.
- Ensure reliability, scalability, performance, and availability of data solutions.
- Implement data-quality checks, governance standards, security controls, and access-management practices.
- Establish coding standards, architecture guidelines, documentation practices, and reusable frameworks.




- Implement CI/CD pipelines for data engineering and analytics solutions.
- Monitor and optimize data pipelines, Spark jobs, warehouse performance, and cloud-resource usage.
- Troubleshoot data-processing, integration, and performance-related issues.
- Mentor junior and mid-level data engineers and provide technical guidance to the team.
- Evaluate emerging technologies and recommend improvements to the existing data ecosystem.

Required Qualifications

- Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field.
- 7+ years of experience in data engineering, data platform development, or data architecture.
- At least 2-3 years of experience in a technical lead, data lead, or architect role.
- Strong hands-on experience with at least one of the following platforms:
- Microsoft Fabric
- Azure Databricks
- Snowflake

- Strong proficiency in SQL.
- Hands-on programming experience in Python, PySpark, or Scala.
- Experience designing ETL/ELT pipelines and large-scale data-processing solutions.
- Strong understanding of dimensional modelling, star schemas, data lakes, lakehouses, and data warehouses.
- Experience with cloud platforms such as Microsoft Azure, AWS, or GCP.
- Experience working with structured, semi-structured, and unstructured data.
- Knowledge of data governance, security, data quality, lineage, and access-control practices.
- Experience with CI/CD, Git, Azure DevOps, GitHub, or similar tools.
- Strong troubleshooting, performance-optimization, and problem-solving skills.
- Ability to lead technical discussions and communicate effectively with business and technical stakeholders.

Experience: 7+ Years
Employment Type: Full time
Position Level: Lead
Notice Period: Immediate joiners preferred

📌 Lead Data Engineer (Databricks / Microsoft Fabric) (Hyderabad)
🏢 Intellicredence
📍 Hyderabad