14 Nov
|
Brace Infotech Private
|
Hyderabad
14 Nov
Brace Infotech Private
Hyderabad
Please find the detailed
Job Description
for the Data Engineering Lead position. Kindly prioritize candidates with strong hands-on experience in Microsoft Fabric, SSIS, ETL/ELT, Python, PySpark, and Data Migration. Looking forward to your support in closing this requirement at the earliest. Position: Data Engineering Lead
Experience:
6-8 Years
Location:
Hyderabad, Telangana Mode: C2H / Permanent
About The Role
We are seeking an experienced Data Engineering Lead to design, develop, and lead enterprise-scale data integration, migration, and analytics initiatives. The ideal candidate will have strong expertise in Microsoft Fabric , SSIS , ETL development , Data Engineering , and Data Migration , along with hands-on experience in Python/PySpark . The candidate will be responsible for driving data platform modernization efforts, mentoring team members, and ensuring the delivery of high-quality, scalable data solutions.
Key Responsibilities
- Lead the design, development, and implementation of end-to-end data engineering solutions.
- Develop and maintain scalable ETL/ELT pipelines using SSIS, Microsoft Fabric, PySpark, and Python.
- Drive data migration initiatives from legacy systems to modern cloud-based data platforms.
- Design and implement data ingestion, transformation, cleansing, and validation processes.
- Build and optimize data warehouses, data marts, and lakehouse architectures.
- Collaborate with business stakeholders, architects, and cross-functional teams to understand data requirements and translate them into technical solutions.
- Ensure data quality, reliability, security, and governance standards are met.
- Monitor and optimize data pipeline performance, scalability, and cost efficiency.
- Lead code reviews,
technical design discussions, and best practice adoption across the team.
- Provide technical guidance and mentoring to junior and mid-level data engineers.
- Participate in effort estimation, sprint planning, and release management activities. Mandatory Skills
- Solid experience in Data Engineering with 6-8 years of overall IT experience.
- Hands-on expertise in Microsoft Fabric and Fabric Data Engineering components.
- Strong exposure to SSIS (SQL Server Integration Services), SSAS (SQL Server Analytical Services).
- Extensive experience in designing and developing ETL/ELT pipelines.
- Experience in large-scale Data Migration projects.
- Proficiency in Python and PySpark for data processing and transformation.
- Familiarity with CI/CD pipelines using Azure DevOps.
- Experience in cloud migration and modernization projects.
- Familiarity with Git-based source control and branching strategies.
- Strong SQL skills with experience in performance tuning and query optimization.
- Experience working with large datasets and complex data transformation frameworks.
- Understanding of data warehousing concepts, dimensional modeling, and data architecture principles.
- Experience working in Agile/Scrum environments. Good-to-Have Skills
- Experience with Azure Data Factory (ADF).
- Exposure to Azure Synapse Analytics.
- Experience with Microsoft Fabric Lakehouse, Dataflows Gen2, and Notebooks.
- Knowledge of Delta Lake, Apache Spark, and Databricks.
- Experience with Power BI reporting and semantic models.
- Knowledge of data governance and data quality frameworks.
- Exposure to real-time data processing and streaming technologies.
- Certifications in Microsoft Azure Data Engineering or Microsoft Fabric.
📌 Data Engineering Lead (Hyderabad)
🏢 Brace Infotech Private
📍 Hyderabad