02 Oct
|
Persistent Systems
|
Pune
02 Oct
Persistent Systems
Pune
About Position:
We are seeking a highly skilled Data Engineer with strong expertise in Azure, Databricks, SQL, Python, and Generative AI technologies. The ideal candidate will be responsible for designing, developing, and optimizing scalable enterprise data platforms that support business intelligence, advanced analytics, AI/ML initiatives, and data-driven decision-making.
• Role: Data Engineer-LLM
• Location: All Persistent Locations
• Experience: 8 to 12 Years
• Job Type: Full time Employment
What You'll Do:
• Design, develop, and maintain scalable data pipelines and integration frameworks across cloud-based data platforms.
• Build and optimize enterprise data warehouses, data lakes, and modern data lakehouse architectures.
• Develop and support ETL/ELT pipelines for ingesting, transforming, and processing large-scale structured and unstructured datasets.
• Implement data engineering solutions using Azure Databricks, Spark, Python, and SQL.
• Support AI/ML and Generative AI initiatives through feature engineering, data preparation, and scalable data platform development.
• Collaborate with business stakeholders, analytics teams, and data scientists to deliver reliable and business-ready data products.
• Ensure data quality, governance, security, integrity, scalability, and availability across enterprise platforms.
• Optimize data processing workloads and improve platform performance through automation and monitoring.
• Build and maintain reusable data engineering frameworks and best practices.
• Participate in architecture discussions and contribute to data platform modernization initiatives.
• Support cloud migration, data integration, and platform optimization programs.
• Implement CI/CD processes, DevOps practices, and automation for data engineering solutions.
• Troubleshoot production issues and perform root cause analysis for data platform and pipeline failures.-native technologies and modern data platform architectures.
Expertise You'll Bring:
• 8-12
📌 Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune