29 Aug
|
Persistent Systems
|
Pune
29 Aug
Persistent Systems
Pune
About Position:
We are seeking a hands-on Data Engineer with 6 to 10 years of experience in Data Engineering, Data Warehousing, and Big Data development. The ideal candidate will have solid expertise in Azure cloud technologies, Databricks, SQL, Python, and modern data platform architectures. This role involves building scalable data pipelines, enabling analytics and AI/ML initiatives, and delivering reliable, high-performance data solutions that support enterprise business objectives.
Role: Data Engineer- LLM
Location: All Persistent Locations
Experience: 6 to 10 Years
Job Type: Full Time Employment
What You'll Do:
Design, develop, and maintain scalable ETL/ELT data pipelines and integration frameworks.
Build and optimize enterprise data warehouses, data lakes, and cloud-native data platforms.
Develop robust data processing solutions using Azure, Databricks, SQL, Python, and Spark.
Ensure data quality, integrity, availability, reliability, and performance across enterprise data environments.
Partner with analytics, AI/ML, reporting,
and business teams to deliver trusted data products.
Support AI/ML initiatives through feature engineering, data preparation, and pipeline development.
Work with Azure Data Factory, Synapse Analytics, Databricks, Snowflake, and related enterprise data platforms.
Implement data governance, metadata management, security, and compliance best practices.
Build monitoring, automation, and operational processes to improve platform reliability and efficiency.
Optimize data models, queries, and processing frameworks for performance and scalability.
Support structured and unstructured data processing across cloud-based data ecosystems.
Participate in Agile ceremonies and collaborate with cross-functional stakeholders.
Implement CI/CD pipelines, DevOps practices, Infrastructure as Code, and platform automation strategies.
Troubleshoot and resolve complex data platform, integration, and performance issues.
Contribute to data architecture decis
📌 Data Engineer- LLM (Pune)
🏢 Persistent Systems
📍 Pune