01 Sep
|
Persistent Systems
|
Pune
01 Sep
Persistent Systems
Pune
About Position:
We are seeking a hands-on Data Engineer with 6 to 10 years of experience in Data Engineering, Data Warehousing, and Big Data development. The ideal candidate will have strong expertise in Azure cloud technologies, Databricks, SQL, Python, and up-to-date data platform architectures. This role involves building scalable data pipelines, enabling analytics and AI/ML initiatives, and delivering reliable, high-performance data solutions that support enterprise business objectives.
- Role: Data Engineer- LLM
- Location: All Persistent Locations
- Experience: 6 to 10 Years
- Job Type: Full Time Employment
What You'll Do:
- Design, develop, and maintain scalable ETL/ELT data pipelines and integration frameworks.
- Build and optimize enterprise data warehouses, data lakes, and cloud-native data platforms.
- Develop robust data processing solutions using Azure, Databricks, SQL, Python, and Spark.
- Ensure data quality, integrity, availability, reliability, and performance across enterprise data environments.
- Partner with analytics, AI/ML, reporting,
and business teams to deliver trusted data products.
- Support AI/ML initiatives through feature engineering, data preparation, and pipeline development.
- Work with Azure Data Factory, Synapse Analytics, Databricks, Snowflake, and related enterprise data platforms.
- Implement data governance, metadata management, security, and compliance best practices.
- Build monitoring, automation, and operational processes to improve platform reliability and efficiency.
- Optimize data models, queries, and processing frameworks for performance and scalability.
- Support structured and unstructured data processing across cloud-based data ecosystems.
- Participate in Agile ceremonies and collaborate with cross-functional stakeholders.
- Implement CI/CD pipelines, DevOps practices, Infrastructure as Code, and platform automation strategies.
- Troubleshoot and resolve complex data platform, integration, and performance issues.
- C
📌 Data Engineer- LLM (Pune)
🏢 Persistent Systems
📍 Pune