02 Sep
|
Persistent Systems
|
Pune
02 Sep
Persistent Systems
Pune
We are seeking an experienced Sr. Data Engineer/Data Engineer + GenAI to design, build, and optimize modern data platforms that enable enterprise-scale analytics, reporting, AI, and business intelligence initiatives. The ideal candidate will possess strong expertise in Databricks, Spark, Kafka, Python, SQL, and AWS data services, with the ability to architect scalable batch and real-time data processing solutions. This role requires collaboration with business and technology stakeholders to deliver reliable, secure, and high-quality data solutions while supporting healthcare data interoperability through FHIR standards and leveraging AI-powered engineering practices.
Role: Senior Data Engineer
Experience: 8 to 12 Years
Job Type: Full Time Employment
Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using contemporary data engineering practices.
Build and optimize data models to support reporting, analytics, machine learning, and AI workloads.
Develop and manage large-scale batch and real-time data processing solutions using Spark and Kafka/Kinesis.
Work extensively with AWS services including Glue, Redshift, Athena, and S3 to build cloud-native data solutions.
Implement and optimize data integration, transformation, and orchestration workflows.
Leverage Databricks to build scalable data engineering and analytics platforms.
Ensure data quality, governance, security, and compliance standards across enterprise data ecosystems.
Design and implement healthcare data integration and interoperability solutions using FHIR standards.
Monitor and optimize data pipeline performance, scalability, and reliability.
Support data migration, modernization, and cloud transformation initiatives.
Implement best practices for data architecture, metadata management, and data lifecycle management.
Mentor junior engineers and promote data engineering best practices across teams.
Utilize GitHub Copilot, Microsoft 365 Copilot, and approved AI tools to impro
📌 Data Engineer AI, Hybrid (Pune)
🏢 Persistent Systems
📍 Pune