10 Aug
|
Persistent Systems
|
Pune
10 Aug
Persistent Systems
Pune
About Position:
We are looking for a highly skilled AWS Data Engineer with strong expertise in AWS, Databricks, and PySpark to build and optimize scalable data platforms and AI-driven solutions. The ideal candidate will have extensive experience in designing modern data architectures, performance tuning, implementing MLOps practices, and leveraging Databricks Mosaic AI capabilities.
Role: Senior AWS Data Engineer
Location: All Persistent Location
Experience: 10+ Years
Job Type: Full-Time Employment
What You'll Do:
As a Senior AWS Data Engineer, you will be responsible for designing, developing, and optimizing enterprise-scale data solutions while enabling advanced AI/ML initiatives.
Design, develop, and maintain scalable data pipelines using AWS and Databricks.
Build and optimize ETL/ELT workflows using PySpark and Spark SQL.
Develop data solutions based on Lakehouse architecture and Delta Lake.
Perform Spark and Databricks performance tuning to improve processing efficiency and reduce costs.
Implement and maintain MLOps workflows for model deployment, monitoring,
and lifecycle management.
Leverage Databricks Mosaic AI capabilities for Generative AI and ML use cases.
Collaborate with Data Scientists, ML Engineers, Architects, and business stakeholders.
Ensure data quality, governance, security, and compliance standards are followed.
Automate data engineering processes using CI/CD pipelines and Infrastructure as Code.
Troubleshoot and resolve complex production issues across data platforms.
Expertise You'll Bring:
The ideal candidate should possess strong technical expertise in cloud-based data engineering, big data technologies, and AI/ML ecosystems.
10+ years of overall IT experience with strong Data Engineering background.
Hands-on experience with AWS services including S3, Glue, EMR, Lambda, Redshift, Athena, IAM, and Step Functions.
Extensive experience working with Databricks, Delta Lake, Unity Catalog, and Databricks Workflows.
Robust development experie
📌 Senior AWS Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune