23 Oct
|
Innova ESI
|
Noida
Job Role: Senior Data Engineer – PySpark / Apache Spark
Experience:
8+ years
Location:
All Publicis Sapient locations Role Overview:
• Robust hands-on experience in PySpark and Apache Spark.
• Independently support Spark job validation, testing, and debugging.
• Guide client teams on effective job validation techniques and best practices.
• Build and support large-scale batch and real-time data pipelines.
• Optimize Spark jobs, performance, and data quality.
• Handle client communication and data transformation requirements. Must-Have
Skills:
• PySpark and Apache Spark — strong hands-on experience.
• AWS: S3, Glue, Aurora, Databricks.
• ETL/ELT pipeline development.
• Strong SQL and Python skills.
• Data modeling and database design.
• Data migration from legacy systems.
• Job validation, testing, debugging, and performance optimization. Good-to-Have
Skills:
• API development and third-party data integration.
• Redis or in-memory databases.
• AWS Lambda, IAM, Step Functions, CloudWatch.
• Infrastructure as Code and CI/CD pipelines.
• Agile methodology and AWS certifications.
📌 Senior Data Engineer – PySpark (Noida)
🏢 Innova ESI
📍 Noida