Job Role: Senior Data Engineer – PySpark / Apache Spark

Experience: 8+ years

Location: All Publicis Sapient locations

Role Overview

- Strong hands-on experience in PySpark and Apache Spark.
- Independently support Spark job validation, testing, and debugging.
- Guide client teams on effective job validation techniques and best practices.
- Build and support large-scale batch and real-time data pipelines.
- Optimize Spark jobs, performance, and data quality.
- Handle client communication and data transformation requirements.

Must-Have Skills:
- PySpark and Apache Spark — strong hands-on experience.
- AWS: S3, Glue, Aurora, Databricks.
- ETL/ELT pipeline development.
- Solid SQL and Python skills.
- Data modeling and database design.
- Data migration from legacy systems.
- Job validation, testing, debugging, and performance optimization.

Good-to-Have Skills:
- API development and third-party data integration.
- Redis or in-memory databases.
- AWS Lambda, IAM, Step Functions, CloudWatch.
- Infrastructure as Code and CI/CD pipelines.
- Agile methodology and AWS certifications.

📌 Senior Data Engineer – PySpark / Apache Spark (Noida)
🏢 Innova ESI
📍 Noida