Job Role: Senior Data Engineer – PySpark / Apache Spark

Experience: 8+ years

Location: All Publicis Sapient locations

Role Overview
Robust hands-on experience in PySpark and Apache Spark.
Independently support Spark job validation, testing, and debugging.
Guide client teams on effective job validation techniques and best practices.
Build and support large-scale batch and real-time data pipelines.
Optimize Spark jobs, performance, and data quality.
Handle client communication and data transformation requirements.

Must-Have Skills:
PySpark and Apache Spark — solid hands-on experience.
AWS: S3, Glue, Aurora, Databricks.
ETL/ELT pipeline development.
Solid SQL and Python skills.
Data modeling and database design.
Data migration from legacy systems.
Job validation, testing, debugging, and performance optimization.

Good-to-Have Skills:
API development and third-party data integration.
Redis or in-memory databases.
AWS Lambda, IAM, Step Functions, CloudWatch.
Infrastructure as Code and CI/CD pipelines.
Agile methodology and AWS certifications.

📌 Senior Data Engineer – Pyspark / Apache Spark Noida (India)
🏢 Innova ESI
📍 India