Greetings from TCS TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 15 Years Job

Location:
Bangalore, Chennai, Hyderabad, Kolkata and Pune

Job description
• 4+ years of experience in data engineering, with strong focus on PySpark/Spark for big data processing.
• Expertise in building data pipelines and ingestion frameworks from relational, semi-structured (JSON, XML), and unstructured sources (logs, PDFs).
• Proficiency in Python with solid knowledge of data processing libraries.
• Strong SQL skills for querying and validating data in platforms like Amazon Redshift, PostgreSQL, or similar.
• Experience with distributed computing frameworks (e.g., Spark on EMR, Databricks).
• Familiarity with workflow orchestration tools (e.g., AWS Step Functions, or similar).




• Solid understanding of data lake / data warehouse architectures and data modeling basics. Expectations from the role:
• Design and build robust, scalable ETL/ELT pipelines using PySpark to ingest data from diverse sources (databases, logs, APIs, files).
• Transform and curate raw transactional and log data into analysis-ready datasets in the Data Hub and analytical data marts.
• Develop reusable and parameterized Spark jobs for batch and micro-batch processing.
• Optimize performance and scalability of PySpark jobs across large data volumes.
• Ensure data quality, consistency, lineage, and proper documentation across ingestion flows.
• Collaborate with Data Architects, Modelers, and Data Scientists to implement ingestion logic aligned with business needs. Thank you Bodhisatwa Ray

📌 Pyspark Developer (Chennai)
🏢 Tata Consultancy Services
📍 Chennai