Pyspark Developer (Bengaluru)

Pyspark Developer (Bengaluru)

20 Aug
|
Tata Consultancy Services
|
Bengaluru

20 Aug

Tata Consultancy Services

Bengaluru

TCS Hiring for Pyspark Developer

Experience Range: - 05 To 10 Years (Mandatory)
(Note: Candidates below 5 years of IT experience shall not be considered)
Job Locations : Bengaluru, Chennai, Hyderabad, Pune, Kolkata

JOB DESCRIPTION

Job Requirements:
Experience with strong proficiency in Python and PySpark.
Experience working on Spark SQL, RDD, and DataFrame APIs.
Valuable understanding of Hadoop ecosystem (Hive, HDFS, YARN).
Knowledge of data formats like Parquet, Avro, JSON, etc.
Experience with SQL and writing efficient queries.
Familiarity with job orchestration tools (Airflow, Oozie, or similar).
Version control systems like Git.
Exposure to cloud platforms (AWS/GCP/Azure) is a plus.

Key responsibilities:

Design, develop, and maintain robust ETL/ELT pipelines using PySpark and other big data technologies. Optimize Spark jobs for performance and scalability.
Implement data transformations, aggregations, and joins over large datasets. Perform batch and real-time data processing tasks.
Collaborate with data scientists, analysts,



and other engineers to understand requirements and deliver quality solutions. Integrate PySpark solutions with data warehouses (like Hive, Redshift, Snowflake) and other data stores.
Write clean, maintainable, and well-documented code. Follow version control and CI/CD practices using tools like Git, Jenkins, or Azure DevOps.
Troubleshoot data quality and performance issues. Monitor pipeline health and ensure SLAs are met.
Work with tools and platforms like Hadoop, Hive, HDFS, AWS EMR, Databricks, or Azure Synapse as required.

Minimum Qualification:
15 years of Full Time Education

Interested candidates kindly share your updated resume to [email protected] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:

Section 1: Basic Details:
Candidate Name:
Email ID:
Phone Number:
Current Location (City):
Preferred Location (City):

Section 2: Educational Details:
Highest Reg

📌 Pyspark Developer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: pyspark developer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: pyspark developer (bengaluru) / bengaluru