09 Sep
|
Tata Consultancy Services
|
Bengaluru
09 Sep
Tata Consultancy Services
Bengaluru
TCS Hiring for Pyspark Developer
Experience Range: - 05 To 10 Years (Mandatory)
(Note: Candidates below 5 years of IT experience shall not be considered)
Job Locations : Bengaluru, Chennai, Hyderabad, Pune, Kolkata
JOB DESCRIPTION
Job Requirements:
- Experience with robust proficiency in Python and PySpark.
- Experience working on Spark SQL, RDD, and DataFrame APIs.
- Good understanding of Hadoop ecosystem (Hive, HDFS, YARN).
- Knowledge of data formats like Parquet, Avro, JSON, etc.
- Experience with SQL and writing efficient queries.
- Familiarity with job orchestration tools (Airflow, Oozie, or similar).
- Version control systems like Git.
- Exposure to cloud platforms (AWS/GCP/Azure) is a plus.
Key responsibilities:
- Design, develop, and maintain robust ETL/ELT pipelines using PySpark and other big data technologies. Optimize Spark jobs for performance and scalability.
- Implement data transformations, aggregations, and joins over large datasets. Perform batch and real-time data processing tasks.
- Collaborate with data scientists, analysts,
and other engineers to understand requirements and deliver quality solutions. Integrate PySpark solutions with data warehouses (like Hive, Redshift, Snowflake) and other data stores.
- Write clean, maintainable, and well-documented code. Follow version control and CI/CD practices using tools like Git, Jenkins, or Azure DevOps.
- Troubleshoot data quality and performance issues. Monitor pipeline health and ensure SLAs are met.
- Work with tools and platforms like Hadoop, Hive, HDFS, AWS EMR, Databricks, or Azure Synapse as required.
Minimum Qualification:
15 years of Full Time Education
Interested candidates kindly share your updated resume to
[email protected] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:
Section 1: Basic Details:
- Candidate Name:
- Email ID:
- Phone Number:
- Current Location (City):
- Preferred Location (City):
Sec
📌 Pyspark Developer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru