11 Sep
|
Tata Consultancy Services
|
Bengaluru
11 Sep
Tata Consultancy Services
Bengaluru
Job Description
TCS Hiring for Pyspark Developer Experience Range: - 05 To 10 Years (Mandatory) (Note: Candidates below 5 years of IT experience shall not be considered) Job Locations : Bengaluru, Chennai, Hyderabad, Pune, Kolkata JOB DESCRIPTION Job Requirements: - Experience with strong proficiency in Python and PySpark. - Experience working on Spark SQL, RDD, and DataFrame APIs. - Positive understanding of Hadoop ecosystem (Hive, HDFS, YARN). - Knowledge of data formats like Parquet, Avro, JSON, etc. - Experience with SQL and writing efficient queries. - Familiarity with job orchestration tools (Airflow, Oozie, or similar). - Version control systems like Git. - Exposure to cloud platforms (AWS/GCP/Azure) is a plus. Key responsibilities: - Design, develop, and maintain robust ETL/ELT pipelines using PySpark and other big data technologies. Optimize Spark jobs for performance and scalability. - Implement data transformations, aggregations, and joins over large datasets. Perform batch and real-time data processing tasks. - Collaborate with data scientists, analysts, and other engineers to understand requirements and deliver quality solutions. Integrate PySpark solutions with data warehouses (like Hive, Redshift, Snowflake) and other data stores. - Write clean, maintainable, and well-documented code. Follow version control and CI/CD practices using tools like Git, Jenkins, or Azure DevOps. - Troubleshoot data quality and performance issues.
Monitor pipeline health and ensure SLAs are met. - Work with tools and platforms like Hadoop, Hive, HDFS, AWS EMR, Databricks, or Azure Synapse as required. Minimum Qualification: 15 years of Full Time Education Interested candidates kindly share your updated resume to
[email protected] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows: Section 1: Basic Details: - Candidate Name: - Email ID: - Phone Number: - Current Location (City): - Preferred Location (City): Section 2: Educational Details: - Highest Regular Full‑Time Qualification - (Diploma / Graduation / Post Graduation / Others) - 10th Completion Year - 12th / Intermediate Completion Year - Graduation Completion Year - Post‑Graduation Completion Year (if applicable) Section 3: Work Experience: - Current Company Name - Total Experience (in years) - Number of Companies Worked - Employment Timeline - (Example: Company A – 2021 to Present, Company B – 2019 to 2021) Section 4: Compensation Details: - Current CTC (in LPA) - Expected CTC (in LPA) - Notice Period - (Immediate / 15 Days / 30 Days / 60+ Days) Section 5: Documentation & Compliance (Yes / No): - Valid ID Proof Available (Aadhar & Pan Card): (Yes/No) - Educational Documents Available: (Yes/No) - Employment Documents Available: (Yes/No) - UAN Number Available: (Yes/No)
📌 Pyspark Developer (5 locations) (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru