12 Aug
|
Tata Consultancy Services
|
Hyderabad
12 Aug
Tata Consultancy Services
Hyderabad
Role: PySpark Developer Experience: 4-8 yrs location: Chennai / Kolkata / Hyderabad / Pune Responsibility: 1. 4+ years of experience in data engineering, with strong focus on PySpark/python for big data processing.
- Expertise in building data pipelines and ingestion frameworks from relational, semi-structured (JSON, XML), and unstructured sources (logs, PDFs).
- Proficiency in Python with strong knowledge of data processing libraries.
- Robust SQL skills for querying and validating data in platforms like Amazon Redshift, PostgreSQL, or similar.
5.
Experience with distributed computing frameworks (e.g., Spark on EMR, Databricks).
- Familiarity with workflow orchestration tools (e.g., AWS Step Functions, or similar). Solid understanding of data lake / data warehouse architectures and data modeling basics.
📌 PySpark Developer (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad