Responsibilities:
Data Processing: Design, develop, and maintain data processing solutions using PySpark, Apache Spark, and Python.
Data Pipeline Development: Develop and optimize data pipelines using PySpark, Apache Spark, and cloud-based data platforms.
Data Integration: Integrate data from various sources, including relational databases, NoSQL databases, and cloud storage.
Data Transformation: Develop and implement data transformation logic using PySpark, Apache Spark, and Python.
PySpark: knowledge of PySpark, Apache Spark, and Python.
Data Processing: understanding of data processing concepts, including data ingestion, data transformation, and data storage.
Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines
📌 Walk In Pyspark Data Engineer Chennai (India)
🏢 Tata Consultancy Services
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.