Key Responsibilities
Design, develop, and optimize scalable data pipelines using Python.
Work extensively with Pandas and PySpark for data processing and transformation.
Build and maintain effective data engineering workflows.
Develop and manage Delta Tables and Parquet datasets for optimized data storage.
Improve data pipeline performance, scalability, and reliability.
Collaborate with cross-functional teams to deliver high-quality data solutions.
Ensure code quality through testing and best engineering practices.

Must-Have Skills
Robust proficiency in Python
Hands-on experience with Pandas and PySpark
Experience in Data Engineering and Workflow Optimization
Working knowledge of Delta Tables
Experience with Parquet file format
Robust problem-solving and debugging skills

Good-to-Have Skills
Experience with Databricks
Hands-on knowledge of Apache Spark
Experience with DBT (Data Build Tool)
Experience with Apache Airflow
Advanced Pandas performance optimization techniques
Knowledge of PyTest and DBT Testing Frameworks

📌 Python Data Engineer Pune
🏢 wissen technology
📍 Pune