Experience: 6–10 Years
Engagement: Freelance / Project-Based
Location: Remote
We are looking for a Senior Data Engineer to develop and optimize scalable data pipelines supporting real-time streaming, enterprise data integration and large-scale analytics workloads.
Key Responsibilities
- Design and develop robust batch and real-time data pipelines
- Process high-volume IoT and event-driven datasets
- Build streaming pipelines using Kafka and related technologies
- Implement CDC and incremental data ingestion mechanisms
- Develop data transformation and processing workflows using Spark/PySpark
- Build and maintain cloud-based data lake/lakehouse platforms
- Implement schema evolution and data validation mechanisms
- Develop scalable ETL/ELT pipelines and orchestration workflows
- Implement data quality, lineage and pipeline observability
- Troubleshoot and optimize distributed data workloads
- Support highly available and fault-tolerant data pipelines
- Collaborate with Lead Engineers, Architects, DevOps and Data Science teams
Required Expertise
✅ 6–10 years of Data Engineering experience
✅ Solid Python and SQL
✅ Apache Spark / PySpark
✅ Kafka or equivalent streaming technology
✅ Experience with CDC and incremental processing
✅ Data Lake / Lakehouse technologies
✅ AWS, Azure or GCP
✅ ETL/ELT pipeline development
✅ Airflow or equivalent orchestration tools
✅ Experience with distributed data processing
✅ Understanding of data governance and data quality
Preferred
IoT | Real-Time Streaming | Delta Lake | Apache Iceberg | Data Mesh | Supply Chain Data | Cloud Data Platforms
Pay: ₹1,000,000.00 - ₹1,500,000.00 per year
Work Location: Remote
📌 Senior Data Engineer (India)
🏢 MW Infotech
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.