20 Aug
|
spark eighteen
|
Delhi
20 Aug
spark eighteen
Delhi
Job Information:
Number of Positions
- 1
Date Opened
- 07/22/2026
Industry
- IT Services
Job Type
- Full time
Work Experience
- 5-7 years
City
- New Delhi
State/Province
- Delhi
Zip/Postal Code
- 110017
Country
- India
- Requirements:
- 5+ years of experience in Data Engineering and production-scale data platforms
- Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion within isolated environments
- Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations
- Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions
- Implement efficient data ingestion, transformation, and bulk-loading pipelines without external connectivity
- Work with S3-compatible object storage (e.g., MinIO) for on-prem data storage
- Proven experience deploying via Docker/Docker Compose in air-gapped or restricted-network environments
- Comfortable working in Ubuntu-based environments with manual/local infrastructure management
- Strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL
- Experience with geospatial and time-series data
- Collaborate with customer teams to translate business requirements into data products
- Ensure data quality, lineage, observability, performance, and SLA compliance
- Troubleshoot production issues on-site/remotely without cloud tooling support
- Create and maintain technical documentation, data models, and operational run-books
- Strong communication, stakeholder management, and problem-solving skills
- Benefits:
- Comprehensive insurance coverage that gives you peace of mind, so you can focus on doing your best work
- Versatile work arrangements designed to support sustained productivity, personal well-being, and work-life balance
- Continuous learning and accelerated skill development through hands-on projects and mentorship from experienced industry leaders
- Global client exposure across 20+ countries, o
📌 Data Engineer (Delhi)
🏢 spark eighteen
📍 Delhi