? Immediate Hiring | Senior Python Developer – Data Engineering | Python | PySpark | Databricks | SQL | Mumbai, pune, Bangalore

AgileEngine is looking for a hands-on Senior Data Engineer for an exciting MSCI engagement focused on scalable data engineering, modern data platforms, and AI-powered automation.

We are specifically looking for engineers with a strong Software Engineering background, combining Python development, clean coding, system design, architecture, and API development with data engineering expertise.

This is not a traditional ETL-only role. We need engineers who can independently design, develop, optimize, and troubleshoot production-grade systems.

? Location: Mumbai, pune, Bangalore

### ? Core Skills Required

- Strong Python, Advanced SQL, PySpark/Spark, Airflow, and dbt.
- Robust software engineering fundamentals: clean coding, modular design, debugging, and optimization.
- System design, software architecture, REST APIs, and backend development.
- Production experience with Databricks and BigQuery/Snowflake or equivalent platforms.
- Strong Spark knowledge: joins, partitioning, data skew, and performance optimization.
- ETL/ELT pipelines, data modelling, incremental loads, and SCD Type 1/2.
- Data quality, validation, testing, monitoring, and reconciliation.
- Practical experience with AI coding assistants and validating generated code.

⭐ Added Advantages

- GIS/Geospatial and location-based applications.
- Go programming.
- Agentic AI, AI Agents, and MCP.
- AI-powered data engineering and workflow automation.

### ? Key Responsibilities
- Design and optimize scalable data solutions using Python, PySpark, and SQL.




- Build production-grade ETL/ELT workflows.
- Develop clean, modular, reusable software components.
- Contribute to system design, architecture, and API development.
- Optimize large-scale Spark workloads.
- Implement data quality, validation, monitoring, and reconciliation frameworks.
- Explore AI-powered automation and agentic workflows.

### ? Technical Interview Expectations

Candidates must demonstrate

- Strong Python coding and problem-solving skills.
- Practical SQL and PySpark/Spark knowledge, including code walkthroughs.
- Understanding of architecture, system design, databases, and APIs.
- Hands-on experience with Spark optimization and production challenges.
- Data modelling, incremental loads, and SCD Type 1/2.
- Independent technical decision-making and real production experience.

⚠️ Important Hiring Consideration

This role requires a combination of Software Engineering + Data Engineering expertise.

We strongly prefer Python developers with solid software architecture, system design, and backend development skills.

Candidates limited to traditional ETL development or pipeline orchestration, without strong software engineering fundamentals, may not be the right fit.

Theoretical knowledge alone will not be sufficient.

### ? Interested? Please DM me with:

- Email ID and updated resume
- Total years of experience
- Python and SQL experience
- PySpark/Spark experience
- Databricks experience
- Airflow and dbt experience
- BigQuery/Snowflake experience
- Software Engineering / Backend Development experience
- System Design and API development experience
- Notice period / Last Working Day (LWD)
- Current CTC / Expected CTC
- Current location

.

📌 Senior Python Developer – Data Engineering | Python | PySpark | Databricks | SQL | Mumbai Only
🏢 Remote_WFH_INDIA
📍 Mumbai