About the Role
We are looking for a Senior Software Engineer to drive the design, development,
and scaling of our centralized, API-driven data validation platform. This is a
hands-on individual contributor role focused on building high-performance,
scalable, and intelligent validation systems that process large datasets with
speed and accuracy. You will work across backend systems, validation engines,
APIs, and data processing pipelines, with opportunities to contribute to
AI-driven capabilities such as anomaly detection, rule automation & LLM based
capabilities.
Key Skills:
• 5 to 8 years of experience into Python
• Strong proficiency in Python(data manipulation libraries like Pandas, NumPy)
with writing clean, maintainable, and testable code.
• Design and develop scalable backend services for data validation.
• Implement high-throughput data processing pipelines.
• Integrate CheckMate with enterprise data systems and pipelines.
• Enable real-time and batch validation capabilities
• Design and implement - Field-level validations, Cross-field and relational
rules & Schema and data integrity checks.
• Knowledge of parallel processing and asynchronous execution.
• Knowledge of caching, indexing and efficient data structures.
• Robust knowledge of API integration, and data extraction from both structured
and unstructured sources
• Knowledge of distributed computing and data engineering techniques for
scalable data processing
• Maintain auditability and traceability in validation workflows.
• Collaborate with Sustainalytics Data Services Digital, Client Services,
Business Analysts, Data Engineers teams to deliver timely and accurate outputs.
• Good to have exposure to LLM.
• Good to have knowledge of anomaly detection using algorithms like Isolation
Forest or similar.
• Good to have knowledge of SQL for querying and managing relational databases.
• Good to have Excel skills, including formulas, pivot tables, and automation
techniques.
• Stay up-to-date with the latest