Position: Data Engineer - Databricks & PySparkExperience: 3 - 5 yearsLocation: Gurgaon, IndiaWork Mode: Work from Office (Monday - Friday)Shift: 2:00 PM - 11:00 PM ISTAbout the Job:MantriAI is hiring for a leading global analytics and advisory firm, helping banks and financial institutions drive revenue growth, reduce costs and manage risk through Big Data, Advanced Analytics and deep industry expertise.Key Responsibilities:- Develop data ingestion and transformation pipelines using Databricks, PySpark, Python and SQL- Integrate data from multiple sources and prepare datasets for reporting, analytics and machine-learning use cases- Build reusable transformation components and analytical data models- Implement data-quality checks, reconciliation, exception handling and pipeline monitoring- Optimize Spark workloads for performance, reliability and cost- Apply data security, access controls, lineage and documentation standards- Support automated deployment,
production troubleshooting and ongoing pipeline maintenance- Translate banking business requirements into sustainable data solutionsRequired Skills & Experience:- Solid hands-on experience with Databricks and PySpark- Proficiency in Python and SQL- Experience building ETL/ELT pipelines and working with a data lake- Understanding of distributed processing, workflow orchestration and performance tuning- Working knowledge of the banking domain, including banking data and metrics- Understanding of data-quality requirements: validation, completeness, accuracy and consistencyPreferred Skills:- Experience with Azure-based data platforms- Familiarity with enterprise data governance and sensitive-data handling- Experience preparing data for Power BI and machine-learning applications (ref:hirist.tech)
📌 Data Engineer (Big Data) (Gurugram)
🏢 MantriAI
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.