Key Responsibilities:

• Design, develop, and maintain current data capabilities and infrastructure for Mastercard's Sustainable Technology Internal Data Lake.

• Create new data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within on-premise/cloud environments.

• Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation.

• Collaborate with technical teams and business stakeholders to understand data requirements and translate them into technical solutions.

• Work with large datasets, ensuring data quality, accuracy, and performance.

• Implement data transformation, integration, and validation processes to support analytics/BI and reporting needs.

• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.

• Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security.

• Troubleshoot and resolve data-related issues,



collaborating with the team to identify root causes.

• Document data processes, data lineage, and technical specifications for future reference.

• Participate in code reviews, ensuring adherence to coding standards and best practices.

• Collaborate with DevOps teams to automate deployment and monitoring of data pipelines.

• Additional tasks as required.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.

• Proven experience as a Data Engineer / Scientist or similar role.

• Deep understanding & expertise in data engineering, ETL/ELT processes, data warehousing, and data modeling.

• Strong command of data integration techniques and data quality management.

• Hands-on experience with data technologies such as Databricks, Spark, Python, SQL, Hadoop, Airflow.

• Familiarity with cloud platforms and services, such as AWS or Azure.

• Excellent analytical, p

📌 Require a Data Engineer in Pune (Pune Division)
🏢 TestHiring
📍 Pune Division