10 Aug
|
TestHiring
|
India
Key Responsibilities:
• Design, develop, and maintain new data capabilities and infrastructure for Mastercard's Sustainable Technology Internal Data Lake.
• Create current data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within on-premise/cloud environments.
• Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation.
• Collaborate with technical teams and business stakeholders to understand data requirements and translate them into technical solutions.
• Work with large datasets, ensuring data quality, accuracy, and performance.
• Implement data transformation, integration, and validation processes to support analytics/BI and reporting needs.
• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.
• Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security.
• Troubleshoot and resolve data-related issues,
collaborating with the team to identify root causes.
• Document data processes, data lineage, and technical specifications for future reference.
• Participate in code reviews, ensuring adherence to coding standards and best practices.
• Collaborate with DevOps teams to automate deployment and monitoring of data pipelines.
• Additional tasks as required.
Requirements
• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
• Proven experience as a Data Engineer / Scientist or similar role.
• Deep understanding & expertise in data engineering, ETL/ELT processes, data warehousing, and data modeling.
• Strong command of data integration techniques and data quality management.
• Hands-on experience with data technologies such as Databricks, Spark, Python, SQL, Hadoop, Airflow.
• Familiarity with cloud platforms and services, such as AWS or Azure.
• Excellent analytical, problem-solving skill
📌 Require a Data Engineer in Pune (India)
🏢 TestHiring
📍 India