Job Description
Data Engineer (Test Data & Service Virtualization)
Experience:
6–9 years
Location:
Pune COE Role Summary We are looking for a Data Engineer to understand, design, build and support the processes, tools and mechanisms behind data mining, data mocking and service virtualization. You will make sure engineering and QA teams have realistic, secure and on-demand data and simulated services. They can then build and test without depending on live systems.
Key Responsibilities
• Data mining: Analyze source systems and production-like datasets to find data patterns, relationships and edge cases. Extract and profile the data needed for testing and analytics.
• Data mocking and synthetic data: Design and build frameworks that generate realistic mock and synthetic data. Cover data masking, anonymization and sub setting so no real PII reaches non-production environments.
• Service virtualization: Build and maintain virtual services and stubs that simulate APIs, third-party systems and message-based interfaces (REST, SOAP, MQ/Kafka). Support testing when real dependencies are unavailable, costly or unstable.
• Tooling and automation: Evaluate, select and implement tools and mechanisms for test data management. Integrate them into CI/CD pipelines for self-service, on-demand data.
• Design and architecture: Define standards, patterns and reusable accelerators for data mocking and virtualization across teams.
• Support: Troubleshoot data and virtual service issues, and handle production-like support requests from dev and QA teams.
Keep documentation and runbooks current.
• Collaboration: Work with developers, QA, DevOps, architects and business analysts to understand data and integration needs.
• Compliance: Follow data privacy, security and governance practices (e.g., GDPR, PCI). Required
Skills:
• 6–9 years of experience in data engineering, test data management or related roles.
• Strong SQL and relational databases (Oracle, PostgreSQL, SQL Server, MySQL), plus working knowledge of NoSQL stores (MongoDB, Cassandra).
• Proficiency in Python, Java or Scala for data processing and automation.
• Hands-on experience with service virtualization and mocking tools (e.g., WireMock, Mountebank, Hoverfly, Parasoft Virtualize, CA/Broadcom DevTest, MockServer).
• Experience with data masking and synthetic data generation
• Solid knowledge of APIs and protocols: REST, SOAP, JSON, XML, JMS/MQ, Kafka.
• Experience with CI/CD tools (Jenkins, GitLab CI, Azure DevOps) and Git.
• Understanding of data modelling, data quality and data profiling.
• Strong analytical, problem-solving and communication skills. Good to Have:
• Cloud experience (AWS, Azure or GCP) and data services (S3, Snowflake).
• Containerization and orchestration (Docker, Kubernetes).
• Experience with data mining or ML techniques for pattern discovery and anomaly detection.
• Background in a domain such as airline, travel
• Familiarity with performance, contract and API testing tools (SoapUI).
📌 Specialist Data Engineer (India)
🏢 Accelya
📍 India