26 Aug
|
Amnex
|
Ahmedabad
Data Engineer
Location: Ahemdabad, Gujarat
Employment Type: Full-time
About the Role
We are looking for a Data Engineer to sit at the intersection of infrastructure, development, and reliability engineering. In this role, you will benchmark hardware for model workloads, analyze model behavior across builds, and work closely with AI/ML developers, delivery engineers, and Site Reliability Engineers (SREs) to ensure our models and pipelines run efficiently and reliably in production.
Key Responsibilities
- Design, run, and maintain benchmarking suites to evaluate hardware performance (GPU/CPU/memory/storage/network) and identify bottlenecks or optimization opportunities.
- Act as a technical liaison between developers, delivery engineers, and SREs, translating requirements and findings across teams to align on performance goals and delivery timelines.
- Analyze model outputs and behavior across different builds, hardware configurations, and environments to detect regressions, drift, or anomalies.
- Establish and maintain automated pipelines to test model performance (latency, throughput, accuracy, resource utilization) with every recent build, and report findings.
- Support and improve AI/ML pipeline infrastructure, ensuring smooth handoffs from development to deployment.
- Maintain clear documentation of benchmarking methodology,
test results, and performance trends for use by engineering and leadership teams.
Required Skills & Qualifications
- Strong proficiency in Python, with experience writing production-quality, testable code.
- Hands-on experience with Docker for containerization of testing/benchmarking environments.
- Solid working knowledge of Linux systems administration and command-line tooling.
- Practical understanding of computer vision pipelines from data ingestion and training to model deployment and monitoring as well as hands on experience with evaluation matrices.
- Familiarity with version control systems such as GitHub/GitLab, including CI/CD workflows.
- Experience with Kubernetes for orchestrating containerized workloads.
Preferred Qualifications (Optional)
- Prior experience working alongside delivery or DevOps teams.
- Experience with shell scripting.
What Success Looks Like
- Benchmarking results that reliably inform hardware and infrastructure decisions.
- Smooth, well-documented communication between developers, delivery, and SRE teams.
- Early detection of model performance regressions through consistent build-over-build testing.
- A performance-testing pipeline that scales with the team's release cadence.
📌 Urgent hiring For Data Engineer - Ahmedabad Location
🏢 Amnex
📍 Ahmedabad