Role Summary

The Data Engineer, Specialist is responsible for building and maintaining scalable data pipelines to ensure seamless integration and efficient data flow across various platforms. This role involves designing, developing, and optimizing ETL (Extract, Transform, Load) processes, managing databases and leveraging big data technologies to support analytics and business intelligence initiatives.

Responsibilities

- Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
- Troubleshoots software and processes for data consistency and integrity. Integrates large scale data from a variety of sources for business partners to generate insight and make decisions.
- Translate business specifications into design specifications and code. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
- Partners with internal clients to gain an enhanced understanding of business functions and informational needs. Gains expertise in tools, technologies, and applications/databases in specific business areas and company-wide systems.
- Leads all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members.
- Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
- Designs and conducts training sessions on tools and data sources used by the team and self-provisioners. Provides job aid to team members and business users.
- Tests and implement new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.




- Participates in special projects and performs other duties as assigned.

Qualifications and Skills

- Minimum 5 years of relevant work experience, with at least 2 years in designing and maintaining data pipelines, ETL processes and database architectures.
- Bachelor's or master's degree in computer science, Information Technology, or related field. Examples: B.E., B.Tech., bachelor's in computer applications (BCA), master's in computer applications (MCA)
- 5 - 8 years of experience in data engineering, analytics engineering, or data platform development
- Robust proficiency in SQL and Python for data transformation and automation
- Hands-on experience building and supporting ETL/ELT pipelines
- Experience with AWS or similar cloud data platforms
- Solid understanding of data modeling, curated datasets, and BI/reporting use cases
- Demonstrated problem-solving skills and commitment to data quality and reliability
- Ability to communicate effectively with both technical and non-technical stakeholders
- Experience working in collaborative, agile team environments
- A quality first mindset, with experience building reliable, scalable, and observable systems
- Comfort using AI assisted engineering tools to improve developer productivity, code quality, and delivery flow
- Proficiency in DevOps concepts, tools and continuous delivery pipelines, specifically Git and GitHub
- Proficiency in Event Driven Architecture (Medallion Architecture)
- Proficiency in AWS technologies: CloudFront, S3, ECS, IAM, DynamoDB, Lambda, SNS, SQS, Glue, Step functions, Athena, PySpark and CloudWatch
- Proficiency in GenAI tools. Example: Claude Code, Copilot Agent
- Preferred Certifications - AWS Cloud Practitioner, AWS Solutions Architect, AWS Solution Consultant, Databricks

Location

This role is based in Hyderabad, Telangana at Vanguard's India office. Only qualified external applicants will be considered.

📌 Data Engineer, Specialist (Telangana)
🏢 Vanguard Technologies
📍 Telangana