Data Engineer

What s important to us:

We are looking for a skilled and experienced Data Engineer with over 4 years of qualified experience in building, automating, and optimizing data pipelines and cloud-based architectures. The ideal candidate will have hands-on experience with cloud data services (AWS, Azure, or GCP) and CI/CD pipelines for deploying scalable, reliable, and secure data solutions.

The candidate will collaborate with cross-functional teams including data analysts, data scientists, and software engineers to design and maintain robust data infrastructure that supports analytics, AI/ML workflows, and enterprise reporting systems.

Key Responsibilities:
- Design, build, and maintain end-to-end ETL/ELT pipelines using both on-premise and cloud-based technologies.
- Architect and operate data storage and streaming solutions leveraging cloud-based services on AWS , Azure , or GCP .
- Design and implement data ingestion and transformation workflows using Airflow , AWS Glue , or Azure Data Factory .




- Develop and optimize data pipelines using Python and PySpark for large-scale distributed data processing.
- Build data models - normalized, denormalized, and dimensional ( Star/Snowflake ) - for analytics and warehousing solutions.
- Implement data quality , lineage , and governance using metadata management and monitoring tools.
- Collaborate with cross-functional teams to deliver clean, reliable, and timely data for analytics and machine learning use cases.
- Integrate CI/CD pipelines for data infrastructure deployment using GitHub Actions , Jenkins , or Azure DevOps .
- Automate infrastructure provisioning using Infrastructure as Code (IaC) tools such as AWS CloudFormation or Terraform .
- Monitor and optimize data processing performance for scalability, reliability, and cost-efficiency.
- Enforce data security policies and ensure compliance with standards such as GDPR and HIPAA .

Must-Have Skills Qualifications:
- Education: Bachelor s or Master s de

📌 Data Engineer (Thiruvananthapuram)
🏢 Techversant
📍 Thiruvananthapuram