Data Engineer

What s key to us:

We are looking for a skilled and experienced Data Engineer with over 4 years of qualified experience in building, automating, and optimizing data pipelines and cloud-based architectures. The ideal candidate will have hands-on experience with cloud data services (AWS, Azure, or GCP) and CI/CD pipelines for deploying scalable, reliable, and secure data solutions.

The candidate will collaborate with cross-functional teams including data analysts, data scientists, and software engineers to design and maintain robust data infrastructure that supports analytics, AI/ML workflows, and enterprise reporting systems.

Key Responsibilities:
Design, build, and maintain end-to-end ETL/ELT pipelines using both on-premise and cloud-based technologies.
Architect and operate data storage and streaming solutions leveraging cloud-based services on AWS , Azure , or GCP .
Design and implement data ingestion and transformation workflows using Airflow , AWS Glue , or Azure Data Factory .




Develop and optimize data pipelines using Python and PySpark for large-scale distributed data processing.
Build data models - normalized, denormalized, and dimensional ( Star/Snowflake ) - for analytics and warehousing solutions.
Implement data quality , lineage , and governance using metadata management and monitoring tools.
Collaborate with cross-functional teams to deliver clean, reliable, and timely data for analytics and machine learning use cases.
Integrate CI/CD pipelines for data infrastructure deployment using GitHub Actions , Jenkins , or Azure DevOps .
Automate infrastructure provisioning using Infrastructure as Code (IaC) tools such as AWS CloudFormation or Terraform .
Monitor and optimize data processing performance for scalability, reliability, and cost-efficiency.
Enforce data security policies and ensure compliance with standards such as GDPR and HIPAA .

Must-Have Skills Qualifications:
Education: Bachelor s or Master s de

📌 Data Engineer Thiruvananthapuram (India)
🏢 Techversant
📍 India