Job Description

Job Description – Data Engineer

n

Position: Data Engineer

n

Experience: 5+ Years

n

Location: Pune/ Indore/Kolkata/ Bangalore

n

Notice Period: Immediate Joiner

n

Employment Type: Full-Time

n

Role Overview

n

We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have strong expertise in AWS or Azure, ETL, SQL, and Python , along with working knowledge of GCP .

n

Key Responsibilities

n

n
- Design, develop, and maintain scalable ETL/ELT data pipelines .
n
- Develop data integration solutions using AWS or Azure cloud services.
n
- Write complex and optimized SQL queries for data extraction, transformation, and analysis.
n
- Develop and maintain data processing solutions using Python .
n
- Work with structured and semi-structured data from multiple sources.
n
- Perform data transformation, cleansing, validation, and quality checks.
n
- Monitor and troubleshoot data pipelines and resolve production issues.
n
- Collaborate with Data Architects, Developers, Analysts, and other stakeholders.
n
- Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
n




- Support cloud-based data platform development and migration initiatives.
n

n

Required Skills

n

n
- 5+ years of experience in Data Engineering.
n
- Strong hands-on experience with ETL/ELT processes.
n
- Strong SQL skills, including query optimization.
n
- Good hands-on experience with Python for data engineering.
n
- Solid experience with GCP, AWS or Azure .
n
- Understanding of Data Warehousing and Data Modeling concepts.
n
- Experience working with large-scale data and production data pipelines.
n

n

Good to Have

n

n
- Experience with AWS Glue / S3 / Lambda / Redshift .
n
- Experience with Azure Data Factory / Azure Data Lake / Synapse .
n
- Knowledge of GCP BigQuery / Cloud Storage / Dataflow .
n
- Experience with Apache Spark / PySpark .
n
- Knowledge of Airflow or other workflow orchestration tools.
n
- Exposure to Git, CI/CD, Docker , or cloud-native technologies.
n

n

Candidate Profile

n

n
- Strong problem-solving and analytical skills.
n
- Good communication and stakeholder management skills.
n
- Ability to work independently and as part of a technical team.
n
- Experience working in enterprise production environments.
n

n

📌 Senior Data Engineer (Pune)
🏢 Calsoft
📍 Pune