Job Description
Job Description – Data Engineer
n
Position: Data Engineer
n
Experience: 5+ Years
n
Location: Pune/ Indore/Kolkata/ Bangalore
n
Notice Period: Immediate Joiner
n
Employment Type: Full time
n
Role Overview
n
We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have solid expertise in AWS or Azure, ETL, SQL, and Python , along with working knowledge of GCP .
n
Key Responsibilities
n
n
Design, develop, and maintain scalable ETL/ELT data pipelines .
n
Develop data integration solutions using AWS or Azure cloud services.
n
Write complex and optimized SQL queries for data extraction, transformation, and analysis.
n
Develop and maintain data processing solutions using Python .
n
Work with structured and semi-structured data from multiple sources.
n
Perform data transformation, cleansing, validation, and quality checks.
n
Monitor and troubleshoot data pipelines and resolve production issues.
n
Collaborate with Data Architects, Developers, Analysts, and other stakeholders.
n
Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
n
Support cloud-based data platform development and migration initiatives.
n
n
Required Skills
n
n
5+ years of experience in Data Engineering.
n
Strong hands-on experience with ETL/ELT processes.
n
Strong SQL skills, including query optimization.
n
Good hands-on experience with Python for data engineering.
n
Solid experience with GCP, AWS or Azure .
n
Understanding of Data Warehousing and Data Modeling concepts.
n
Experience working with large-scale data and production data pipelines.
n
n
Good to Have
n
n
Experience with AWS Glue / S3 / Lambda / Redshift .
n
Experience with Azure Data Factory / Azure Data Lake / Synapse .
n
Knowledge of GCP BigQuery / Cloud Storage / Dataflow .
n
Experience with Apache Spark / PySpark .
n
Knowledge of Airflow or other workflow orchestration tools.
n
Exposure to Git, CI/CD, Docker , or cloud-native technologies.
n
n
Candidate Profile
n
n
Strong problem-solving and analytical skills.
n
Good communication and stakeholder management skills.
n
Ability to work independently and as part of a technical team.
n
Experience working in enterprise production environments.
n
n
📌 Senior Data Engineer Pune
🏢 Calsoft
📍 Pune