Job Description – Data Engineer
Position: Data Engineer
Experience:
5+ Years
Location:
Pune/ Indore/Kolkata/ Bangalore
Notice Period:
Immediate Joiner
Employment Type:
Full time
Role Overview
We are looking for an experienced
Data Engineer
with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have robust expertise in
AWS or Azure, ETL, SQL, and Python
, along with working knowledge of
GCP
.
Key Responsibilities
Design, develop, and maintain scalable
ETL/ELT data pipelines
.
Develop data integration solutions using
AWS or Azure
cloud services.
Write complex and optimized SQL queries for data extraction, transformation, and analysis.
Develop and maintain data processing solutions using
Python
.
Work with structured and semi-structured data from multiple sources.
Perform data transformation, cleansing, validation, and quality checks.
Monitor and troubleshoot data pipelines and resolve production issues.
Collaborate with Data Architects, Developers, Analysts,
and other stakeholders.
Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
Support cloud-based data platform development and migration initiatives.
Required Skills
5+ years of experience in Data Engineering.
Strong hands-on experience with
ETL/ELT
processes.
Solid
SQL
skills, including query optimization.
Good hands-on experience with
Python
for data engineering.
Strong experience with GCP,
AWS or Azure
.
Understanding of
Data Warehousing and Data Modeling
concepts.
Experience working with large-scale data and production data pipelines.
Good to Have
Experience with
AWS Glue / S3 / Lambda / Redshift
.
Experience with
Azure Data Factory / Azure Data Lake / Synapse
.
Knowledge of
GCP BigQuery / Cloud Storage / Dataflow
.
Experience with
Apache Spark / PySpark
.
Knowledge of
Airflow
or other workflow orchestration tools.
Exposure to
Git
📌 Senior Data Engineer Pune
🏢 Calsoft
📍 Pune