We are looking for an experienced
Data Engineer
with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have strong expertise in
AWS or Azure, ETL, SQL, and Python
, along with working knowledge of
GCP
.
Key Responsibilities
- Design, develop, and maintain scalable
ETL/ELT data pipelines
.
- Develop data integration solutions using
AWS or Azure
cloud services.
- Write complex and optimized SQL queries for data extraction, transformation, and analysis.
- Develop and maintain data processing solutions using
Python
.
- Work with structured and semi-structured data from multiple sources.
- Perform data transformation, cleansing, validation, and quality checks.
- Monitor and troubleshoot data pipelines and resolve production issues.
- Collaborate with Data Architects, Developers, Analysts,
and other stakeholders.
- Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
- Support cloud-based data platform development and migration initiatives.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with
ETL/ELT
processes.
- Solid
SQL
skills, including query optimization.
- Good hands-on experience with
Python
for data engineering.
- Strong experience with GCP,
AWS or Azure
.
- Understanding of
Data Warehousing and Data Modeling
concepts.
- Experience working with large-scale data and production data pipelines.
Good to Have
- Experience with
AWS Glue / S3 / Lambda / Redshift
.
- Experience with
Azure Data Factory / Azure Data Lake / Synapse
.
- Knowledge of
GCP BigQuery / Cloud Storage / Dataflow
.
- Experience with
Apache Spark / PySpark
.
- Knowledge of
Airflow
or other workflow orchestration tools.
- Exposure to
Git
📌 Senior Data Engineer (Pune)
🏢 Calsoft
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.