10 Nov
|
Recognized
|
Bengaluru
10 Nov
Recognized
Bengaluru
Description
Job Description: Senior Data Engineer
Position Summary
We are seeking a highly skilled Senior Data Engineer with experience in designing, developing, and optimizing large-scale data platforms and ETL pipelines across cloud environments. The ideal candidate will have strong expertise in Python, SQL, PySpark, Airflow, Databricks, AWS, GCP, and up-to-date data warehousing technologies. The role involves building scalable data solutions, driving cloud migrations, improving data quality, and enabling analytics for business stakeholders.
Required Skills & Qualifications
Technical Skills
Robust programming skills in Python, SQL, and PySpark.
Hands-on experience with Apache Airflow for workflow orchestration.
Experience with Databricks and distributed data processing frameworks.
Expertise in cloud platforms:
AWS (Glue, Lambda, S3, Step Functions, CloudWatch, Redshift)
GCP (BigQuery, Cloud Storage, Cloud Functions)
Experience with up-to-date data warehousing technologies:
BigQuery
Snowflake
Amazon Redshift
Knowledge of DBT, Delta Lake, and Apache Iceberg.
Experience with Git and software development best practices.
Professional Experience
5+ years of experience in Data Engineering and ETL development.
Experience working across Financial Services, Healthcare, Retail/QSR, or similar domains.
Proven track record in cloud migration, data modernization, and performance optimization initiatives.
Experience handling large-scale datasets ranging from hundreds of GBs to multi-terabyte environments.
Education
Bachelor’s degree in computer science, Electronics & Computer Engineering, Information Technology, or a related discipline.
📌 Data Engineering Ii Support Services Data & Analytics In House Engineering Bengaluru
🏢 Recognized
📍 Bengaluru