12 Aug
|
Kotak
|
Bengaluru
Job Description: Senior Data Engineer
Position Summary
We are seeking a highly skilled Senior Data Engineer with experience in
designing, developing, and optimizing large-scale data platforms and ETL
pipelines across cloud environments. The ideal candidate will have strong
expertise in Python, SQL, PySpark, Airflow, Databricks, AWS, GCP, and modern
data warehousing technologies. The role involves building scalable data
solutions, driving cloud migrations, improving data quality, and enabling
analytics for business stakeholders.
Required Skills & Qualifications
Technical Skills
* Strong programming skills in Python, SQL, and PySpark.
* Hands-on experience with Apache Airflow for workflow orchestration.
* Experience with Databricks and distributed data processing frameworks.
* Expertise in cloud platforms:
* AWS (Glue, Lambda, S3, Step Functions, CloudWatch, Redshift)
* GCP (BigQuery, Cloud Storage, Cloud Functions)
* Experience with contemporary data warehousing technologies:
* BigQuery
* Snowflake
* Amazon Redshift
* Knowledge of DBT, Delta Lake, and Apache Iceberg.
* Experience with Git and software development best practices.
Professional Experience
* 5+ years of experience in Data Engineering and ETL development.
* Experience working across Financial Services, Healthcare, Retail/QSR, or
similar domains.
* Proven track record in cloud migration, data modernization, and performance
optimization initiatives.
* Experience handling large-scale datasets ranging from hundreds of GBs to
multi-terabyte environments.
Education
* Bachelor’s degree in computer science, Electronics & Computer Engineering,
Information Technology, or a related discipline.
📌 Data Engineering II-SUPPORT SERVICES-Data (Bengaluru)
🏢 Kotak
📍 Bengaluru