Apply on Kit Job: kitjob.in/job/43jt0x

Job Title: Data Engineer (4–8 Years)

n

Location: Pune | Bangalore | Chennai

n

Employment Type: Full time

n

Work Mode: Work from Office (3 days/week at client office – mandatory)

n

Availability: Immediate joiners only

n

About the Role:

n

We are looking for experienced Data Engineers with 4 to 8 years of experience to join our team. You will design and build scalable data pipelines on AWS using Databricks, Apache Airflow, and Apache Iceberg. This role involves working on enterprise-grade data platforms with a focus on performance, governance, and reliability.

n

Note: A detailed background verification (BGV) will be conducted. A valid LinkedIn profile is mandatory for application consideration.

n

Key Responsibilities

n

- Design, develop, and optimize ETL/ELT pipelines using Databricks, PySpark, and Apache Airflow.
- Implement data lakehouse architectures using Apache Iceberg for ACID transactions, time travel, and schema evolution.
- Build and maintain cloud-native data solutions on AWS using services like S3, Glue, Lambda, EventBridge, SNS, SQS, and Lake Formation.
- Implement fine-grained data access controls with AWS Lake Formation.




- Develop event-driven and serverless data workflows for scalability and cost efficiency.
- Collaborate with data scientists, analysts, and software engineers to deliver high-quality data products.
- Senior-level candidates will also lead technical initiatives and mentor junior team members.

n

Required Skills

n

Must-Have for All Candidates:

n

- Databricks
- Apache Airflow
- Python and PySpark
- Apache Iceberg
- AWS services: S3, Glue/Crawler, Lambda, Lake Formation

Additional Skills Based on Experience:n

- For 4–6 Years Experience:
- Hands-on experience with EventBridge, SNS, SQS, and Kafka. Terraform knowledge is a bonus.
- For 6–8 Years Experience:
- Advanced proficiency in Databricks, Airflow, Python, Iceberg, and core AWS services (S3, Glue, Lambda, Lake Formation). Ability to lead technical design and mentor team members.

n

Preferred Qualifications

n

- Experience with Terraform for infrastructure as code.
- Familiarity with Kafka or other streaming platforms.

Apply on Kit Job: kitjob.in/job/43jt0x

📌 Data Engineer (Nellore)
🏢 Kresta Softech Private
📍 Nellore