– Data Engineer

Location: Bangalore

Experience: 5 to 10 yrs

Required Skills

Programming & Data Processing

- Strong proficiency in Python or Java.
- Experience in Python-based data extraction and logic development.
- Hands-on experience with Apache Kafka, Apache Spark, ANSI SQL, and FTP.
- Experience in on-premises to AWS cloud migration.

Data Formats

- Robust understanding of JSON, Avro, and Parquet file formats.

Platforms & Technologies

- Experience with Hadoop (HDFS/Hive).
- Hands-on experience with Snowflake, Apache Iceberg, and Sybase IQ.

Data Modeling & Architecture

- Understanding of data normalization and denormalization techniques.
- Knowledge of natural keys and surrogate keys and their strategic use in data modeling.

Key Responsibilities





- Develop and maintain data extraction and transformation pipelines.
- Build scalable data processing solutions using Apache Spark and Kafka.
- Work with structured and semi-structured data formats.
- Support on-premises to AWS cloud migration projects.
- Design and optimize SQL queries for efficient data processing.
- Implement data modeling strategies using normalization, denormalization, and appropriate key selection.
- Work with Hadoop, Snowflake, Apache Iceberg, and Sybase IQ platforms

Salary: 15 - 20 INR Per annum

📌 Data Engineer (Bengaluru)
🏢 N Consulting
📍 Bengaluru