– Data Engineer

Location: Bangalore

Experience: 5 to 10 yrs

Required Skills

Programming & Data Processing
Robust proficiency in Python or Java.
Experience in Python-based data extraction and logic development.
Hands-on experience with Apache Kafka, Apache Spark, ANSI SQL, and FTP.
Experience in on-premises to AWS cloud migration.

Data Formats
Robust understanding of JSON, Avro, and Parquet file formats.

Platforms & Technologies
Experience with Hadoop (HDFS/Hive).
Hands-on experience with Snowflake, Apache Iceberg, and Sybase IQ.

Data Modeling & Architecture
Understanding of data normalization and denormalization techniques.
Knowledge of natural keys and surrogate keys and their strategic use in data modeling.

Key Responsibilities




Develop and maintain data extraction and transformation pipelines.
Build scalable data processing solutions using Apache Spark and Kafka.
Work with structured and semi-structured data formats.
Support on-premises to AWS cloud migration projects.
Design and optimize SQL queries for productive data processing.
Implement data modeling strategies using normalization, denormalization, and appropriate key selection.
Work with Hadoop, Snowflake, Apache Iceberg, and Sybase IQ platforms

Salary: 15 - 20 INR Per annum

📌 Data Engineer Bengaluru
🏢 N Consulting
📍 Bengaluru