Job Description – Data Engineer
Location: Bangalore
Experience: 5 to 10 yrs
Required Skills
Programming & Data Processing
• Strong proficiency in Python or Java.
• Experience in Python-based data extraction and logic development.
• Hands-on experience with Apache Kafka, Apache Spark, ANSI SQL, and FTP.
• Experience in on-premises to AWS cloud migration.

Data Formats
• Solid understanding of JSON, Avro, and Parquet file formats.

Platforms & Technologies
• Experience with Hadoop (HDFS/Hive).
• Hands-on experience with Snowflake, Apache Iceberg, and Sybase IQ.

Data Modeling & Architecture
• Understanding of data normalization and denormalization techniques.
• Knowledge of natural keys and surrogate keys and their strategic use in data modeling.





Key Responsibilities
• Develop and maintain data extraction and transformation pipelines.
• Build scalable data processing solutions using Apache Spark and Kafka.
• Work with structured and semi-structured data formats.
• Support on-premises to AWS cloud migration projects.
• Design and optimize SQL queries for efficient data processing.
• Implement data modeling strategies using normalization, denormalization, and appropriate key selection.
• Work with Hadoop, Snowflake, Apache Iceberg, and Sybase IQ platforms

Salary: 15 - 20 INR Per annum

📌 Data Engineer (Bengaluru)
🏢 N Consulting
📍 Bengaluru