Senior Data Engineer

Job Description

Key Responsibilities:

- Design and develop robust data pipelines and ETL processes
- Support data migration from traditional systems (Oracle, Vertica) to up-to-date cloud platforms (Snowflake, AWS)
- Build and maintain scalable data ingestion and transformation frameworks
- Optimize and tune data queries for performance and efficiency
- Implement and manage cloud-based data solutions (Snowflake, AWS, Azure)
- Work closely with architects and senior engineers on solution design
- Participate in Agile development practices (Scrum/Kanban)
- Conduct unit testing, troubleshoot issues, and ensure data quality
- Document data models, processes, and best practices

Technical Skills:

- Cloud Platforms: AWS (preferred), Snowflake, Azure (nice to have)
- Databases: Oracle, SQL Server, Vertica, MongoDB
- Languages: Python, SQL, Shell scripting (Java is a plus)
- Tools: Spark (preferred), Tableau, Jenkins, Git, Docker (basic understanding)
- Frameworks:



Familiarity with REST APIs and microservices architecture
- Data Skills: Data modeling, ETL, Data Migration, Data Quality
- Agile Methodologies: Experience working in Scrum/Kanban teams

Mandatory Competencies

- Data Science and Machine Learning - Data Science and Machine Learning - Databricks
- Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
- Big Data - Big Data - Pyspark
- Beh - Communication
- Database - Sql Server - SQL Packages
- Automation - Scripting Automation - Shell Scripting
- Programming Language - Python - Apache Airflow
- Data AI - Data Engineering - Apache Kafka
- Data AI - Data Engineering - Data Quality Validation
- Data AI - Data Engineering - Stream Processing
- Data Science and Machine Learning - Data Science and Machine Learning - Python

📌 Senior Data Engineer (Noida)
🏢 IRIS SOFTWARE
📍 Noida