We are seeking an experienced

Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions. The ideal candidate will have robust hands-on expertise in relational databases, ETL/ELT development, Python, PySpark, shell scripting, and Snowflake.

Key Responsibilities

- Design, develop, test, deploy, and maintain reliable ETL/ELT pipelines for ingesting, transforming, validating, and loading data.

- Extract and integrate data from relational databases, files, APIs, cloud storage, and other source systems.

- Develop efficient data transformation and data-processing workflows using

Python and

PySpark

.

- Build and optimize

Snowflake data warehouse objects, including tables, views, staging layers, stored procedures, and SQL transformations.

- Write complex SQL queries for data extraction, transformation, validation, reconciliation, and reporting.

- Develop and maintain

Unix/Linux shell scripts for file handling, job automation, scheduling support, and operational monitoring.

- Perform data profiling, cleansing, deduplication, validation, and data-quality checks.

- Optimize SQL queries, PySpark jobs, and Snowflake workloads for performance, scalability, and cost efficiency.

- Monitor production pipelines, investigate failures, troubleshoot data issues, and implement preventive fixes.

- Collaborate with data architects,



analysts, business stakeholders, and downstream reporting teams to translate requirements into technical solutions.

- Create and maintain technical documentation, data-flow diagrams, deployment steps, and operational runbooks.

- Follow data governance, security, access-control, and coding best practices.

Required Skills

- Strong experience with relational databases such as SQL Server, Oracle, MySQL, or PostgreSQL.

- Strong SQL skills, including complex queries, joins, window functions, stored procedures, and query optimization.

- Hands-on experience designing and developing

ETL/ELT pipelines

.

- Proficiency in

Python for data processing, automation, APIs, and reusable frameworks.

- Hands-on experience with

PySpark for large-scale batch data processing and transformations.

- Good working Experience of

Unix/Linux shell scripting

.

- Practical experience with

Snowflake

, including warehouse design, data loading, performance tuning, and SnowSQL/SQL development.

- Experience with data modeling, dimensional modeling, data warehousing concepts, and data-quality practices.

- Familiarity with orchestration and scheduling tools such as Airflow, Control-M, Tidal, or similar.

- Experience with Git, CI/CD practices, and Agile delivery.

📌 Data Engineer - Immediate Joiners only &F interview is Mandatory (Bengaluru)
🏢 wissen technology
📍 Bengaluru