We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions. The ideal candidate will have strong hands-on expertise in relational databases, ETL/ELT development, Python, PySpark, shell scripting, and Snowflake.

Key Responsibilities

- Design, develop, test, deploy, and maintain reliable ETL/ELT pipelines for ingesting, transforming, validating, and loading data.
- Extract and integrate data from relational databases, files, APIs, cloud storage, and other source systems.
- Develop efficient data transformation and data-processing workflows using Python and PySpark.
- Build and optimize Snowflake data warehouse objects, including tables, views, staging layers, stored procedures, and SQL transformations.
- Write complex SQL queries for data extraction, transformation, validation, reconciliation, and reporting.
- Develop and maintain Unix/Linux shell scripts for file handling, job automation, scheduling support, and operational monitoring.
- Perform data profiling, cleansing, deduplication, validation, and data-quality checks.
- Optimize SQL queries, PySpark jobs, and Snowflake workloads for performance, scalability, and cost efficiency.
- Monitor production pipelines, investigate failures, troubleshoot data issues, and implement preventive fixes.
- Collaborate with data architects,



analysts, business stakeholders, and downstream reporting teams to translate requirements into technical solutions.
- Create and maintain technical documentation, data-flow diagrams, deployment steps, and operational runbooks.
- Follow data governance, security, access-control, and coding best practices.

Required Skills
- Strong experience with relational databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
- Strong SQL skills, including complex queries, joins, window functions, stored procedures, and query optimization.
- Hands-on experience designing and developing ETL/ELT pipelines.
- Proficiency in Python for data processing, automation, APIs, and reusable frameworks.
- Hands-on experience with PySpark for large-scale batch data processing and transformations.
- Valuable working Experience of Unix/Linux shell scripting.
- Practical experience with Snowflake, including warehouse design, data loading, performance tuning, and SnowSQL/SQL development.
- Experience with data modeling, dimensional modeling, data warehousing concepts, and data-quality practices.
- Familiarity with orchestration and scheduling tools such as Airflow, Control-M, Tidal, or similar.
- Experience with Git, CI/CD practices, and Agile delivery.

📌 Data Engineer - Immediate Joiners only &F interview is Mandatory (Bengaluru)
🏢 wissen technology
📍 Bengaluru