Data Engineer

- Design and develop scalable ETL/ELT data pipelines using Python, PySpark, and Databricks.

- Work with AWS, Azure, Snowflake, and data warehousing solutions.

- Build reliable, analytics-ready datasets and ensure data quality and performance.

Requirements

Key Roles & Responsibilities

- Develop and optimize ETL pipelines and data ingestion workflows.

- Implement CDC, SCD Type 1/2, and Medallion Architecture.

- Perform data validation, transformation, and quality checks.

- Develop data models and support BI reporting using Power BI/QuickSight.

- Work with AWS Glue, S3, Azure Data Factory, Airflow, and Snowflake.

- Collaborate with stakeholders to understand requirements and deliver data solutions.

Primary Skills:

- Python, SQL, PySpark

- Databricks & Apache Spark

- ETL/ELT & Data Pipelines

- AWS (S3, Glue)

- Snowflake

Secondary Skills:

- Azure Data Factory

- Apache Airflow, dbt, Fivetran

- Data Modeling & Data Warehousing

- CDC & SCD Type 1/2

- Power BI & Amazon QuickSight

- Delta Lake, Terraform & CI/CD

📌 Data Engineer (Coimbatore)
🏢 QBrainX India
📍 Coimbatore