We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. The ideal candidate will design, build, and optimize scalable data pipelines with solid SQL proficiency and data modeling expertise.

Responsibilities

- Design, develop, and maintain scalable pipelines to process structured and unstructured data.

- Optimize and manage SQL queries for performance and efficiency in large-scale datasets.

- Experience working with data warehouse solutions (e. g., Redshift, BigQuery, Snowflake) for analytics and reporting.

- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.

- Experience in Implementing solutions for streaming data (e. g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.

- Ensure data quality, governance, and security across pipelines and storage systems.

- Document architectures, processes,



and workflows for clarity and reproducibility.

Requirements

- 4 or more years of experience in Data Engineering file.

- Expertise in SQL (complex queries, optimization, and database design).

- Write optimized and production-grade SQL scripts for transformations and data validation.

- Solid understanding and hands-on experience in creating data pipelines and patterns.

- Proficiency in any programming languages like Python or R for scripting, automation, and pipeline development.

- Hands-on experience with Google Bigquery and Apache Airflow.

- Experience working on any cloud-based platforms like AWS or GCP or Azure.

- Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).

- Familiarity with cloud-based data warehouses (Redshift, BigQuery, and Snowflake).

- Knowledge of version control systems (e. g., Git) and CI/CD practices.

This job was posted by Kumar Ags from BigThinkCode.

📌 Sr. Data Engineer (Chennai)
🏢 BigThinkCode
📍 Chennai