We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. The ideal candidate will design, build, and optimize scalable data pipelines with solid SQL proficiency and data modeling expertise.

Responsibilities
Design, develop, and maintain scalable pipelines to process structured and unstructured data.
Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
Experience working with data warehouse solutions (e. g., Redshift, BigQuery, Snowflake) for analytics and reporting.
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
Experience in Implementing solutions for streaming data (e. g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
Ensure data quality, governance, and security across pipelines and storage systems.
Document architectures, processes,



and workflows for clarity and reproducibility.

Requirements
4 or more years of experience in Data Engineering file.
Expertise in SQL (complex queries, optimization, and database design).
Write optimized and production-grade SQL scripts for transformations and data validation.
Solid understanding and hands-on experience in creating data pipelines and patterns.
Proficiency in any programming languages like Python or R for scripting, automation, and pipeline development.
Hands-on experience with Google Bigquery and Apache Airflow.
Experience working on any cloud-based platforms like AWS or GCP or Azure.
Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
Familiarity with cloud-based data warehouses (Redshift, BigQuery, and Snowflake).
Knowledge of version control systems (e. g., Git) and CI/CD practices.

This job was posted by Kumar Ags from BigThinkCode.

📌 Sr Data Engineer Chennai (India)
🏢 BigThinkCode
📍 India