25 Sep
|
Tata Consultancy Services
|
India
25 Sep
Tata Consultancy Services
India
Role & responsibilities
Data Engineer
Location: Chennai / Bangalore
Experience:6+ Years
Employment Type: Full-Time
Preferred candidate profile
Job Summary
We are seeking a talented Data Engineer to build and maintain scalable data solutions that support analytics, reporting, and business intelligence initiatives. The ideal candidate will have solid experience in data engineering, ETL development, cloud platforms, and big data technologies.
Key Responsibilities
Design, develop, and maintain end-to-end data pipelines and ETL/ELT processes.
Build scalable and reliable data solutions for batch and real-time data processing.
Integrate data from various sources including databases, APIs, cloud platforms, and third-party systems.
Develop and optimize data models, data warehouses, and data lakes.
Ensure data quality, consistency, security, and governance across platforms.
Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
Collaborate with data analysts, data scientists, and business stakeholders to understand requirements.
Support data migration, transformation, and modernization initiatives.
Implement best practices for data architecture and engineering.
Maintain technical documentation and operational procedures.
Required Skills
4+ years of experience in Data Engineering.
Solid hands-on experience in:
Python
SQL
ETL/ELT Development
Data Warehousing
Data Modeling
Azure/AWS Cloud Platforms
Experience with one or more of the following:
Azure Databricks
Azure Data Factory (ADF)
Azure Synapse Analytics
Apache Spark / PySpark
Snowflake
Kafka
Airflow
Solid understanding of data lake and lakehouse architectures.
Experience with Git and CI/CD practices.
Knowledge of data governance, security, and compliance standards.
Preferred Skills
Experience working with large-scale data processing environments.
Exposure to real-time streaming technologies.
Cloud certifications (Azure Data Engineer Associate, AWS Data Analytics, etc.).
Experience with Power BI, Tableau, or other reporting tools.
Knowledge of DevOps and Infrastructure as Code (Terraform, ARM Templates).
📌 Data Engineer Chennai (India)
🏢 Tata Consultancy Services
📍 India