23 Aug
|
Tata Consultancy Services
|
Bengaluru
23 Aug
Tata Consultancy Services
Bengaluru
Job Description:
We are looking for a Data Engineer with strong experience in designing, building, and supporting scalable data pipelines, data warehouse solutions, and analytics-ready data platforms. The candidate should have hands-on knowledge of BigQuery, SQL, PySpark, ETL / ELT processes, Airflow orchestration, Cloud SQL, and Databricks. The role requires the ability to work with structured and semi-structured data, optimize data processing jobs, ensure data quality, and collaborate with business, analytics, and application teams to deliver reliable data solutions.
- Design, develop, and maintain effective ETL / ELT data pipelines using SQL, PySpark, Airflow, and cloud-native data services.
- Build and optimize BigQuery datasets, tables, views, partitioning, clustering, and query performance for large-scale analytical workloads.
- Develop data ingestion frameworks from multiple sources including databases, files, APIs, and cloud storage into enterprise data platforms.
- Implement data validation, reconciliation, monitoring, logging, and alerting mechanisms to ensure data accuracy and pipeline reliability.
- Work on Databricks and PySpark jobs for large-volume batch processing, transformation, and performance tuning.
- Collaborate with stakeholders to understand reporting requirements and convert them into scalable data models and reusable datasets.
- Support production data pipelines, troubleshoot failures, perform root-cause analysis, and drive timely remediation.
📌 Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru