15 Nov
|
Tata Consultancy Services
|
Bengaluru
15 Nov
Tata Consultancy Services
Bengaluru
## Job highlights
- 10+ years experience in Data Engineering with expertise in Databricks, Python, PySpark, SQL, DBT, AWS data services, Cloudformation, CI/CD, Apache Airflow, and data modeling
- Develop and orchestrate data pipelines using Python, PySpark, dbt, SQL, manage automated testing, release management, and implement AI-augmented engineering workflows Role-Data Engineer Location-Bengaluru,Chennai,Hyderabad,Kolkata Exp-10+ Years Skills- Data Engineering with Databricks, Python, PySpark, SQL, DBT
- Strong in Python & Pyspark programming, SQL
- Has good experience in developming of Data Pipelines and Data Curation using AWS native data services (and Azure Synapse & ADLS)
- Has good experience on AWS Cloudformation for IaC and CI/CD using Git, Harness and Kubernetes
- Pipeline orchestation using Apache Airflow
- Data modeling experience
- Valuable communication skill and understanding/experience of working in Agile delivery
- AI-Augmented Engineering Delivery leveraging (Copilot, VS Code agent mode) into engineering workflow code generation, test creation, code review, documentation Responsibilities- •
- Pipeline Development Python / PySpark / dbt / SQL
•
- Pipeline Orchestration Apache Airflow (primary) / Autosys (legacy only)
•
- Automated Unit and Integration Testing
•
- Release Management and CAB Coordination
•
- AI-Augmented Engineering Delivery leveraging (Copilot, VS Code agent mode) into engineering workflow code generation, test creation, code review, documentation
📌 Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru