27 Sep
|
Tata Consultancy Services
|
Hyderabad
27 Sep
Tata Consultancy Services
Hyderabad
Job Description
Greetings from TCS
/n
TCS is hiring Data Engineer (Databricks with Azure)
/n
Location – Any
/n
Years of Experience – 4-15 years
/n
Job Description
/n
Role - Senior Data Engineer – Databricks
/n
Required Technical Skill Set
/n
Databricks, PySpark, Delta Lake, MLflow, Azure, Data Lakehouse architecture, CI/CD, DataOps
/n
Job description-
/n
/n
- Data Pipeline Development: Design, build, and optimize scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure services for data ingestion and processing.
/n
- Data Architecture: Develop and implement scalable data architectures, data warehouses, and data storage solutions (SQL/NoSQL) on Azure.
/n
- Data Quality & Security: Ensure data accuracy, consistency, integrity,
and security through robust governance and best practice implementation.
/n
- Performance Optimization: Monitor, troubleshoot, and optimize data systems and pipelines for optimal performance, efficiency, and cost-effectiveness.
/n
- Collaboration: Work closely with data scientists, data analysts, business stakeholders, and solution architects to understand requirements and deliver effective data solutions.
/n
- Automation: Implement automated data pipelines and workflows, and contribute to CI/CD (Continuous Integration/Continuous Delivery) using tools like Azure DevOps.
/n
📌 Data Engineer (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad