13 Nov
|
Tata Consultancy Services
|
Visakhapatnam
13 Nov
Tata Consultancy Services
Visakhapatnam
Develop and maintain ETL pipelines using PySpark / Spark SQL in Azure Databricks .-
- Implement data pipelines ensuring data quality, governance, and lineage tracking .- Integrate data from different systems such as core banking, payments, and trading platforms .- Optimize Spark jobs for high performance and cost efficiency .- Collaborate with business teams and compliance departments to align on project requirements.-
- Perform advanced data transformations and develop user-defined functions (UDFs) where necessary.- Use Unix scripting, scheduling tools , and maintain generic process development and performance tuning .- Support audit requirements and ensure compliance with regulatory standards
- Location
- Visakhapatnam
- Job Function
- IT INFRASTRUCTURE SERVICES
- Role
- Developer
- Job Id
- 418259
- Desired Skills
- Azure
Qualifications : BACHELOR OF ENGINEERING
📌 Azure Pyspark Data Engineer (Visakhapatnam)
🏢 Tata Consultancy Services
📍 Visakhapatnam