13 Aug
|
Tata Consultancy Services
|
Bengaluru
13 Aug
Tata Consultancy Services
Bengaluru
Role - Data Analyst/Engineer (collibra)-AWS
Desired Experience Range- 6-12 Years
Location- Chennai, Kochi, Trivandum, Bengaluru.
Job Description-
Responsible for building and maintaining data pipelines and transformation logic using PySpark/Databricks, enabling analytics and reporting use cases.
Roles & Responsibilities
- Develop ETL/ELT data pipelines using PySpark/Spark leveraging lakeflow declarative pipelines
- Perform data transformation, cleansing, and enrichment
- Optimize Spark jobs for performance and cost efficiency
- Build datasets for analytics, reporting, and BI consumption
- Leverage AWS query federation SDK/Databricks Datasource API for query federation
- Work with multiple data sources (S3, APIs, etc.) 1
- Support data validation, reconciliation, and testing
- Collaborate with architects, analysts, and downstream teams
- Experience in Data transformation & pipeline development
- Positive to have experience in AWS Cloud ,AWS Databricks , Python , SQL, PySpark, Spark SQL ,Python , SQL,Collibra.
📌 Data Analyst/Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru