Databricks (Hyderabad)

Databricks (Hyderabad)

13 Aug
|
Virtusa
|
Hyderabad

13 Aug

Virtusa

Hyderabad

⃣ Sr. Data Engineers (2) – Databricks Pipeline Developers
Role Overview
Build and maintain data pipelines in Databricks for ingestion, cleansing, enrichment, and storage.
Key Responsibilities
- Develop PySpark pipelines for
- API ingestion
- FTP file ingestion
- Data cleansing
- Enrichment transformations
- Implement incremental & batch loads
- Develop Bronze → Silver → Gold transformations
- Translate legacy SQL stored procedures into Spark jobs
- Optimize Delta Lake tables
- Implement validation checks
- Support testing & reconciliation

Required Skills
- Solid PySpark / Spark SQL
- Strong SQL (read & interpret legacy procedures)
- Experience with API integration
- Experience handling flat files (FTP ingestion)
- Experience with Delta Lake
- Knowledge of partitioning & optimization

📌 Databricks (Hyderabad)
🏢 Virtusa
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: databricks (hyderabad) / hyderabad