Expertise in Designing and developing scalable Apache spark / ETL based Data processing pipelines.
Robust command-line knowledge in Unix/Linux with Shell scripting using Bash, Kornshell or Perl and File processing using awk scripts.
Expertise in SQL querying and complex joins.
Implementing comprehensive Spark based Data validation frameworks, transforming large volumes of Financial data within the Project lifecycle
Expertise with complex Data workflows with Apache AirFlow, managing task dependencies, SLAs etc to ensure timely data delivery and corresponding automated validation controls .
Solid Analytical skills and expertise on SparkSQL for Data analysis and validation; ensuring the delivery of clean, query-ready datasets for business consumption.
Expertise in Data quality checks and monitoring.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Apache Spark Professional Hyderabad
🏢 PSRTEK
📍 Hyderabad