We are hiring for the below skill , kindly share the below details .
Skill : ETL+ DataBricks+ AWS
Exp : 9-12 yrs
Location : Chennai/ Bangalore/ Ahmedabad
JD
BIG DATA LEAD • Domain Expertise Clinical research Data (Positive to have) • Develop / Build high-performance and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks). Handson development of Batch and incremental pipelines, streaming pipelines (Kafka, etc) Ensure high code quality and reusability • Proficiency in AWS (S3, Glue) • Perform advanced Spark optimization and cluster sizing • Implement CI/CD, version control, and DevOps best practices within Databricks. • Execute and Maintain data governance framework, scripts and Data lineage reports & Data Quality reports • Perform Technical Tests before UAT and provide sign-off (Bronze layer) • Plan and execute sprint deliveries • Review code, enforce standards • Act as the primary technical point of contact for delivery