Role Summary:The ideal candidate will design, build, and optimize scalable data pipelines using Databricks and related technologies, enabling faster data-driven decisions for the company.Key Responsibilities:- Design, develop, and optimize end-to-end batch and streaming data pipelines using Azure Databricks and Spark.- Apply Medallion Architecture to structure data layers (raw, enriched, curated).- Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.- Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency.- Collaborate closely with analysts, architects, and business teams to deliver end-to-end data solutions.- Support and maintain existing data pipelines and solutions.- Implement data quality rules and principles.- Participate in code reviews and contribute to best practices.Must-Have Qualifications:- Hands-on experience with Databricks, Delta Lake, and Data Factory.- Proficiency in Python, PySpark,
and SQL with strong query optimization skills.- Deep understanding of Lakehouse architecture and Medallion design patterns.- Experience building scalable ETL/ELT pipelines.- Familiarity with Git, CI/CD pipelines, and Agile methodologies.Nice to Have:- Knowledge of data quality frameworks and monitoring practices.- Experience with data visualization tools.- Experience working in managed services.Behavioral Competencies:- Strong problem-solving and analytical skills.- Attention to detail and commitment to data quality.- Team-oriented mindset and effective communication.- Proactive and self-driven.Why Join Us:- The company offers a dynamic work environment that fosters innovation.- Recognized as a Great Place to Work in 2021, ensuring a high-trust and high-performance culture.- Employees have the opportunity to work with cutting-edge technologies.- Committed to personal and professional growth. (ref:hirist.tech)
📌 Senior Data Engineer - Databricks (Bengaluru)
🏢 ARA Resources
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.