Job Type: Full-time

Remote: Hybrid

About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdTeamware Solutions (a division of Quantum Leap Consulting Pvt. Ltd.) is a 20+ year industry leader providing IT staffing and consulting services, supporting 4000+ professionals across India, the USA, the Middle East, and APAC for leading GCC clients.About the RoleWe are hiring a Senior Data Engineer – PySpark | Databricks | Airflow | AWSLocation: BangaloreWork Model: HybridExperience: 7+ yearsNotice Period: Immediate - 15 daysProject:Objective of the project is to implement a solution to retain all data / documents needed to satisfy (a) Retention requirements of all Acts and Regulations governing the Credit Cards business (e.g. ECOA, FCRA, EFTA, TILA etc.), (b) GS Privacy Policy and (c) Any litigation and legal holds. The solution should enable retrieval of data/documents to service Regulatory inquiries, Audit requests, Litigation requests, as well as all account documentation requirements from other external parties related to the business.Role & Responsibilities:Design and maintain scalable data pipelines for data ingestion, transformation, and processing.Build and optimize ETL/ELT workflows using PySpark, Databricks, SQL, and Airflow.Develop data models and solutions for retention, reporting, and analytics needs.Ensure data quality, integrity,



and reliability through validation and monitoring frameworks.Integrate data from multiple sources and optimize processing performance.Collaborate with cross-functional teams to deliver data solutions and resolve data issues.Maintain technical documentation, data lineage, and mapping artifacts.Support production deployments, troubleshooting, and continuous improvement through engineering best practices.Location: Bengaluru Office; Full-time, work from the officeTechnical Skills Requirements:PySpark & Spark SQL: Hands-on experience writing production-grade PySpark codeDatabricks: Proven experience working within Databricks environments, including cluster configuration and Delta LakeApache Airflow: Robust experience building and managing pipelines in Apache AirflowSQL Mastery: Advanced SQL skills (window functions, CTEs, query optimization, indexing strategies)Data Modeling: Solid understanding of modern data warehousing conceptsVersion Control: Proficiency with Git and CI/CD deployment workflowsAWS: Experience in Amazon Web Services (AWS) cloud infrastructureETL/ELT: Proven track record of designing, building, and optimizing scalable ETL/ELT pipelines and data platformPlease let me know if you are interested in this position and send me your resume to [email protected]

📌 Senior Data Engineer – PySpark | Databricks | Airflow | AWS (Bengaluru)
🏢 Teamware Solutions
📍 Bengaluru