Job DescriptionAWS Data Engineer / Databricks / PySpark Technical Lead
nExperience: 5-10 Years
nLocation: Bangalore (Whitefield)
nJob Summary
nWe are seeking an experienced AWS Data Engineer / Databricks / PySpark Technical Lead with strong expertise in designing, developing, and implementing large-scale data solutions on AWS and Databricks platforms. The ideal candidate should have extensive hands-on experience with Python, PySpark, Spark SQL, Kafka, Airflow, and cloud-based data engineering solutions.
nKey Responsibilities
n
- n
- Design, develop, and optimize scalable data pipelines using Python, PySpark, Spark SQL, Databricks, and AWS Services.n
- Lead end-to-end architecture, design, development, and implementation of big data solutions.n
- Develop and maintain real-time and batch data processing workflows using Apache Kafka and Airflow.n
- Build and support data integration solutions using APIs, streaming platforms, and cloud-native services.n
- Perform data modeling, database design, performance tuning, and optimization activities.n
- Support production systems,



troubleshoot critical issues, and provide timely resolutions.n
- Collaborate with business stakeholders, cross-functional teams, and vendors to deliver high-quality solutions.n
- Mentor junior team members and provide technical leadership in Agile development environments.n
- Participate in code reviews, architecture discussions, and best practice implementation.n

nRequired Skills
n
- n
- Solid experience in Python, PySpark, Spark SQL, Databricks, AWS Cloud Services.n
- Minimum 2+ years of Apache Kafka streaming experience.n
- Hands-on experience with Apache Airflow.n
- Experience working with Oracle, PostgreSQL, and NoSQL databases.n
- Good knowledge of SQL, PL/SQL, Unix Shell Scripting, and Autosys.n
- Experience with GitHub, Agile methodologies, and CI/CD practices.n
- Strong analytical, troubleshooting, and problem-solving skills.n
- Excellent communication and stakehol

📌 AWS Data Engineer/ Data Bricks/Pyspark (Karnataka)
🏢 Tata Consultancy Services
📍 Karnataka