Job DescriptionJob Title: Technical Lead - Python/PySpark Data Engineering
NLocation: Bangalore
NExperience: 5-10 Years
NJob Description
nWe are looking for an experienced Technical Lead with robust expertise in Python, PySpark, Databricks, AWS Cloud, SQL, and Apache Kafka to lead the design, development, and implementation of scalable data engineering solutions. The ideal candidate will have extensive hands-on experience in big data processing, cloud-based data platforms, and real-time streaming architectures.
NPrimary Skills
n
- n
- Python N
- PySpark / Apache Spark N
- Databricksn
- AWS Cloud Services N
- SQL / Spark SQLn
- Apache Kafka N

nSecondary Skills
N
- n
- Apache Airflow N
- Oracle Databasen
- PL/SQL N
- Unix Shell Scripting N
- AutoSysn
- Test-Driven Development (TDD) N
- GitHubn

nKey Responsibilities
N
- n
- Design, architect, and develop scalable data processing applications using Python, PySpark, Databricks, and AWS. N
- Build and optimize batch and streaming data pipelines using Apache Kafka and Airflow. N




- Lead end-to-end implementation of Databricks solutions, including architecture, development, deployment, and performance tuning. N
- Develop and maintain complex ETL/ELT solutions for large-scale data platforms. N
- Work closely with business stakeholders, vendors, and cross-functional teams to deliver high-quality solutions. N
- Support production systems, troubleshoot critical issues, and provide timely resolutions. N
- Perform data modeling, database design, and performance optimization. N
- Mentor junior developers and provide technical leadership to Agile teams. N
- Ensure adherence to best practices in software development, testing, and deployment. N

nRequired Qualifications
N
- n
- 5-10 years of overall IT experience with strong data engineering expertise. N
- Strong hands-on experience in Python, PySpark, Spark SQL, Databricks, and AWS. N
- Minimum 2+ years of experience with Apache Kafka

📌 Hiring: Aws Data Engineer/ Data Bricks/Pyspark (Karnataka)
🏢 Tata Consultancy Services
📍 Karnataka