22 Oct
|
Tata Consultancy Services
|
Pune
22 Oct
Tata Consultancy Services
Pune
Hiring: Python Data Engineer
Location: Chennai ,Kochi, Bangalore ,Pune ,Bhubaneshwar
Experience: 5-10 Years
Interview Mode: Virtual
Interview Date: To Be Announced
We are seeking an experienced Python Data Engineer with strong expertise in Azure Cloud, Databricks, PySpark, SQL, and Data Engineering. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, performing data analysis, and collaborating with cross-functional teams to deliver robust data-driven solutions.
Ideal Candidate
- 5-8 years of hands-on experience in Python Development.
- Strong expertise in PySpark, Pandas, NumPy, and SQL.
- Experience in building large-scale Data Engineering and ETL solutions.
- Robust working knowledge of Azure Cloud Services and Azure Data Lake Storage (ADLS).
- Hands-on experience with Azure Databricks.
- Understanding of DevOps practices, CI/CD pipelines, and automation.
- Experience in data modeling, data transformation, and performance tuning.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
- Build and implement data processing algorithms leveraging Pandas, NumPy, PySpark, and related libraries.
- Develop and optimize ETL/ELT workflows for extracting, transforming, and loading large datasets.
- Work extensively with Azure Data Lake Storage (ADLS) and Azure data services.
- Utilize Databricks to develop and deploy scalable data engineering solutions.
- Collaborate with Engineers, Data Scientists, and Researchers to gather requirements and deliver end-to-end data solutions.
- Perform data analysis, validation, and experimentation to ensure solution accuracy and reliability.
- Optimize data pipelines and processing jobs for performance, scalability, and efficiency.
- Independently develop, test, debug, and support applications of varying complexity.
Role: Data Engineer, Industry Type: IT Services & Consulting, Department: Engineering - Software & QA, Employment Type: Full Time, Permanent Role Category: Software Development Education UG: B.Tech / B.E. in Any Specialization read more
Key Skills Skills highlighted with ‘‘ are preferred keyskills Data EngineeringPythonPyspark Data BricksAzure DatabricksSQLNumpyPandas
📌 Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune