01 Aug
|
Nameless
|
Chennai
Job Description
- Years of Experience: 3 to 8 Years
- Role Type: Fixed Term Contract (6 Months)
- Payroll Organization: Talpro
- • CTC Offered:
> > - Exp Up to 5 Yrs - ₹100,000 per month (Maximum Rate)
>
>> - Exp 5 Yrs + - ₹1,50,000 per month (Maximum Rate)
>
- • Shift Timing: Day shift IST, from 12pm
- • Notice Period: Immediate Joiners Only
- • Work Location: Bangalore
- • Work Mode: Hybrid (3 Days from Office Weekly)
- Mandatory Skills:
- Databricks
- SQL
- PySpark
- Python
Requirements
⸻
Mandatory Skills:
- • 5 years of hands-on experience as a Databricks / PySpark Developer
- • Robust Python programming skills
- • Proficient understanding of Apache Spark concepts (DataFrames, Spark SQL, MLlib)
- • Familiarity with cloud platforms (preferably Azure)
- • Hands-on with Azure Data Factory and other Azure services
- • Proficiency in SQL for ETL logic and Delta Lake
- • Strong experience in data pipeline design, ETL development, and Spark job optimization
- • Hands-on experience with GitLab and understanding of CI/CD pipelines, DevOps tools
-
Good to Have Skills:
- • Exposure to data warehousing concepts and data modeling
- • Experience creating stored procedures, functions, tables, cursors
- • Knowledge of database testing, data comparison, and transformation scripting
- • Troubleshooting and performance profiling of database/server resources
-
⸻
Role Overview / Job Summary:
We are looking for a skilled Databricks Developer with strong Python expertise to join our Data Engineering team in Bangalore. The ideal candidate will have solid experience building and optimizing large-scale data pipelines using Databricks and PySpark. You will be responsible for ETL design and development, data processing workflows, and ensuring best practices in data engineering within a hybrid work setup.
⸻
Key Responsibilities / Job Responsibilities:
• Design, develop, and deploy ETL processes on Databricks for data integration and transformation
• Build and optimize data pipelines, architectures, and datasets
• Implement and fine-tune Spark jobs, data transformations, and processing workflows
• Collaborate with data engineers, architects, and stakeholders to ensure efficient storage and processing
• Apply best practices for pipeline monitoring, logging, and error handling
• Work with Azure Data Factory and cloud services to deliver robust data solutions
• Engage in DevOps practices using GitLab and CI/CD pipelines
⸻
Additional Instructions:
• Immediate Joiners Preferred
• Candidates must be open to working onsite 1 to 3 days a week in Bangalore
• All mandatory skills must be clearly visible in the candidate’s CV for consideration
📌 Databricks Developer with Python (Chennai)
🏢 Nameless
📍 Chennai