Job Information : Department Name

- Banking

Date Opened

- 03/15/2026

Industry

- IT Services

Job Type

- Full time

Work Experience

- 10 - 12 Years

City

- Chennai

State/Province

- Tamil Nadu

Country

- India

Zip/Postal Code

- 600032

About Us :

- Kumaran Systems was founded by a bunch of young professionals who were passionate about technology and its unlimited possibilities. What started off in 1990 as a product development company soon developed a twin focus on legacy migrations. With ground-breaking solutions to offer to the waiting world, Kumaran Systems achieved instant success. And soon, we went on to become the world leader in ORACLE migration solutions. And the rest is recorded history. Today, our tally shows over 2000 successful projects including legacy migrations and deployment of enterprise management solutions.

Job Summary : Key Responsibilities : Pipeline Development

- Design, develop, and maintain ETL/ELT data pipelines using PySpark and SQL in Databricks notebooks.
- Process large-scale datasets and ensure reliable and efficient data transformations.

Architecture Design

- Implement data lake and data warehouse architectures using Databricks Delta Lake and Delta Live Tables .
- Build and manage Medallion Architecture (Bronze, Silver, Gold layers) for structured data processing.

Performance Optimization

- Optimize Spark jobs and queries for performance, scalability, and cost-efficiency.
- Manage cluster configurations, partitioning strategies, and caching mechanisms .

Cloud Integration

- Integrate Databricks solutions with cloud services such as:

- Azure Data Factory (ADF)

- Azure Data Lake Storage (ADLS) Gen2

- AWS S3 or other cloud storage platforms

Data Governance & Quality

- Implement data quality checks, validation frameworks, and monitoring processes .
- Ensure data security, encryption, masking, and lineage tracking .

Workflow Automation





- Build and manage automated workflows and scheduling using Databricks Jobs, Airflow, or CI/CD pipelines.
- Integrate with DevOps tools such as Azure DevOps or Jenkins for continuous integration and deployment.

Collaboration

- Work closely with data engineers, analysts, and business stakeholders to translate business requirements into scalable data solutions.
- Participate in Agile development processes including sprint planning and technical discussions.

Required Skills & Qualifications : Core Technologies

- 10+ years of experience with Databricks, Apache Spark, and Python (PySpark) .
- Strong experience building scalable ETL/ELT pipelines .

SQL Expertise

- Advanced knowledge of Spark SQL or Databricks SQL for data transformation and analysis.

Cloud Platforms

- Hands-on experience with Azure Databricks, AWS, or Google Cloud Platform (GCP) .

Data Modeling

- Experience with Delta Lake and Medallion Architecture (Bronze/Silver/Gold layers) .
- Solid understanding of data modeling and data warehouse concepts .

Version Control & CI/CD

- Proficiency with Git and CI/CD tools such as Azure DevOps or Jenkins .

Preferred Qualifications :

- Experience with Data Build Tool (dbt) .
- Knowledge of workflow orchestration tools such as Apache Airflow .
- Experience with Machine Learning workflows using MLflow .
- Familiarity with data governance and enterprise data platforms .

Education :

- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field .

Key Competencies :

- Strong problem-solving and analytical skills
- Ability to handle large-scale data processing environments
- Good communication and collaboration skills in Agile teams

Kumaran Systems is an Equal Opportunity Employer and does not discriminate on the basis of race or ethnicity, religion, sex, national origin, age, veteran disability or genetic information or any other reason prohibited by law in employment.

📌 Data Bricks Expert (Chennai)
🏢 Kumaran Systems
📍 Chennai