NOTE: Please carry a copy of your Aadhar or PAN Card Xerox

Relevant Experience Required

- Hands-on experience in developing, maintaining, and optimizing data pipelines using Databricks.
- Knowledge of ETL/ELT pipelines, data ingestion, transformation, and orchestration.
- Exposure to data lake, data warehouse, or lakehouse architectures.
- Experience with data migration, integration, and automation.
- Collaboration with senior engineers, architects, and analytics teams for solution delivery.
- Familiarity with security, access control, and compliance best practices.
- Working experience in Agile and DevOps environments

Must Have Skills

- Hands-on experience with Databricks platform, including:
- PySpark / Spark SQL for data processing and transformation
- Delta Lake for ACID-compliant data storage
- Notebooks for workflow orchestration and cooperative development




- Strong programming skills in Python and SQL.
- Experience in data ingestion from batch and streaming sources.
- Knowledge of ETL/ELT design patterns and data pipeline optimization.
- Familiarity with cloud data storage and compute environments (AWS, Azure, or GCP).
- Basic understanding of workflow orchestration tools (Airflow, Databricks Jobs).
- Exposure to DevOps concepts, CI/CD pipelines, and version control (Git).
- Awareness of data security, access control, and compliance considerations.
- Understanding of performance tuning, partitioning, and caching strategies in Spark.

Responsibilities

- Develop and maintain scalable data pipelines using Databricks (PySpark, Delta Lake).

📌 Walk-in || Databricks Data Engineer (Visakhapatnam)
🏢 Tata Consultancy Services
📍 Visakhapatnam