14 Aug
|
Tata Consultancy Services
|
India
14 Aug
Tata Consultancy Services
India
NOTE: Please carry a copy of your Aadhar or PAN Card Xerox
Relevant Experience Required
Hands-on experience in developing, maintaining, and optimizing data pipelines using Databricks.
Knowledge of ETL/ELT pipelines, data ingestion, transformation, and orchestration.
Exposure to data lake, data warehouse, or lakehouse architectures.
Experience with data migration, integration, and automation.
Collaboration with senior engineers, architects, and analytics teams for solution delivery.
Familiarity with security, access control, and compliance best practices.
Working experience in Agile and DevOps settings
Must Have Skills
Hands-on experience with Databricks platform, including:
PySpark / Spark SQL for data processing and transformation
Delta Lake for ACID-compliant data storage
Notebooks for workflow orchestration and cooperative development
Robust programming skills in Python and SQL.
Experience in data ingestion from batch and streaming sources.
Knowledge of ETL/ELT design patterns and data pipeline optimization.
Familiarity with cloud data storage and compute environments (AWS, Azure, or GCP).
Basic understanding of workflow orchestration tools (Airflow, Databricks Jobs).
Exposure to DevOps concepts, CI/CD pipelines, and version control (Git).
Awareness of data security, access control, and compliance considerations.
Understanding of performance tuning, partitioning, and caching strategies in Spark.
Responsibilities
Develop and maintain scalable data pipelines using Databricks (PySpark, Delta Lake).
📌 Walk In Databricks Data Engineer Visakhapatnam (India)
🏢 Tata Consultancy Services
📍 India