Hi

Experience; 6- 8 Years / Location: Pan India.

Notice Period: Immediate 30 Days Only.
Solid SQL skills including joins, window functions, CTEs, query optimization, data modeling, and analytical queries.
Hands-on experience with BigQuery, Cloud SQL, data warehouse concepts, partitioning, clustering, views, and performance tuning.
Experience in PySpark / Spark for distributed data processing, transformations, aggregations, and troubleshooting performance issues.
Knowledge of Databricks, Delta Lake, Medallion Architecture, notebooks, jobs, and lakehouse implementation concepts.
Experience designing ETL / ELT pipelines using Airflow DAGs, operators, sensors, scheduling, retries, dependencies, and monitoring.
Understanding of data quality, reconciliation, lineage,



metadata management, error handling, and production support practices.
Experience working on GCP data services such as Cloud Storage, Dataflow, Pub/Sub, Composer, IAM, and monitoring tools.
Exposure to CI/CD practices, Git, code reviews, deployment automation, and setting management.
Understanding of cost optimization, query optimization, workload scheduling, and resource utilization in cloud data platforms.
Ability to work with structured, semi-structured, and large-volume datasets in batch and near real-time processing scenarios.

📌 Data Engineer Cloud Composer & Apache Airflow Hyderabad (India)
🏢 Tata Consultancy Services
📍 India