Hi

Experience; 6- 8 Years / Location: Pan India.

Notice Period: Immediate 30 Days Only.

- Solid SQL skills including joins, window functions, CTEs, query optimization, data modeling, and analytical queries.
- Hands-on experience with BigQuery, Cloud SQL, data warehouse concepts, partitioning, clustering, views, and performance tuning.
- Experience in PySpark / Spark for distributed data processing, transformations, aggregations, and troubleshooting performance issues.
- Knowledge of Databricks, Delta Lake, Medallion Architecture, notebooks, jobs, and lakehouse implementation concepts.
- Experience designing ETL / ELT pipelines using Airflow DAGs, operators, sensors, scheduling, retries, dependencies, and monitoring.
- Understanding of data quality, reconciliation, lineage,



metadata management, error handling, and production support practices.
- Experience working on GCP data services such as Cloud Storage, Dataflow, Pub/Sub, Composer, IAM, and monitoring tools.
- Exposure to CI/CD practices, Git, code reviews, deployment automation, and environment management.
- Understanding of cost optimization, query optimization, workload scheduling, and resource utilization in cloud data platforms.
- Ability to work with structured, semi-structured, and large-volume datasets in batch and near real-time processing scenarios.

📌 Data Engineer (Cloud composer & Apache Airflow) (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad