08 Sep
|
Tata Consultancy Services
|
Hyderabad
08 Sep
Tata Consultancy Services
Hyderabad
An Azure Data Engineer designs, builds, and manages scalable data pipelines and cloud storage solutions on the Microsoft Azure platform.
Location- Chn/blr/hyd
Core Responsibilities
- Pipeline Development: Build and maintain ETL/ELT workflows using Azure Data Factory to move data from various sources into centralized storage.
- Data Processing: Transform, clean, and aggregate large datasets using Azure Databricks, Spark, and PySpark.
- Storage Management: Configure and optimize data lakes and warehouses via Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
- Performance & Quality: Monitor pipeline performance, troubleshoot query execution, and ensure data integrity and security (RBAC, encryption).
Key Skills & Tech Stack
- Languages: Advanced SQL and Python/PySpark.
- Azure Services: ADF, ADLS Gen2, Databricks, Synapse Analytics, and Stream Analytics.
- Data Modeling: Dimensional modeling, star/snowflake schemas, and data warehousing concepts.
- DevOps: Git version control and CI/CD pipeline integration.
If you are tailoring a resume or drafting a specific job posting, tell me:
- The experience level required (Junior, Mid-level, Senior)
- Any specific industry tools to include (like Snowflake, Terraform, or Kafka)
📌 Data Engineer (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad