05 Sep
|
Paltech
|
Hyderabad
Role Summary
Responsible for building and managing scalable cloud-based ETL/ELT data pipelines, supporting data ingestion, storage, and analytics. The role involves working with cloud data platforms, optimizing performance and costs, and leveraging SQL, cloud services, and up-to-date data orchestration tools to deliver reliable data solutions.
Key Responsibilities
- Design and deploy automated ETL/ELT pipelines to ingest data from various sources (APIs, databases, logs) into cloud data warehouses.
- Maintain cloud storage solutions (Data Lakes and Data Warehouses).
- Monitor and tune query performance and cloud resource consumption to manage costs
Required Skills And Qualifications- Educational Background: Bachelor’s degree in computer science, Information Technology, or a related field.
- Technical Skills:
- Cloud Platforms: AWS (Redshift, S3, Glue) / Azure (Data Factory, Synapse) / GCP (BigQuery, Dataflow).
- Languages: Advanced SQL (essential) and Python or Scala.
- Data Processing: Apache Spark, Flink, or Kafka for real-time streaming.
- Orchestration: Apache Airflow, dbt, or Prefect
- Soft Skills: Excellent communication, teamwork abilities, and strong analytical and problem-solving skills.
📌 Azure Data Engineer (Hyderabad)
🏢 Paltech
📍 Hyderabad