11 Sep
|
Tredence
|
Bengaluru
11 Sep
Tredence
Bengaluru
Role: Associate Data Engineer -Azure Databricks
Exp Level: 1-2 Yrs
Work Location: Bangalore
Notice Period: Immediate
We are looking for a Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will enable reliable, scalable, and high-quality data flows that power analytics and machine learning across the organization.
Key Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines to ingest data from diverse sources.
- Develop and optimize data models and schemas for analytics and reporting use cases.
- Build and maintain data infrastructure on cloud platforms (Azure, AWS, or GCP).
- Ensure data quality, reliability, and observability through monitoring, testing, and validation frameworks.
- Collaborate with data scientists and analysts to provision clean, well-structured datasets.
- Implement data governance, security, and access control best practices.
- Optimize pipeline performance and manage cost efficiency of data processing workloads.
- Contribute to CI/CD practices for data pipeline deployment and version control.
Required Skills & Qualifications
- 1-2 years of experience in data engineering or a related field.
- Solid proficiency in SQL and at least one programming language (Python, Pyspark).
- Hands-on experience with distributed data processing frameworks (Apache Spark, or similar).
- Experience building pipelines using orchestration tools (Airflow, Azure Data Factory, or similar).
- Experience working with cloud data platforms (Azure) and modern data warehouses (Snowflake, BigQuery, Redshift, or Databricks).
- Solid understanding of data modeling concepts (dimensional modeling, star/snowflake schemas).
- Familiarity with version control (Git) and CI/CD practices.
📌 Data Engineer-Azure Databricks (Bengaluru)
🏢 Tredence
📍 Bengaluru