We are seeking a skilled Data Engineer responsible for designing, developing, and maintaining scalable data pipelines and data platforms. The role focuses on building reliable data ingestion and transformation processes using modern data engineering tools and frameworks. The ideal candidate will have solid experience with Python-based data engineering, SQL, and the Databricks platform, along with a solid understanding of data architecture and data modeling. This role will collaborate closely with analytics, platform, and business teams to ensure high-quality, well-structured data is available for reporting, analytics, and advanced data use cases.

Key Responsibilities
- Design, develop, and maintain scalable data pipelines for ingesting, transforming, and processing large volumes of data.
- Build and manage ELT/ETL pipelines using Python and modern data engineering frameworks.
- Utilize the Databricks platform to process and manage distributed data workloads.
- Develop and optimize Python-based data transformation logic using libraries such as Pandas, Polars,



and Delta Live Tables (DLT).
- Implement and maintain data transformations using dbt and SQL.
- Design and manage data schemas and data models to support analytical and operational workloads.
- Build and maintain data ingestion pipelines integrating with various ELT tools such as cData, Hevo, MuleSoft, or Fivetran.
- Monitor, troubleshoot, and resolve issues in data pipelines and workflows to ensure reliability and performance.
- Apply data architecture principles, including data lake structures and medallion architecture (Bronze, Silver, Gold layers).
- Optimize data processing and transformation logic for performance, scalability, and maintainability.
- Document data pipelines, transformations, and data models to ensure transparency and knowledge sharing.
- Collaborate with cross-functional teams to understand data requirements and deliver reliable data solutions.
- Use version control systems (Git) and foll

📌 Data Engineer (Bengaluru)
🏢 Potentiam
📍 Bengaluru