13 Aug
|
7dxperts
|
Bengaluru
13 Aug
7dxperts
Bengaluru
Role & Responsibilities
- Own end-to-end solution design from understanding source system types, data extraction, and ingestion methods (batch, streaming, CDC, APIs, files, and databases) through to curated, analytics-ready data products.
- Remain deeply hands-on: personally write, test, and optimise production-grade code in Python, SQL, and Apache Spark, building data pipelines alongside the team.
- Lead the engineering team technically set technical direction, take ownership of delivery, and raise the overall standard of the team.
- Design and build multi-cloud data platforms across GCP BigQuery and Databricks, leveraging interoperability between the two (open table formats such as Delta Lake and Apache Iceberg, Delta UniForm, BigLake, and Unity Catalog catalog federation).
- Apply up-to-date data platform design patterns in particular the medallion architecture (bronze / silver / gold) to structure scalable, maintainable, and cost-efficient platforms.
- Design, build, review, and optimise ETL/ELT pipelines, ingestion frameworks,
and transformation logic for large-scale data processing.
- Take part in requirement analysis with stakeholders and clients; categorise requirements as small, medium, or complex, and plan estimation, sequencing, and effort accordingly.
- Set and enforce engineering best practices coding standards, testing, documentation, CI/CD, data quality, and governance.
- Perform code reviews and design reviews, mentoring engineers and ensuring designs are robust, performant, and maintainable.
- Own cloud infrastructure decisions compute, storage, networking, security, IAM, cost optimisation, and platform reliability across cloud environments.
- Troubleshoot and resolve complex data pipeline failures, performance bottlenecks, and data quality issues across environments.
- Define and implement data governance, security, lineage, and access-control standards across the platform.
- Drive technical decision-making architecture patterns, tooling selection, mod
📌 Technical Lead-Data Platform/Solution Architect (Bengaluru)
🏢 7dxperts
📍 Bengaluru