25 Sep
|
Brillio
|
Bengaluru
Data EngineerJob requirements
Key Responsibilities Logic Discovery and Requirements AnalysisWork with pricing analysts to identify custom definitions, calculations, transformations, dependencies, assumptions, edge cases, and ambiguities currently implemented in the Gold layer.Reverse-engineer analyst-written SQL, spreadsheet logic, and ad hoc calculations to define intended business behaviour.Translate legacy logic into explicit technical requirements and migration plans.Migration to the Silver LayerRe-implement approved pricing definitions as governed, reusable, documented dbt models in the Silver layer.Follow data modelling, naming, testing, version control, and code review standards.Build maintainable, scalable, auditable models independent of undocumented analyst knowledge.Apply dbt tests for uniqueness, not-null, accepted values, relationships, and business rules.Parity Validation and Quality AssuranceCompare migrated Silver-layer results with existing Gold-layer outputs and resolve differences.Validate results across representative periods, segments, boundary conditions, and known exceptions.Confirm migrations only after parity review and pricing analyst approval.Analyst Collaboration and Sign-OffPartner with pricing analysts to clarify calculations, confirm intended behaviour, and align on expected results.Lead walkthroughs and reviews; document analyst approval before retiring legacy definitions.Communicate risks, open questions, dependencies, and decisions to technical and business stakeholders.Documentation and LineageDocument business meaning, calculation rules, assumptions, exceptions, source inputs, ownership, lineage, tests,
and downstream consumers in dbt and Confluence.Ensure documentation enables future engineers and analysts to maintain logic without relying on the original analyst.Gold-Layer Cleanup and CutoverDecommission ad hoc Gold-layer logic after the Silver replacement is validated, approved, adopted, and downstream dependencies are updated.Verify retired logic is no longer used and operational documentation reflects the new source of truth.Required Qualifications5–8 years of data engineering experience on analytical data platforms.Strong SQL skills: joins, window functions, CTEs, aggregations, conditional logic, and optimisation.Hands-on dbt experience across models, tests, documentation, and lineage.Strong Snowflake experience, including modelling, performance tuning, and warehouse concepts.Experience refactoring, migrating, or modernising complex analytical logic.Ability to untangle ad hoc SQL and spreadsheet calculations and validate outputs.Strong understanding of data quality, reconciliation, testing, and release controls.Skilled at working with non-engineering stakeholders to clarify requirements and validate outcomes.Excellent communication and documentation habits.Core Skills and ToolsSQL; Python a plusSnowflakedbt, dbt CloudAirflowConfluence, Jira, SlackData modelling, quality validation, reconciliation, migration planning, stakeholder collaboration, and technical documentation.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
📌 Data Engineer442 (Bengaluru)
🏢 Brillio
📍 Bengaluru