19 Nov
|
Insight International (UK
|
Hyderabad
19 Nov
Insight International (UK
Hyderabad
Role: Senior Data Engineer (Dremio Platform Developer)
Location: Hyderabad (Hybrid)
Job Type: Permanent
Summary:
We are seeking an experienced Senior Data Engineer / Dremio Platform Developer to join a banking technology team supporting in Hyderabad. The ideal candidate will have robust hands-on experience in Dremio, SQL, data engineering, data virtualization, and cloud-based data platforms, along with excellent communication skills and experience working in an Agile delivery environment. The candidate will design, develop, optimize, and support scalable data solutions, collaborating with business stakeholders, product owners, architects, and globally distributed engineering teams.
Key Responsibilities
Dremio Platform Development
- Design, develop, and maintain data virtualization solutions using Dremio.
- Build and optimize virtual datasets (VDS), physical dataset configurations, and semantic layers.
- Develop complex SQL queries, reusable data views, and analytical data models.
- Configure and optimize reflections to improve query performance.
- Integrate Dremio with enterprise data sources, data lakes, and cloud storage platforms.
- Troubleshoot query performance, connectivity, metadata, and data-access issues.
- Implement secure, scalable,
and reusable data access solutions.
Data Engineering and Integration
- Develop and maintain enterprise data pipelines and data integration solutions.
- Work with structured and semi-structured data across banking applications.
- Integrate data from relational databases, cloud data lakes, and enterprise data platforms.
- Apply data quality, validation, reconciliation, and governance standards.
- Optimize data processing and query execution for high-volume datasets.
- Support data modernization and cloud transformation initiatives.
Agile Delivery and SDLC
- Participate in sprint planning, daily stand-ups, backlog refinement, sprint reviews, and retrospectives.
- Collaborate with product owners and business analysts to define user stories and technical designs.
- Provide accurate effort estimates and deliver committed sprint objectives.
- Develop unit tests, support integration testing, and resolve defects.
- Participate in code reviews and follow engineering standards.
- Use Jira, Confluence, Git, and CI/CD tools for development and release management.
- Follow enterprise SDLC, change management, and production release processes.
📌 Senior Data Engineer (Dremio Platform Developer) (Hyderabad)
🏢 Insight International (UK
📍 Hyderabad