Description
Roles & responsibilities
Design, develop, and implement data pipelines for scalable solutions using various technologies – Databricks or Microsoft Fabric
Conduct Code reviews and recommend best coding practices
Provide effort estimates to implement solutions, development effort for the proposed solutions
Develop and maintain comprehensive documentation for all proposed solutions. models, including detailed technical specifications, results of testing and evaluation, and datasets used for developing the solutions
Lead Architect and design efforts for Product development and application development for relevant use cases providing guidance and support to team members and clients
Implement best practices of Data Engineering and Architectural solution design, development, Testing and documentation
Participate in team meetings, brainstorming sessions, and project planning activities
Stay up-to-date with the latest advancements in Data Engineering area, to drive innovation and maintain a competitive edge
Stay hands-on with the design,
development and validation of systems and models deployed
Collaborate with audit professionals to understand business, regulatory and risk requirements and key alignment considerations for Audit
Drive efforts in the Data Engineering and Architecture practice area
Mandatory technical & functional skills
Databricks/Fabric/Spark Notebooks
SQL/NoSQL databases, Redis,
Full-Stack Development - React, Angular
Data Management: Design, implement, and manage AI-driven data solutions on the Microsoft Azure cloud platform, ensuring scalability and performance.
Data Integration: Develop and maintain data pipelines for AI applications, ensuring effective data extraction, transformation, and loading (ETL) processes using Azure Data Factory.
Big Data Processing: Utilize big data technologies such as Azure Databricks and Apache Spark to handle, analyze, and process large datasets for machine learning and AI applications.
machine learning framewor
📌 / Sr. Engg - GTS - Build AI (Hyderabad)
🏢 BSR
📍 Hyderabad