28 Sep
|
Ishan Technologies
|
Nagpur
28 Sep
Ishan Technologies
Nagpur
Basic Information:Experience: 6 to 8 YearsLocation: PuneMust Required Skill: Google Cloud Platform (GCP)Immediate JoinersJob PurposeWe are seeking experienced Data Engineer hands-on experience in designing, building, and managing large-scale data pipelines and cloud-based data infrastructure. The ideal candidate will have strong expertise in Google Cloud Platform (GCP) and experience integrating data from web and mobile applications, including React-based systems and Firebase services. You will play a key role in ensuring the reliability, scalability, and efficiency of data pipelines while collaborating closely with developers, data scientists, and product teams to deliver high-quality, actionable data solutions.Key Responsibilities1. Data Pipeline Development:- Design, build, and maintain scalable and effective data pipelines to ingest, process, and transform large datasets from web and mobile applications.- Implement ETL (Extract, Transform, Load) processes to integrate data from multiple sources, including Firebase (Firestore, Firebase Analytics).- Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments.2. Data Infrastructure Management:- Develop and manage data storage solutions (databases, data warehouses, data lakes) to support back-end and analytical needs.- Configure and maintain cloud-based data infrastructure, ensuring scalability, security, and high availability.- Automate infrastructure tasks such as schema migrations, data partitioning, and backup management for seamless operations.3.
Data Integration & API Development:- Build and maintain APIs and data access layers to enable seamless data integration with React-based and cloud-native applications.- Consolidate and unify data from disparate sources for analytics and product functionalities.- Ensure data consistency, integrity, and synchronization across systems, supporting both batch and real-time data processing.4. Collaboration & Communication- Partner with data scientists, software developers, and product managers to understand data requirements and deliver effective data solutions.- Provide regular updates on data infrastructure health, data availability, and pipeline performance.- Collaborate with engineering teams to integrate pipelines with production environments, including Firebase-hosted systems.5. Data Quality & Monitoring- Implement robust data quality checks and validation mechanisms.- Monitor and troubleshoot pipeline performance and data latency using cloud monitoring tools.- Maintain documentation, metadata, and data lineage for compliance and traceability.Qualification & Experience- Education: B.E / M.E / B.Tech / M.Tech / BCA / MCA- Experience: 5+ Years- Certifications (if any): Google Cloud PlatformRequired Skills & CompetenciesTechnical Skills:Google Cloud Platform (GCP) , BigQuery , Cloud Dataflow , Cloud Storage , Cloud Functions , Firebase , Firestore , Cloud Monitoring , IAM & Security Management , ETL/ELT Development , Data Pipeline Design & Development , Data Modeling , Data Warehousing , Data Migration , Python , API Integration , CI/CD Pipelines , Infrastructure as Code (IaC)Functional Skills:End-to-End Pipeline Development , Data Warehouse Design , Data Consolidation , Firebase Integration , Data Governance , Query Optimization , Production Deployment Support , Stakeholder Communication , API-based Data Exchange , Cloud Data ArchitectureBehavioral Competencies:Problem Solving & Analytical Thinking , Ownership & Accountability , Collaboration & Teamwork , Innovation & Continuous Improvement , Adaptability , Customer & Business Focus
📌 Sr. Data Engineer - GCP (Nagpur)
🏢 Ishan Technologies
📍 Nagpur