23 Sep
|
Tata Consultancy Services
|
Maharashtra
23 Sep
Tata Consultancy Services
Maharashtra
Job Description: Data Engineer (GCP | Python | Airflow | SQL | Looker Studio)5+yrs of ExpRole SummaryWe are seeking a highly skilledData Engineerto design, build, and manage scalable data platforms and pipelines onGoogle Cloud Platform (GCP). The role focuses on enabling data-driven decision-making by delivering robust data pipelines, optimized data models, and business-friendly visualizations.Key Responsibilities1. Data Pipeline Development & EngineeringDesign, develop, and maintainscalable ETL/ELT pipelinesusing Python, SQL, and GCP toolsBuild batch and real-time data processing workflowsAutomate data pipelines usingApache Airflow (Cloud Composer)for orchestration2. Cloud Data Platform Management (GCP)Develop and manage data solutions usingBigQuery, Cloud Storage, Dataflow, and Pub/SubImplement scalable data warehousing and lakehouse architecturesMonitor and optimize cloud infrastructure performance, reliability, and cost3. Data Modeling & TransformationDesign and implement logical and physical data modelsPerformdata cleansing, transformation, and aggregationfor analytics readinessEnsure high data quality, integrity, and consistency across systems [expertia.Ai]4. Analytics & Visualization EnablementEnable business insights through dashboards usingLooker Studio / LookMLCollaborate with analysts and business teams to define reporting requirementsTranslate data into actionable insights for decision-making5.
Collaboration & Stakeholder EngagementWork closely withdata scientists, analysts, and business stakeholdersto gather requirementsProvide data platform support and resolve data-related issuesCommunicate technical solutions effectively to non-technical stakeholders6. Data Governance, Security & ComplianceImplement data governance, access control, and security best practicesEnsure compliance with data privacy regulations and enterprise policies7. Continuous Improvement & OptimizationIdentify and implement performance optimizations across pipelines and databasesIntroduce automation and best practices for DataOps and CI/CDStay updated with evolvingGCP and data engineering technologiesKey Skills & CompetenciesTechnical SkillsStrong programming expertise inPython and SQLHands-on experience withGoogle Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage)Workflow orchestration usingApache Airflow / Cloud ComposerExperience withETL/ELT pipeline design and data warehousingVisualization and reporting usingLooker Studio / LookMLFunctional & Process SkillsStrong understanding ofdata lifecycle (ingestion → transformation → analytics)Expertise indata modeling, data integration, and pipeline optimizationFamiliarity withAgile / DevOps practices in data engineeringSoft SkillsStrong analytical and problem-solving capabilitiesExcellent communication and stakeholder management skillsAbility to work in cross-functional, global teams
📌 Data Engineer (Maharashtra)
🏢 Tata Consultancy Services
📍 Maharashtra