04 Aug
|
Impetus Capital
|
Chennai
04 Aug
Impetus Capital
Chennai
Job Description – GCP Data Engineer (4–9 Years Experience)
Company: Impetus Technologies
Position: GCP Data Engineer
Experience: 4–9 Years
Location: Bangalore / Chennai / Gurgaon
Employment Type: Full-Time
We are seeking a highly skilled GCP Data Engineer with 4–9 years of experience in building scalable data platforms and modern data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience in designing, developing, and optimizing batch and real-time data processing solutions using GCP services and contemporary big data technologies.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines on Google Cloud Platform.
- Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.
- Develop batch and streaming data pipelines using Apache Beam, Dataflow, Spark, and Kafka.
- Implement data models and data warehousing solutions using BigQuery.
- Work with large-scale datasets and ensure data quality, governance, and security best practices.
- Integrate data from multiple sources including APIs, databases, cloud storage, and enterprise applications.
- Collaborate with architects, data scientists, analysts, and business stakeholders to deliver data-driven solutions.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
- Implement CI/CD practices and automate deployment processes for data engineering solutions.
- Participate in architecture reviews and contribute to cloud modernization initiatives.
Required Skills & Qualifications
Technical Skills
- 4–9 years of experience in Data Engineering and Big Data technologies.
- Strong hands-on experience with Google Cloud Platform (GCP).
- Expertise in:
- BigQuery
- Cloud Storage (GCS)
- Dataflow
- Pub/Sub
- Cloud Composer (Airflow)
- Dataproc
- Cloud Functions
- Strong programming skills in Python, PySpark, SQL, and Java/Scala (preferred).
- Experience building ETL/ELT pipelines and data integration frameworks.
- Good understanding of data warehousing concepts and dimensional modeling.
- Hands-on experience with Apache Spark, Hadoop ecosystem, and distributed computing frameworks.
- Experience with real-time data streaming technologies such as Kafka and Pub/Sub.
- Knowledge of containerization and orchestration tools such as Docker and Kubernetes.
- Experience with version control systems like Git and CI/CD pipelines.
Database Skills
- Strong proficiency in SQL.
- Experience with:
- BigQuery
- PostgreSQL
- MySQL
- Oracle
- NoSQL databases (MongoDB/Cassandra) is an added advantage.
Preferred Qualifications
- GCP Professional Data Engineer Certification.
- Experience working in Agile/Scrum environments.
- Exposure to data lake and lakehouse architectures.
- Knowledge of Delta Lake, Iceberg, or Hudi is a plus.
- Experience with Infrastructure as Code (Terraform) is preferred.
- Familiarity with data governance and security frameworks.
Education
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Why Join Impetus
- Prospect to work on large-scale cloud and data transformation projects.
- Exposure to cutting-edge GCP, AI, and analytics technologies.
- Collaborative and innovation-driven culture.
- Continuous learning and certification support.
- Fast-track career growth opportunities.
📌 GCP Data Engineer (Chennai)
🏢 Impetus Capital
📍 Chennai