31 Jul
|
Ayno Technologies
|
India
31 Jul
Ayno Technologies
India
Mandatory Skills :
- Google Cloud Platform (GCP)
- Scala
- Data Engineering
- BigQuery
- Apache Spark
- Cloud Dataflow
- Apache Beam
- SQL
- ETL/ELT Pipelines
- Git
Job Summary:
We are looking for a skilled Data Engineer - Data Platforms (Google Cloud | Scala) to design, develop, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP). The ideal candidate should have robust expertise in Scala, distributed data processing, cloud-native technologies, and modern data engineering practices.
You will work closely with data architects, analysts, and cross-functional teams to build reliable, high-performance data solutions that support business intelligence, analytics, and machine learning initiatives.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Scala and Google Cloud Platform (GCP).
- Build batch and streaming data processing solutions using Apache Spark, Cloud Dataflow, and Apache Beam.
- Develop and optimize data models and datasets in BigQuery.
- Design and implement robust ETL/ELT workflows for structured and unstructured data.
- Integrate data from multiple internal and external sources.
- Optimize data processing performance, scalability, and cost on GCP.
- Ensure data quality, governance, security, and compliance across data platforms.
- Monitor, troubleshoot, and resolve production data pipeline issues.
- Collaborate with Data Scientists, Data Analysts, DevOps Engineers, and Product teams.
- Participate in Agile ceremonies, sprint planning, code reviews, and technical discussions.
Required Skills :
- Robust hands-on experience with Google Cloud Platform (GCP).
- Excellent programming skills in Scala.
- Experience with Apache Spark for large-scale data processing.
- Strong knowledge of BigQuery, Cloud Storage, and Cloud Dataflow.
- Experience building batch and real-time data pipelines.
- Strong SQL skills and experience with relational databases.
- Knowledge of Apache Beam and event-driven data processing.
- Experience with version control systems such as Git.
- Understanding of CI/CD pipelines and DevOps practices.
- Familiarity with data modelling, data warehousing, and distributed systems.
- Strong analytical and problem-solving skills.
Preferred Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Google Cloud Professional Data Engineer certification is a plus.
- Experience with Airflow, Dataproc, Pub/Sub, or Kafka is an advantage.
- Knowledge of Python or Java is desirable.
- Experience working in Agile/Scrum environments.
- Excellent communication and collaboration skills.
📌 Data Engineer - Google Cloud Platform (India)
🏢 Ayno Technologies
📍 India