19 Aug
|
ClearTrail Technologies
|
Gurugram
19 Aug
ClearTrail Technologies
Gurugram
Job Summary:
We are looking for skilled GCP Data Engineers with 69 years of hands-on experience in building scalable, high-performance data solutions. The ideal candidate will have strong expertise in Java-based big data processing frameworks and deep exposure to Google Cloud Platform (GCP) services for modern data engineering workloads.
Key Skills & Experience:
1. Strong programming expertise in Java, with experience in building distributed data processing applications
2. Hands-on experience with Big Data technologies such as Apache Spark (Java APIs), Hadoop, and Hive
3. Experience with Spark (DataFrame/Spark SQL) using Java (PySpark knowledge
4. Solid understanding of data structures, algorithms, and object-oriented programming in Java
5. Strong knowledge of SQL, data modeling, and data warehousing concepts
6. Experience working with Linux/Unix environments and scripting (Bash or similar)
7. Proven analytical and problem-solving skills, especially in debugging and optimizing data pipelines
8. Ability to design and build scalable, fault-tolerant data processing systems
Preferred / Good to Have:
1. Hands-on experience with GCP services such as BigQuery, Dataflow (Apache Beam with Java), Dataproc, Cloud Storage, Pub/Sub, and IAM
2. Experience with workflow orchestration tools like Airflow or Cloud Composer
3. Exposure to cloud migration projects, especially transitioning from on-premise Hadoop ecosystems to GCP
4. Familiarity with streaming data pipelines using Pub/Sub and Dataflow
5. Understanding of CI/CD pipelines and DevOps practices in a cloud setting
Roles & Responsibilities:
1. Design, develop, and maintain scalable ETL/ELT pipelines using Java-based big data frameworks on GCP
2. Build and optimize batch and streaming data processing solutions using Dataproc, Dataflow, and Spark
3. Ensure high-quality, efficient, and maintainable code by following best practices and coding standards
4. Perform unit testing, integration testing, and troubleshoot comp
📌 Data Engineer GCP Java (Gurugram)
🏢 ClearTrail Technologies
📍 Gurugram