we have opemings for Python(Apache Icebarg, Python, Pyspark, Big Query, GCS)
Experience: 4 to 10yrs
Location : Pan-india
jd:
- Strong experience with MongoDB for data lake management. • Proficiency in Scala programming language.
- Hands-on experience with GCP Dataflow, Pub/Sub, and other GCP services (Big Query, Cloud Storage, etc.).
- Solid understanding of distributed data processing and streaming architectures.
- Experience with data modeling, ETL processes, and performance tuning. • Familiarity with CI/CD pipelines and version control (Git).
- . candidate will design, develop, and optimize large-scale data processing pipelines and ensure effective data storage and retrieval for analytics and business intelligence.
- Experience with Apache Beam.
- Knowledge of Kubernetes or containerized deployments.
- Exposure to data governance and security best practices on cloud platforms.