Job Summary:

We are looking for a skilled Big Data Engineer with strong experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms.

Experience with Palantir Foundry is highly preferred

Experience Required: 5 – 10 years

Key Responsibilities:

- Design, develop, and maintain ETL/data pipelines using Python and PySpark
- Work with real-time/streaming data systems
- Build and optimize data processing solutions on cloud platforms
- Collaborate with cross-functional teams to understand business requirements
- Develop and maintain CI/CD pipelines
- Ensure data quality, performance, and scalability

Required Skills:

- 5–10+ years of experience in Data Engineering
- Strong expertise in Python and PySpark
- Experience with Kafka, Flink, and Kubernetes
- Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
- Experience with cloud platforms (Azure, AWS, or GCP)
- Positive understanding of data architecture and pipeline design

Preferred Skills:

- Experience with Palantir Foundry
- Knowledge of Java
- Experience in consulting or Utilities domain

📌 Big Data Engineer (Hyderabad)
🏢 cognine
📍 Hyderabad