We are looking for a skilled Big Data Engineer with solid experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms. Experience with Palantir Foundry is highly preferred
Experience Required: 5 – 10 years
Key Responsibilities
Design, develop, and maintain ETL/data pipelines using Python and PySpark
Work with real-time/streaming data systems
Build and optimize data processing solutions on cloud platforms
Collaborate with cross-functional teams to understand business requirements
Develop and maintain CI/CD pipelines
Ensure data quality, performance, and scalability
Required Skills
5–10+ years of experience in Data Engineering
Strong expertise in Python and PySpark
Experience with Kafka, Flink, and Kubernetes
Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
Experience with cloud platforms (Azure, AWS, or GCP)
Good understanding of data architecture and pipeline design
Preferred Skills
Experience with Palantir Foundry
Knowledge of Java
Experience in consulting or Utilities domain
Share with someone awesome
View all job openings
📌 Big Data Engineer (Hyderabad)
🏢 Cognine Technologies
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.