02 Aug
|
dunnhumby
|
Gurugram
02 Aug
dunnhumby
Gurugram
dunnhumby is the global leader in Customer Data Science, partnering with the world’s most ambitious retailers and brands to put the customer at the heart of every decision. We combine deep insight, advanced technology, and close collaboration to help our clients grow, innovate, and deliver measurable value for their customers.
dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Nestlé, Unilever and Metro.
We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team. It’s an chance to work with a market-leading business to explore new opportunities for us and influence global retailers.
What we expect from you
- 2–5 years of experience in Data Engineering or a related field
- Strong experience with Python, PySpark, and SQL (mandatory)
- Experience working in Linux environments and writing shell scripts
- Hands-on experience with big data technologies such as Spark, Hive, Hadoop,
Airflow, Oozie, HBase, or MapReduce
- Experience with data pipeline development and data flow management
- Familiarity with Git and process automation
- Experience with relational database management systems (RDBMS) and Data Flow Development
Key Responsibilities
- Build data solutions, including data lakes, data warehouses, ETL/ELT pipelines, APIs, and analytics platforms.
- Build scalable and low-latency data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams.
- Automate data pipelines and processes end-to-end using orchestration frameworks such as Apache Airflow to manage complex workflows and dependencies.
- Develop pipeline for real-time data processing.
- Implement data governance, metadata management, and data quality standards.
- Explore appropriate tools, platforms, and technologies aligned with organizational standards.
- Ensur
📌 Big Data Engineer (Gurugram)
🏢 dunnhumby
📍 Gurugram