Java Spark Data Engineer (Pune)

Java Spark Data Engineer (Pune)

27 Aug
|
wissen technology
|
Pune

27 Aug

wissen technology

Pune

Company Name – Wissen Technology

Group of companies in India – Wissen Technology & Wissen Infotech

Work Location – Whitefield, Bangalore

Website and Company profile:

www.wissen.com

LinkedIn Page:

https://www.linkedin.com/company/wissen-technology/

While you may already know about Wissen and the company history, here is a quick rundown for you.

About Wissen Technology:

· The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015.

· Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.

· Our workforce has highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like Wharton, MIT, IITs, IIMs, and NITs and with rich work experience in some of the biggest companies in the world.

· Wissen Technology has grown its revenues by 400% in these five years without any external funding or investments.

· Globally present with offices US, India, UK, Australia, Mexico, and Canada.

· We offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.

· Wissen Technology has been certified as a Outstanding Place to Work®.





· Wissen Technology has been voted as the Top 20 AI/ML vendor by CIO Insider in 2020.

· Over the years, Wissen Group has successfully delivered $650 million worth of projects for more than 20 of the Fortune 500 companies.

· We have served client across sectors like Banking, Telecom, Healthcare, Manufacturing, and Energy. They include likes of Morgan Stanley, Goldman Sachs, MSCI, StateStreet, Flipkart, Swiggy, Trafigura, GE to name a few.

About Role :

Key Responsibilities

- Build and maintain data transformation pipelines using java Spark
- Develop and optimize large-scale/CPU intensive data processing using Apache Spark
- Orchestrate workflows using Airflow
- Implement data quality checks, testing, and monitoring for pipeline. Good to have exposer into managing metadata, cataloguing, and lineage
- Support schema evolution, backfills, and incremental processing
- Ensure pipelines meet SLAs for freshness, reliability, and performance
- Expertise/working knowledge in Spark and HBase(semantic layer, virtual datasets, Reflections)

Required Skills & Qualifications

- Strong hands-on experience with
- HBase
- Apache Spark
- Experience with HBase or similar lakehouse query engines
- Airflow
- Understanding of data catalogs and lineage (e.g., OpenLineage, DataHub, Apache Polaris , openlineage)
- Proficiency in Java
- Experience with Git-based development and CI/CD

Nice-to-Have Skills

- OpenTable format/Iceberg ,Apache Arrow
- CDC-based analytics pipelines
- Cloud platforms (AWS)
- Kubernetes-based data platforms

Skills:- Java, Spark, Hadoop, Apache HBase, SQL and Apache Airflow

📌 Java Spark Data Engineer (Pune)
🏢 wissen technology
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: java spark data engineer (pune) / pune

Subscribe to this job alert:

Get the latest job offers by email for: java spark data engineer (pune) / pune