02 Oct
|
JPMorganChase
|
Bengaluru
02 Oct
JPMorganChase
Bengaluru
Description
Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team.
As a Data Engineer III - Databricks, Pyspark, Python, AWS at JPMorgan Chase within the Commercial & Investment Bank, you'll serve as a seasoned member of an agile team to design and deliver trusted data collection, storage, access, and analytics solutions in a secure, secure, and scalable way. You are responsible for developing, testing, and maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
- Design, develop, and maintain big data pipelines (batch and streaming) using PySpark/Spark and Databricks.
- Lead/own data modelling and solution design for data products, including defining target-state architecture, data flows, and transformation patterns.
- Build scalable ingestion and transformation workflows for high-volume datasets, ensuring reliability, quality, and performance.
- Develop and optimize complex SQL transformations,
reconciliation queries, and analytical datasets; perform query tuning for large-scale workloads.
- Apply strong data warehousing concepts (dimensional modeling, SCDs, partitioning strategies, etc.) to build well-structured, analytics-ready data layers and Leverage common AWS services, with strong emphasis on S3 and AWS data processing capabilities, to support scalable storage and processing.
- Perform advanced debugging and troubleshooting across distributed Spark workloads (data skew, shuffle tuning, memory/compute optimization).
- Implement engineering best practices: modular design, efficient coding, code reviews, and CI-friendly development approaches.
- Use GitHub/Bitbucket and standard version control workflows to manage codebase, peer reviews, and releases.
- Partner with cross-functional stakeholders to convert requirements into robust big data solutions.
- Uses enterprise-authorized AI
📌 Data Engineer III (Bengaluru)
🏢 JPMorganChase
📍 Bengaluru