27 Sep
|
Clock Edge Technologies Pvt Lt
|
Pune
27 Sep
Clock Edge Technologies Pvt Lt
Pune
Data Engineer – DataStage / PySpark / Control-M third party payroll and contract basis job artech
JP ID: CGEMJP00354761
Experience: 7–10 Years
Location: Pune
Notice Period: Only Immediate
Budget: 20–21 LPA
Role Summary
Looking for a Data Engineer with 7+ years’ experience to design, build, and support robust data integration and processing solutions. The role involves end-to-end delivery of batch/ETL pipelines using IBM DataStage, PySpark, Linux, and Control-M, with a strong preference for Banking/Finance domain experience.
Key Responsibilities
* Design, develop, and maintain ETL/data pipelines using IBM DataStage.
- Build and optimize big data processing jobs using PySpark, including transformations, performance tuning, and partitioning strategies.
- Develop and support batch scheduling and workload automation using Control-M.
- Work confidently in Linux/Unix environments including scripting, troubleshooting, file handling, permissions, and process monitoring.
- Perform root-cause analysis for production issues and implement fixes focused on stability, resiliency, and repeatability.
- Partner with upstream/downstream teams including data producers, consumers, QA, platform, and operations.
- Ensure solutions meet banking/finance expectations for data quality, auditability, lineage, and operational controls.
- Prepare technical documentation including mappings,
job design, runbooks, and operational procedures.
Required Skills & Experience
* 7+ years hands-on experience as a Data Engineer / ETL Engineer / Data Integration Engineer.
- IBM DataStage – job design, performance tuning, parallelism, error handling.
- PySpark – DataFrames, transformations/actions, optimization.
- Control-M – scheduling, monitoring, incident handling, job orchestration.
- Linux/Unix – shell scripting and environment troubleshooting.
- Banking or Finance domain experience – risk, finance reporting, payments, AML, regulatory reporting, treasury, customer data.
- Experience supporting production environments with on-call/incident processes and SLAs.
- Strong analytical and problem-solving skills with clear communication to technical and non-technical stakeholders.
Preferred / Nice-to-Have
* Relational databases such as Oracle/DB2/PostgreSQL and solid SQL skills.
- Data quality controls, reconciliation, and metadata/lineage concepts.
- CI/CD, version control (Git), and automated deployment practices.
- Data governance and regulatory expectations in financial services.
Education
* Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience. Pay: From ₹2,000,000.00 per year
Work Location: In person
📌 Data Engineer – DataStage / PySpark / Control-M (Pune)
🏢 Clock Edge Technologies Pvt Lt
📍 Pune