Discover your future at Citi : Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.
Job Overview : We are seeking a highly skilled and experienced BigData/PySpark Engineer to join our energetic Big Data Analytics team. This role is pivotal in designing, developing, and optimizing robust, scalable data pipelines for large-scale data processing and analytics.
Key Responsibilities:
- Design & Development: Create and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark for massive datasets.
- Coding & Engineering: Write clean, efficient, well-documented code primarily in Python (PySpark) often leveraging frameworks/tools.
- Collaboration: Work with cross-functional teams (senior developers, data engineers, analysts, business partners) to understand data requirements and ensure seamless solution integration.
- Full SDLC Involvement: Participate in the entire software development lifecycle, from requirements analysis and design to testing, deployment,
and operations.
- Data Integrity: Ensure high data quality and integrity throughout the data lifecycle.
Key Experience & Expertise :
- Object-Oriented Programming (OOP) : Solid foundation in OOP concepts.
- Big Data Development : Expertise in PySpark, HDFS, Hive, Sqoop, and Hadoop for Big Data environments.
- Database Technologies : Good exposure to SQL Server and ORACLE databases. Experience with query writing for data validation/manipulation
- Scripting & Automation : Proficient in Shell Scripting and experience with job scheduling tools like Autosys .
- BI Reporting Tools : Some exposure to BI tools, specifically Tableau .
- Tools & Practices : Proficient with Git; experience with JIRA, Confluence. Familiarity with DevOps and CI/CD pipelines. Job Family Group :Technology
- Job Family : Applications Development
- Time Type : Full time
- Most Relevant Skills :Please see the requirements listed above.
- Other Relevant Skills :For complementary skills, please see above and/or contact the recruiter.
📌 Pyspark Big Data Developer (Pune)
🏢 Citi
📍 Pune