Python Pyspark Chennai

Python Pyspark Chennai

31 Aug
|
Diverse Lynx
|
Chennai

31 Aug

Diverse Lynx

Chennai

Skill: Python
Location: Chennai
Experience: 6+
Desired Competencies (Technical/Behavioral Competency)
Must-Have  Ability to analyze, design, build, and deploy data pipelines in different environments.
 Analytical ability to solve medium to complex problems
 Writing complex SQL scripts across extensive data volumes
 Ability to transform SQL script to PySpark/Snowpark code
 Hands on the use of data science libraries like pandas and NumPy.
 Design and develop code considering performance
 Ability to analyze data from different sources and extract it at regular intervals considering performance
Must have worked as an individual contributor and interacted with different teams in the micro architecture application to get the work done.
 Ability to understand and adapt to existing applications designed on Java/SQL and make code changes.
 Must have hands-on experience with Linux commands and scripts.
Valuable-to-Have  AWS development (S3, EC2) exposure
 Snowflake experience
 Hands-on with DBT
 Hands-on with Autosys
 Talend exposure




 Orchestration exposure
 Knowledge of CDC
 Hands-on with Java
 Hands-on with angular
 Understanding of API design

SN Responsibility of / Expectations from the Role
1 Hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines/ETL processes.
2 Experienced in Testing and debugging with Python test framework tools like Pytest, unit test. Should be able to mock and write unit tests for pyspark/pandas/Snowpark code.
3 Proficiency in SQL and Python for applied large-scale data processing
4 Expertise with RDBMS and OLAP databases, and big data technologies-Snowflakes, including Datawarehouse and Data Lake.
5 Have used GitHub, Jenkins, Source Tree, VSS Code, CI/CD pipeline
6 Ability to excel in a short timeframe under short sprints
7 Robust problem solving, analytical, communication and documentation skills.

📌 Python Pyspark Chennai
🏢 Diverse Lynx
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: python pyspark chennai / chennai

Subscribe to this job alert:

Get the latest job offers by email for: python pyspark chennai / chennai