Databricks Pyspark (India)

Databricks Pyspark (India)

09 Sep
|
Clifyx
|
India

09 Sep

Clifyx

India

Req ID- 10290307

Job Title: Developer

Work Location: ~PUNE~BANGALORE~

Skill Required: Digital : Databricks~Digital : PySpark

Experience Range : 6-8Years

Job Description:

Job Description for Data Engineer:•Design and develop ETL processes based on functional and non-functional requirements in Databricks, python / PySpark within Azure platform.•Understand the full end to end development activities from design to go live for ETL development in Azure platform.•Recommend and execute improvements.•Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.•Apply automation and innovation on new and on-going data platforms that aligned to business strategies.•Document component design for developers and for broader communication.•Understand and adopt an Agile (SCRUM like) software development mindset.•Follow established processes/standards, business technology architecture for development, release management and deployment process.•Design,



develop and implement reporting platforms and complex ETL frameworks that meet business requirements.•Provide data analysis and requirements within enterprise platform.•Develop, maintain knowledge of data available from upstream sources and data within various platforms.

Essential Skills:

Must-have skills•Azure Databricks, Azure Data Factory•Python / Spark / Pyspark / Shell Script•Synapse•5+ years of experience in ETL/Data area with minimum of 3 years of development experience in above technologies (PySPark, ADB, ADF) is must•SQL, Working experience with data modeling, relational modeling and dimensional modeling, Data Warehousing, ETL•General knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. MS SQL, Oracle) and different type of connectivity is also very practical.•Data files movement via mailbox•Source-code versioning/promotion tools, e.g. Git/Jenkins•Good communication skill, team player

📌 Databricks Pyspark (India)
🏢 Clifyx
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: databricks pyspark (india) / india