13 Aug
|
Weekday`
|
Hyderabad
13 Aug
Weekday`
Hyderabad
This role is for one of our clients
Company Name: Vidpro Consultancy Services
Seniority level: Mid-Senior level
Min Experience: 5+ years
Location: Bengaluru, Hyderabad, Telangana, India, Pune, Kolkata, West Bengal, India, Chennai, Tamil Nadu, India
JobType: full time
₹8,00,000 - ₹20,00,000 a year
Role: Senior Databricks Engineer
Experience: 5-8 years
Location: Bangalore, Chennai, Hyderabad,Kolkata, Pune
Mandatory Skills: Python, PySpark, Etl, Sql, Azure Databricks, Azure Datafactory.
Primary Roles and Responsibilities:
● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
● Ability to provide solutions that are forward-thinking in data engineering and analytics space
● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications:
● Bachelor's and/or master’s degree in computer science or equivalent experience.
● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in AWS/ Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hi
📌 Azure Data Engineer (Hyderabad)
🏢 Weekday`
📍 Hyderabad