This role is for one of the Weekday's clients
Salary range: Rs 800000 - Rs 2000000 (ie INR 8 - 20 LPA)
Min Experience: 5+ years
Location: Bengaluru, Hyderabad, Telangana, India, Pune, Kolkata, West Bengal, India, Chennai, Tamil Nadu, India
JobType: full-time
Mandatory Skills: Python, PySpark, Etl, Sql, Azure Databricks, Azure Datafactory.
Primary Roles and Responsibilities:
- Developing Up-to-date Data Warehouse solutions using Databricks and AWS/ Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Requirements
Skills and Qualifications:
- Bachelor's and/or master's degree in computer science or equivalent experience
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects
- Deep understanding of Star and Snowflake dimensional modelling
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis)
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working wit
📌 Azure Data Engineer (Kolkata Metropolitan Area)
🏢 Weekday AI (YC W21)
📍 Kolkata Metropolitan Area
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.