30 Jul
|
Nisum
|
Telangana
Position: Data Engineer
Experience: 6-9 Yrs
Location: Hitech City, Hyderabad
Work Mode: Work from Office / Hybrid
Job Description:
What you will do
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
- Drive the team to deliver solutions on time and quality that is committed.
- Write unit/integration tests, contribute to engineering wiki, and documents work.
- Performing data analysis requires to troubleshoot data-related issues and assist in the resolution of data issues.
- Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
- Work closely with all business units and engineering teams to develop a strategy for long-term data engineering platform architecture
- Design of data-oriented solutions (end to end) using design patterns and best market practices.
- Define and implement governance, access and security policies
- Ensure optimal use of resources both in cost and performance
- Ensure that non-functional requirements are taken care
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
What you know
- Required above 6 years of ETL and Data Engineering experience.
- Experience in senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)
- Experience in up-to-date data ingestion processes (datalake, datawarehouse, lakehouse)
- Experience in data governance models
- Experience with relational SQL and NoSQL databases.
- Experience with Azure cloud Data services
- More than 4 years of experience in Data Engineering & ETL Tools (like Teradata, Ab Initio) and Azure
- Data Engineer with Azure functions and Azure Data Factory, Databricks and PySpark
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education:
Bachelors degree in computer science, Information Systems, Engineering, Computer Applications, or related fields.
Benefits:
- Continuous Learning - Year-round training sessions are offered as part of skill enhancement
- Certifications sponsored by the company on an as-need basis. We support our team to excel in their field.
- Parental Medical Insurance - Nisum believes our team is the heart of our business, and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
- Activities -From the Nisum Premier League&39;s cricket tournaments to host Hack-a-thon, Nisum employees can participate in a variety of team building activities such as skits, dance performances in addition to festival celebrations.
- Free Meals and dinner is provided daily, in addition to subsidized lunch.
📌 Data Engineer (Telangana)
🏢 Nisum
📍 Telangana