Toptal is an exclusive network of the world’s top freelance software developers, designers, finance experts, product managers, and project managers. As one of the fastest-growing fully remote networks globally, we empower professionals to thrive in their freelance careers while working with leading companies around the world.
/n
/n
Role: Data Engineer
/n
/n
Responsibilities:
/n
/n
- Collaborate with teams of experienced actuaries, developers and business experts to deliver projects
/n
- Design and propose end-to-end data pipelines (ingestion to storage to consumption) for data projects as well as databases to support web-based applications
/n
- Implementation of data warehouses and data marts to serve data consumers
/n
- Execute implementation of the designs and bring it from design stages to implementation ,followed by operationalization to maintenance
/n
- Database design and modelling. To be able to organize data at both macro and micro level and provide logical data models for the consumers
/n
- Database performance tuning and data lifecycle management
/n
- Assist in support and enhancements of existing data pipelines and databases
/n
/n
/n
Must-Have:
/n
/n
- 5+ years of total experience working with data integration teams.
/n
- 1+ years of in-depth experience developing data pipelines within an Apache Spark environment (preferably Databricks).
/n
- 1+ years of active hands-on work with Databricks , demonstrating in-depth experience.
/n
- Good experience in building data pipelines that ingests various types of data sources into a database or data lake and populating a structured warehouse or data mart that fuels the data consumer.
/n
- Fluent in both complex SQL query performance tuning and database performance tuning
/n
- Good knowledge of data modelling, database technologies, data warehousing.
/n
- Have experience in building data warehouses/data marts
/n
- Understand the importance of performance and able to implement best practices in ensuring performance and maintainability for data-centric projects
/n
- This person is required to be dynamic and be a quick eager learner as knowledge about recent technologies will need to be acquired on the spot
/n
- Experience with BI and analytics tools like Power BI or Tableau.
/n
/n
/n
Nice-to-Have:
/n
/n
- Experience integrating AI into data engineering.
/n
- Certifications in Databricks, cloud computing or database management.
/n
- Experience developing data solutions using native IaaS and PaaS solutions on AWS (RDS, S3).
/n
- Experience in any object-oriented programming language.
/n
/n
/n
Additional Details
/n
/n
- Location: Hybrid in Bangalore, India (2-3 days/week in-office)
/n
- Overlap: Singapore timezone
/n
- Type: 40h/week contract
/n
- Duration: 12+ months
/n
- Authorization: Applicants must be authorized to work in their country of residence without employer sponsorship
/n
📌 Data Engineer (Bengaluru)
🏢 Toptal
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.