13 Nov
|
Tavant Technologies
|
Bengaluru
13 Nov
Tavant Technologies
Bengaluru
We are looking for a Data Engineer to work with our Client's team and help improve the platform that supports one of the best experimentation tools in the world.
The selected candidate will work side by side with other data engineers and site reliability engineers to improve the reliability, scalability, maintenance and operations of all the data products that are part of the experimentation tool.
Key Responsibilities and Duties
- Take ownership of multiple data pipelines and products and provide cutting-edge solutions to reduce the operational workload required to maintain them
- Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
- Contribute to the development of data platform capabilities such as testing, monitoring, debugging and alerting to improve the development environment of data products
- Solve issues with data and data pipelines, prioritizing based on customer impact.
- End-to-end ownership of data quality in complex datasets and data pipelines.
- Experiment with new tools and technologies, driving innovative engineering solutions to meet business requirements regarding performance, scaling, and data quality.
- Provide self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
- Serve as the main point of contact for technical and business stakeholders regarding data engineering issues, such as pipeline failures and data quality concerns
Tech Stack:
- Solid experience in at least one programming language. We use Java and Python
- Experience building production data pipelines in the cloud, setting up data-lakes and server-less solutions
- Hands-on experience with schema design and data modeling
- Experience designing systems E2E and knowledge of basic concepts (lb, db, caching, NoSQL, etc)
- Knowledge of Flink, CDC, Kafka, Airflow, Spark, Snowflake, DBT or equivalent tools
- Practical experience building data platform capabilities like testing, alerting, monitoring, debugging, security
- Experience working with big data.
- Experience working with teams located in different timezones is a plus
- Experience with experimentation, statistics and A/B testing is a plus
📌 Sr Data Engineer (Bengaluru)
🏢 Tavant Technologies
📍 Bengaluru