Job Description

JOB DESCRIPTION

n

About us

n

DataWeave provides Retailers and Brands with "Competitive Intelligence as a Service" that enables them to take key decisions that

n

impact their revenue. Powered by AI, we provide easily consumable and actionable competitive intelligence by aggregating and

n

analyzing billions of publicly available data points on the Web to help businesses develop data-driven strategies and make smarter

n

decisions.

n

Data Engineering and Delivery @DataWeave

n

We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of

n

the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable

n

python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are: Tooling, domain

n

awareness, fast paced delivery, and pushing the envelope.

n

How we work?

n

It's hard to tell what we love more, problems or solutions! Every day, we choose to address some of the hardest data problems that

n

there are. We are in the business of making sense of messy public data on the web. At serious scale! Read more on Become a

n

DataWeaver

n

What do we offer?

n

n
- Some of the most challenging data problems. Huge text and image datasets that you can play with!
n
- Ability to see the impact of your work and the value you're adding to our customers almost immediately.
n

n

Opportunity to work on different problems and explore a wide variety of tools to figure out what really excites y

n

ou.



A culture of openness. Fun work workplace. A flat hierarchy. Organization wide visibility. Flexible working

n

hours.

n

•

n

n
- Learning opportunities with courses and tech conferences. Mentorship from seniors in the team.
n
- Last but not the least, competitive salary packages and fast paced growth opportunities
n

n

Relevant set of skills

n

n
- Good communication and collaboration skills with 4-7 years of experience.
n
- Ability to code and script with strong grasp of CS fundamentals, excellent problem solving abilities.
n
- Comfort with frequent, incremental code testing and deployment, Data management skills
n
- Good understanding of RDBMS
n
- Experience in building Data pipelines and processing large datasets.
n
- Knowledge of building crawlers and data mining is a plus.
n
- Working knowledge of open source tools such as mysql, Solr, ElasticSearch, Cassandra (data stores) would be a plus.
n
- Expert in Python programming
n

n

Role and responsibilities

n

n
- Inclined towards working in a start-up environment.
n
- Comfort with frequent, incremental code testing and deployment, Data management skills
n

n

Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering

n

business insights, reporting and analytics.

n

•

n

n
- Expertise in troubleshooting, debugging, data completeness and quality issues and scaling overall system performance.
n
- Build robust API's that powers our delivery points (Dashboards, Visualizations and other integrations)
n

📌 Senior Data Engineer (Kunnathur)
🏢 DataWeave
📍 Kunnathur