Job Description

JOB DESCRIPTION

n

About us

n

DataWeave provides Retailers and Brands with “Competitive Intelligence as a Service” that enables them to take key decisions that

n

impact their revenue. Powered by AI, we provide easily consumable and actionable competitive intelligence by aggregating and

n

analyzing billions of publicly available data points on the Web to help businesses develop data-driven strategies and make smarter

n

decisions.

n

Data Engineering and Delivery @DataWeave

n

We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of

n

the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable

n

python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are: Tooling, domain

n

awareness, fast paced delivery, and pushing the envelope.

n

How we work?

n

It's hard to tell what we love more, problems or solutions! Every day, we choose to address some of the hardest data problems that

n

there are. We are in the business of making sense of messy public data on the web. At serious scale! Read more on Become a

n

DataWeaver

n

What do we offer?

n

• Some of the most challenging data problems. Huge text and image datasets that you can play with!

n

• Ability to see the impact of your work and the value you're adding to our customers almost immediately.

n

Opportunity to work on different problems and explore a wide variety of tools to figure out what really excites y

n

ou.



A culture of openness. Fun work environment. A flat hierarchy. Organization wide visibility. Flexible working

n

hours.

n

•

n

• Learning opportunities with courses and tech conferences. Mentorship from seniors in the team.

n

• Last but not the least, competitive salary packages and fast paced growth opportunities

n

Relevant set of skills

n

• Positive communication and collaboration skills with 4-7 years of experience.

n

• Ability to code and script with strong grasp of CS fundamentals, excellent problem solving abilities.

n

• Comfort with frequent, incremental code testing and deployment, Data management skills

n

• Good understanding of RDBMS

n

• Experience in building Data pipelines and processing large datasets.

n

• Knowledge of building crawlers and data mining is a plus.

n

• Working knowledge of open source tools such as mysql, Solr, ElasticSearch, Cassandra (data stores) would be a plus.

n

• Expert in Python programming

n

Role and responsibilities

n

• Inclined towards working in a start-up environment.

n

• Comfort with frequent, incremental code testing and deployment, Data management skills

n

Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering

n

business insights, reporting and analytics.

n

•

n

• Expertise in troubleshooting, debugging, data completeness and quality issues and scaling overall system performance.

n

• Build robust APIʼs that powers our delivery points (Dashboards, Visualizations and other integrations)

📌 Senior Data Engineer (Coimbatore)
🏢 DataWeave
📍 Coimbatore