Job Description
Experience Level: 5 - 7+ Years
nPreferred Industry: High-Frequency Trading (HFT) or Hedge Funds
n

nKey Responsibilities:
n
n
Handle the entire data delivery process, including data procurement, vendor discussions, process setup, pipeline design and deployment (with logging and alerts), and database insertion, optimizing for minimal data delivery cycles.n
Build applications that simplify data querying for quantitative developers.n
Work with multiple datasets to deliver standardized data outputs.n
Break down large, abstract tasks into manageable deliverables within set deadlines.n
Identify business requirements, communicate them effectively to end users, and clarify technical details as needed.n
Distinguish between user needs and wants to prioritize effectively.n
Proactively explore and propose new ideas.n
Quickly assume responsibilities from senior staff to support the team.n
Adhere to safe data handling practices.n

n

nEssential Skills:
n
n
Strong command of Python, Bash, and SQL in a Linux environment.n




Understanding of low-level system design for efficient data delivery applications.n
Ability to explain technical concepts to non-technical stakeholders.n
Hands-on experience with ClickHouseDB and its integrations with Python, Bash, and C++.n
Familiarity with Jira and Agile methodologies.n
Proficiency with Git and version control workflows.n
Comfortable developing over SSH.n
Knowledge of market, alternative, and supporting datasets with solid technical comprehension.n
Experience leading a team of at least 4 people and delivering robust data solutions.n

n

nIdeal Skills:
n
n
Experience handling 1+ TB of daily data processing.n
Ability to build highly productive and resource-optimized data pipelines.n
Up to date with hardware and software trends relevant to data engineering.n
Ability to write effective and maintainable code without relying on LLMs.n
Experience work

📌 Lead Data Engineer New Delhi (India)
🏢 Proprietary Trading Firm
📍 India