About the Role:

Senior Data Engineer - SMC Global Securities

We're seeking a skilled Senior Data Engineer to join our team at SMC Global Securities. In this role, you will be crucial in building and maintaining the data infrastructure that powers our financial services and trading platforms. You will work with a diverse tech stack to handle massive volumes of real-time and historical financial data, ensuring that our analytics, research, and business teams have access to high-quality, reliable information to support our brokerage, wealth management, and advisory services.

Responsibilities:

- Design, build, and maintain highly efficient and scalable real-time and batch data pipelines to ingest, process, and analyze financial data, including market data, trades, and client information.
- Implement and enforce data modeling standards with a solid understanding of various modeling techniques, including a valuable understanding of Data Vault, Dimensional, and star/snowflake schema modeling, to create a robust and flexible data architecture for financial data.
- Build data pipelines using a Medallion Architecture, progressing data through Bronze (raw), Silver (cleansed), and Gold (analytics-ready) layers to ensure data quality, lineage, and auditability for regulatory compliance.
- Develop and optimize composable data architectures, focusing on creating modular, reusable data components that can be easily combined to support different business needs, such as risk management, algorithmic trading, and research analytics.

MTS 3 - (5-10 years):

- Develop and optimize data transformation processes for financial data using tools like DBT and data processing frameworks like Apache Spark on EMR.
- Manage and maintain data storage solutions across our Data Lake (S3), Data Warehouse (Redshift), and Data Lakehouse architectures, including Hive and Iceberg tables, to handle large-scale financial datasets.




- Write and optimize complex SQL queries and Python scripts for financial data extraction, transformation, and loading (ETL/ELT).
- Implement and orchestrate data workflows for market data ingestion, trade processing, and reporting using Apache Airflow and Airbyte.
- Utilize AWS cloud services such as Lambda, Glue, S3, Athena, and Redshift to build robust data solutions.
- Collaborate with research analysts, quant traders, and business intelligence teams to understand data needs and build data models that support financial analysis, reporting (e.g., IPO reports), and the development of trading tools.
- Monitor and troubleshoot data pipelines and infrastructure to ensure data quality, reliability, and performance, critical for a trading environment.
- Document data pipelines, data models, and processes for maintainability and knowledge sharing.

Requirements:

- Strong proficiency in SQL and Python is a must, with a focus on data manipulation and analysis.
- Good understanding of data modeling concepts and experience with various modeling techniques in a financial context.
- Strong understanding of Medallion and composable data architectures.
- Solid understanding of data architecture concepts including Data Lake, Data Warehouse, and Data Lakehouse.
- Hands-on experience with AWS cloud services, including but not limited to S3, Redshift, Athena, Glue, EMR, and Lambda.
- Experience with open-source data tools like Airflow, DBT, and Airbyte.
- Familiarity with Hive and Iceberg tables is essential.
- Proven experience building and maintaining data pipelines, handling large volumes of financial data.
- Experience with reporting or business intelligence tools (e.g., Metabase).
- Excellent problem-solving skills and the ability to work independently or as part of a team.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Prior experience in the financial services, trading, or fintech industry is highly preferred.

📌 Senior Data Engineer - SMC Global Securities (India)
🏢 SMC Group of Companies
📍 India