31 Aug
|
Gartner
|
Gurugram
Key Responsibilities:
- Design, develop, and maintain scalable and robust data pipelines and ETL systems using Python and SQLAlchemy.
- Transform and process large datasets from diverse sources, ensuring data integrity, quality, and consistency.
- Optimize and build effective SQL queries for data retrieval and manipulation; manage and interact with relational databases (MSSQL, PostgreSQL, Oracle, etc.).
- Collaborate with cross-functional teams to understand data requirements and deliver innovative solutions.
- Implement data models and structures to support business intelligence, analytics, and machine learning initiatives.
- Leverage advanced Python programming techniques and libraries (e.g., Pandas, Numpy ) to solve complex data challenges.
- Architect and implement agentic AI solutions to automate data processes, enhance pipeline intelligence, and support next-generation analytics.
- Work with AWS cloud services related to data engineering ( AWS Batch, S3, Lambda, etc.).
- Stay abreast of emerging trends in data engineering and AI and proactively recommend improvements.
- Integrate real-time data streaming solutions (e.g., Kafka, Kinesis) into data pipelines.
Technical Skills:
Python Programming Language:
- Level: Advanced
- Key Concepts : Multi-threading, Multi-processing, Regular Expressions, Exception Handling, Generators, Decorators, Context Managers, Asyncio, Type Hinting, and best practices for scalable code.
- Libraries: Pandas, Numpy, SQLAlchemy, etc.
Data Modelling and Data Transformation:
- Level: Advanced
- Key Areas: ETL, processing structured and unstructured data, data quality, and integrity.
Relational Databases:
- Level: Advanced
- Key Areas: Query Optimization, Query Building, Experience with ORMs like SQLAlchemy, Exposure to databases such as MSSQL, PostgreSQL, Oracle, etc.
Agentic AI / Automation:
- Exposure to or interest in agentic AI frameworks and tools (e.g., LangChain, OpenAI APIs, or similar).
- Experience integrating AI/ML models i
📌 Software Engineer (Gurugram)
🏢 Gartner
📍 Gurugram