04 Aug
|
Msys Softsol
|
Maharashtra
04 Aug
Msys Softsol
Maharashtra
Work LocationAny Saksoft (Che, Blr, Pune, Mum or Noida)Years of Experience7+ yearsMandatory SkillsPython Data Engineering ArchitectDetailed JD• Strong hands-on experience in Python, DBT, SQL, and Data Lake/Data Warehouse architectures for building scalable data solutions.• Expertise in data modeling, ETL/ELT pipelines, KPI reporting, and dashboard data preparation.• Experienced Data Architect/Lead with solid expertise in Python, DBT, and Data Lake architectures to drive end-to-end data platform delivery. Responsible for designing scalable data solutions, building and optimizing data pipelines, and developing KPI-driven datasets for dashboard reporting. The role will lead architecture decisions, ensure data quality and governance, and collaborate with cross-functional teams to deliver business insights. Provide technical leadership to the engineering team. Experience in contemporary cloud-based data platforms and analytics ecosystems is highly preferred.
Here are some skill requirements for this role.
Python backend framework hands on work experience Fast API / Django / Flask.
Async I/O python library
SQLAlchemy Core , Pydantic
Backend Job systems Celery, Arq, or Dramatiq
Working knowledge with any of the datawarehouse systems Snowflake, BigQuery, Redshift, Databricks, or ClickHouse
Idea on performance optimization using columnar storage, partitioning and clustering strategies
Pre-aggregation tables, materialized views, incremental refresh, approximate query engines
Positive to know DuckDB or Polars
REST API / Graph QL
cursor-based pagination for large result sets, streaming responses
WebSocket or SSE patterns
Caching architecture.
Should have knowledge Infra and ops. Containerization, Kubernetes or ECS, CI/CD, observability
📌 Python Data Engineering Architect Maharashtra
🏢 Msys Softsol
📍 Maharashtra