Location: Hyderabad (Work from Office) OR Remote – Anywhere in India

Experience: 7+ Years (Minimum 5 Years in Production Python Development)

Employment Type: Contract / Contract-to-Hire

Company: YemPover Inc.

Apply: [email protected]

About the Role

YemPover is looking for a highly skilled, hands-on Senior Python Engineer / Python Technical Lead with deep expertise in Python architecture, reusable framework development, concurrency, performance optimization, and enterprise data processing.

This is a Python-first engineering role , not a traditional PySpark, Databricks, or AWS Glue developer position.

The ideal candidate must be capable of independently designing, coding, testing, and maintaining complex Python frameworks that process large datasets and integrate with Snowflake and dbt.

Key Responsibilities

- Architect and develop scalable, reusable, multi-module Python frameworks for enterprise data ingestion, validation, transformation, and loading.
- Design Python pipelines to efficiently process thousands of files from AWS S3 and load them into Snowflake.
- Implement robust concurrency using asyncio, multiprocessing, and asynchronous I/O , with appropriate resource management.
- Build extensible Python architectures using design patterns, interfaces, dependency injection, typing, and modular components.
- Develop reliable ingestion workflows incorporating idempotency, retry mechanisms, schema-drift handling, error recovery, and audit logging .
- Implement efficient Snowflake bulk-loading strategies using staging tables, COPY INTO, and MERGE.
- Optimize application performance through profiling, memory management, efficient data structures, and parallel processing.
- Establish engineering best practices through pytest, unit/integration testing, mocking, code reviews, CI/CD, and documentation.




- Work closely with data engineering teams to determine appropriate boundaries between Python processing and Snowflake SQL/dbt transformations.
- Take end-to-end ownership of Python architecture, implementation, testing, and production reliability.

Mandatory Technical Skills 1. Advanced Python Engineering

- 5+ years of hands-on production Python development.
- Strong understanding of Python internals, including generators, decorators, context managers, descriptors, typing, memory management, and the GIL.
- Experience developing complex, multi-module Python applications, reusable libraries, SDKs, or extensible frameworks.
- Hands-on experience with Python 3.12+ and contemporary development practices.

2. Concurrency & Performance

- Production experience with asyncio and/or multiprocessing.
- Strong understanding of CPU-bound versus I/O-bound workloads.
- Experience with profiling, memory optimization, batching, and high-throughput processing.

3. Snowflake & Data Engineering

- Hands-on Python integration with AWS S3 and Snowflake.
- Understanding of Snowflake stages, COPY INTO, MERGE, and bulk-loading patterns.
- Strong SQL skills and understanding of dbt-based transformations.
- Experience with Pandas, Polars, PyArrow, DuckDB, or equivalent data-processing libraries.
- Experience with schema validation using Pydantic or Pandera.

4. Python Framework Design & Reliability

- Experience designing extensible ingestion or data-processing frameworks.
- Strong understanding of idempotency, retry mechanisms, exception handling, and schema evolution.
- Ability to design reusable modules, adapters, validators,



and processing interfaces.

5. Testing & Engineering Practices

- Strong experience with pytest, mocking, fixtures, unit testing, and integration testing.
- Git, CI/CD, Docker, dependency management, and Python packaging.
- Familiarity with modern tooling such as uv, ruff, mypy, and pyright.

Preferred / Added Advantage
- AWS S3, Lambda, SQS/SNS, Step Functions, ECS, and event-driven architecture.
- Airflow, custom DAGs/operators, and dbt.
- Kafka/Kinesis and idempotent event consumers.
- Cython, Numba, Rust/PyO3, or advanced Python runtime optimization.
- MCP servers, LangGraph, Pydantic AI, or LLM API integrations.

What We Are Specifically Looking For We are seeking a hands-on Python architect-level engineer , not someone whose experience is primarily limited to configuring cloud services or developing PySpark/Databricks pipelines.

Candidates must be able to:

- Explain and demonstrate Python architecture at the code and module level.
- Independently design a framework to validate and load thousands of S3 files into Snowflake.
- Implement concurrency, error handling, retries, idempotency, and schema validation.
- Clearly articulate when processing belongs in Python versus SQL/dbt.
- Demonstrate personal ownership of complex Python production systems.

Strong Python coding and architectural reasoning are mandatory.

Interview Process

Technical screening will include Python architecture design, concurrency and performance concepts, Snowflake ingestion patterns, and a hands-on Python coding exercise.

Apply Now

Interested candidates can share their updated resumes at [email protected].

#Hiring #SeniorPythonEngineer #PythonDeveloper #PythonArchitect #Python312 #AsyncIO #Multiprocessing #Snowflake #dbt #AWS #Pytest #DataEngineering #PythonFrameworks #HyderabadJobs #RemoteJobsIndia #YemPover

📌 Sr. Python Architect/ Senior Python Engineer / Python Technical Lead (Hyderabad)
🏢 YemPover
📍 Hyderabad