03 Oct
|
wissen technology
|
Bengaluru
03 Oct
wissen technology
Bengaluru
Wissen Technology is hiring for Senior Data Engineer
About Wissen Technology:
Job Summary:
We are hiring a Senior Data Engineer to design, build, and optimize enterprise scale data platforms using Databricks, Python, and PySpark. This role focuses on developing high-performance batch and real-time data pipelines, implementing up-to-date data engineering frameworks, and delivering reliable, governed data solutions that power analytics, reporting, and AI-driven applications across financial services ecosystems.
Experience: 7 - 12 Years
Location: Bangalore
Mode of Work: Hybrid
Must Have Skills:
Python (7+ years) for developing scalable, modular, and production-ready data engineering applications
PySpark & Apache Spark (5+ years) including DataFrame API, Spark SQL, Structured
Streaming, performance optimization, partitioning strategies, joins, caching, and handling data skew
Databricks (4+ years) including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and end-to-end data engineering capabilities
ETL/Data Engineering/Data Pipeline Development (7+ years) building large-scale batch and real-time data processing solutions
Advanced SQL & Data Modeling including dimensional modeling, slowly changing dimensions (SCD), schema evolution, and query optimization
Apache Airflow (3+ years) for workflow orchestration, DAG development, dependency management, scheduling, monitoring, retries, and backfills
dbt (Data Build Tool) including layered architecture, incremental models, snapshots, macros (Jinja), testing, documentation, and deployment best practices
Cloud Platforms (AWS/Azure/GCP) with hands-on experience building and operating cloud native data solutions.
Valuable to Have:
Microsoft Fabric for data integration, engineering, and analytics workloads
AI-assisted development tools such as GitHub Copilot, Claude Code, or equivalent code generation platforms
Delta Lake advanced optimization techniques and Lakehouse architecture expertise
-
📌 Senior Data Engineer Bengaluru
🏢 wissen technology
📍 Bengaluru