Job Description Seeking experienced Data Engineers to support a large-scale data modernization effort involving legacy transportation and operational data. The team is migrating complex Hadoop-based data assets into Azure Databricks while supporting active implementation initiatives and a growing product backlog.
Responsibilities
· Modernize and optimize legacy Hadoop views and data pipelines
· Analyze highly complex nested data structures built over many years
· Design, build, and optimize data pipelines within an Azure Databricks Medallion Architecture framework (Bronze, Silver, and Gold layers).
· Work across SQL Server, DB2, and CSV ingestion frameworks
· Partner with Product Managers, Architects, and Technical Leads to understand business context behind requirements
· Independently troubleshoot and solve complex data challenges Skills and Requirements · Azure Databricks
· Medallion Architecture
· SQL Server
· Robust problem-solving and analytical skills
· Ability to work independently with limited direction
· Transportation, logistics,
or supply chain data experience
· Data modernization and migration experience We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to
[email protected].
📌 INTL - Data Engineer - India (Hyderabad)
🏢 Insight Global
📍 Hyderabad