Skip to content

[Tracking] AMD NPU EP 1.8.63 unable to load foundry local models with Foundry Local SDK version 1.2.0 and later #871

Description

@natke

Error from CLI

  Handler for op 'model.load' threw.
  Error loading model qwen2.5-coder-1.5b-instruct-vitis-npu:2

Error from logs

  Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException:
  Exception during initialization:
  C:\a\_work\1\s\onnxruntime\core\framework\session_state_utils.cc:250
  onnxruntime::session_state_utils::SaveInitializedTensors
  ort_value_name_idx_map.MaxIdx() > -1 was false.
  OrtValue indexes should have been populated.

This has been root caused to an incompatibility between the 1.8.63 EP and ORT versions >= 1.25.0

Repro scripts here: https://github.com/natke/amd-npu-sample

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions