SIGN IN SIGN UP

convert_hf : faster lazy safetensors (#8482)

* convert_hf : faster lazy safetensors

This makes '--dry-run' much, much faster.

* convert_hf : fix memory leak in lazy MoE conversion

The '_lazy' queue was sometimes self-referential,
which caused reference cycles of objects old enough
to avoid garbage collection until potential memory exhaustion.
C
compilade committed
7acfd4e8d55082c1b597dfc3ffe04fb5d530c6dc
Parent: 97bdd26
Committed by GitHub <noreply@github.com> on 7/16/2024, 3:13:10 AM