Open
Description
Description
Currently, there is no direct way to interact with the cached models downloaded by PostgresML. For instance, when using HuggingFace models, they get stored in /var/lib/postgresql/.cache
. Users might want to delete or even see what models have been downloaded.
I spoke with Lev on Discord and he mentioned that there is no API exposed to work with the cached models directly.
Suggested Feature
It would be helpful to provide an API for users to list, delete, or otherwise manage the models cached by PostgresML. This would give more control to the users over the storage and management of models without having to manually intervene at the file system level.
Use Case
- Listing all downloaded models.
- Deleting specific models that are no longer needed.
- Potentially updating models.
- Dealing with fine tuning models at some point