Skip to content

Ability to Interact with Cached Models through an API #761

Open
@Tostino

Description

@Tostino

Description

Currently, there is no direct way to interact with the cached models downloaded by PostgresML. For instance, when using HuggingFace models, they get stored in /var/lib/postgresql/.cache. Users might want to delete or even see what models have been downloaded.

I spoke with Lev on Discord and he mentioned that there is no API exposed to work with the cached models directly.

Suggested Feature

It would be helpful to provide an API for users to list, delete, or otherwise manage the models cached by PostgresML. This would give more control to the users over the storage and management of models without having to manually intervene at the file system level.

Use Case

  1. Listing all downloaded models.
  2. Deleting specific models that are no longer needed.
  3. Potentially updating models.
  4. Dealing with fine tuning models at some point

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions