Skip to content

Cloud docs outline #1553

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 10, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added pgml-cms/docs/.gitbook/assets/vpc.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
20 changes: 11 additions & 9 deletions pgml-cms/docs/SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,13 +60,6 @@
* [Installation](open-source/pgcat/installation.md)
* [Configuration](open-source/pgcat/configuration.md)

## Product

* [PostgresML Cloud](product/postgresml-cloud/README.md)
* [Serverless](product/postgresml-cloud/serverless.md)
* [Dedicated](product/postgresml-cloud/dedicated.md)
* [Enterprise](product/postgresml-cloud/enterprise.md)

## Guides

* [Embeddings](guides/embeddings/README.md)
Expand All @@ -82,8 +75,17 @@
* [Unified RAG](guides/unified-rag.md)
* [OpenSourceAI](guides/opensourceai.md)
* [Natural Language Processing](guides/natural-language-processing.md)
* [Vector database](product/vector-database.md)

* [Vector database](guides/vector-database.md)

## Cloud

* [Overview](cloud/overview.md)
* [Serverless](cloud/serverless.md)
* [Dedicated](cloud/dedicated.md)
* [Enterprise](cloud/enterprise/README.md)
* [Teams](cloud/enterprise/teams.md)
* [VPC](cloud/enterprise/vpc.md)

## Resources

* [Architecture](resources/architecture/README.md)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,8 @@ To create a Dedicated database, make sure you have an account on postgresml.org.

Once logged in, select "New Database" from the left menu and choose the Dedicated Plan.

<figure><img src="../../.gitbook/assets/spaces_B7HH1yMjCs0skMpuwNIR_uploads_S9xbhlwvqnnFUYSJLJug_image.webp" alt=""><figcaption><p>Create new database</p></figcaption></figure>
<figure><img src="../.gitbook/assets/spaces_B7HH1yMjCs0skMpuwNIR_uploads_S9xbhlwvqnnFUYSJLJug_image.webp" alt=""><figcaption><p>Create new database</p></figcaption></figure>

<figure><img src="../../.gitbook/assets/image (4).png" alt=""><figcaption><p>Choose the Dedicated plan</p></figcaption></figure>
<figure><img src="../.gitbook/assets/image%20(4).png" alt=""><figcaption><p>Choose the Dedicated plan</p></figcaption></figure>

### Configuring the database
4 changes: 4 additions & 0 deletions pgml-cms/docs/cloud/enterprise/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Enterprise

Enterprise plans are ideal large companies that have special compliance needs and deployment configurations; with options for cloud-prem (VPC), on-prem, ACL’s and more.

3 changes: 3 additions & 0 deletions pgml-cms/docs/cloud/enterprise/teams.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Teams

Invite additional team members to manage your databases.
9 changes: 9 additions & 0 deletions pgml-cms/docs/cloud/enterprise/vpc.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# VPC

PostgresML can be launched in your Virtual Private Cloud (VPC) account on AWS, Azure or GCP.

<figure><img src="../../.gitbook/assets/vpc.png" alt=""><figcaption><p>Deploy in your cloud</p></figcaption></figure>

The PostgresML control plane provides a complete management solution to control the resources in your cloud account:
- Responsible for PostgresML instance launches, backups, monitoring and failover operations. This requires permission to create and destroy AWS EC2, EBS and AMI resources inside the designated VPC.
- Does not read/write any data inside PostgresML databases other than status metadata inside system tables or the pgml schema necessary to perform the previously mentioned operations.
Original file line number Diff line number Diff line change
Expand Up @@ -18,16 +18,16 @@ PostgresML Cloud is available on Amazon Web Services (AWS), Google Cloud Platfor

Quickly and easily create a PostgresML engine that can scale from very little capacity to gigabytes of GPU cache and terabytes of disk storage. Ideal for teams that want to start small and grow as their usage of PostgresML increases.

[Learn more about serverless](serverless)
[Learn more about serverless](serverless.md)

### Dedicated

Dedicated plans provide a large assortment of hardware, including CPU and GPU configurations, near-bottomless storage capacity and horizontal scaling into millions of queries per second. Ideal for larger startups and enterprises that have established PostgresML as their AI database of choice.

[Learn more about dedicated](dedicated)
[Learn more about dedicated](dedicated.md)

### Enterprise

Enterprise plans are ideal large companies that have special compliance needs and deployment configurations; with options for cloud-prem (VPC), on-prem, ACL’s and more.

[Learn more about enterprise](enterprise)
[Learn more about enterprise](enterprise/)
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,9 @@ To create a Serverless database, make sure you have an account on postgresml.org

Once logged in, select "New Database" from the left menu and choose the Serverless Plan.

<figure><img src="../../.gitbook/assets/image (1).png" alt=""><figcaption><p>Create new database</p></figcaption></figure>
<figure><img src="../.gitbook/assets/image%20(1).png" alt=""><figcaption><p>Create new database</p></figcaption></figure>

<figure><img src="../../.gitbook/assets/image (2).png" alt=""><figcaption><p>Choose the Serverless plan</p></figcaption></figure>
<figure><img src="../.gitbook/assets/image%20(2).png" alt=""><figcaption><p>Choose the Serverless plan</p></figcaption></figure>


### Serverless Pricing
Expand Down
2 changes: 1 addition & 1 deletion pgml-cms/docs/introduction/getting-started/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@ We provide a fully managed solution in [our cloud](create-your-database), and do

By building PostgresML on top of a mature database, we get reliable backups for model inputs and proven scalability without reinventing the wheel, so that we can focus on providing access to the latest developments in open source machine learning and artificial intelligence.

This guide will help you get started with a generous [free account](create-your-database), which includes access to GPU accelerated models and 5 GB of storage, or you can skip to our [Developer Docs](/docs/resources/developer-docs/quick-start-with-docker) to see how to run PostgresML locally with our Docker image.
This guide will help you get started with [$100 credits](create-your-database), which includes access to GPU accelerated models and 5 GB of storage, or you can skip to our [Developer Docs](/docs/resources/developer-docs/quick-start-with-docker) to see how to run PostgresML locally with our Docker image.
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@ This reduces the number of rows Postgres has to scan by half. By adding more par

Partitioning by hash, unlike by range, can be applied to any data type, including text. A hash function is executed on the partition key to create a reasonably unique number, and that number is then divided by the number of partitions to find the right child table for the row.

To create a table partitioned by hash, the syntax is similar to partition by range. Let's use the USA House Prices dataset we used in [Vectors](../../product/vector-database.md) and [Tabular data](README.md), and split that table into two (2) roughly equal parts. Since we already have the `usa_house_prices` table, let's create a new one with the same columns, except this one will be partitioned:
To create a table partitioned by hash, the syntax is similar to partition by range. Let's use the USA House Prices dataset we used in [Vectors](../../cloud/vector-database.md) and [Tabular data](README.md), and split that table into two (2) roughly equal parts. Since we already have the `usa_house_prices` table, let's create a new one with the same columns, except this one will be partitioned:

```postgresql
CREATE TABLE usa_house_prices_partitioned (
Expand Down
7 changes: 6 additions & 1 deletion pgml-dashboard/src/main.rs
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,12 @@ async fn main() {
.expect("Error initializing site search");
let mut site_search_copy = site_search.clone();
tokio::spawn(async move {
site_search_copy.build().await.expect("Error building site search");
match site_search_copy.build().await {
Err(e) => {
error!("Error building site search: {e}")
}
_ => {}
};
});

pgml_dashboard::migrate(guards::Cluster::default().pool())
Expand Down