Skip to content

Commit 7d2ecfb

Browse files
Moloejoegitbook-bot
authored andcommitted
GITBOOK-129: No subject
1 parent 46922dc commit 7d2ecfb

5 files changed

+24
-0
lines changed

pgml-cms/docs/resources/benchmarks/ggml-quantized-llm-support-for-huggingface-transformers.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,7 @@
1+
---
2+
description: Quantization allows PostgresML to fit larger models in less RAM.
3+
---
4+
15
# GGML Quantized LLM support for Huggingface Transformers
26

37
Quantization allows PostgresML to fit larger models in less RAM. These algorithms perform inference significantly faster on NVIDIA, Apple and Intel hardware. Half-precision floating point and quantized optimizations are now available for your favorite LLMs downloaded from Huggingface.

pgml-cms/docs/resources/benchmarks/making-postgres-30-percent-faster-in-production.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,9 @@
1+
---
2+
description: >-
3+
Anyone who runs Postgres at scale knows that performance comes with trade
4+
offs.
5+
---
6+
17
# Making Postgres 30 Percent Faster in Production
28

39
Anyone who runs Postgres at scale knows that performance comes with trade offs. The typical playbook is to place a pooler like PgBouncer in front of your database and turn on transaction mode. This makes multiple clients reuse the same server connection, which allows thousands of clients to connect to your database without causing a fork bomb.

pgml-cms/docs/resources/benchmarks/million-requests-per-second.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,9 @@
1+
---
2+
description: >-
3+
The question "Does it Scale?" has become somewhat of a meme in software
4+
engineering.
5+
---
6+
17
# Scaling to 1 Million Requests per Second
28

39
The question "Does it Scale?" has become somewhat of a meme in software engineering. There is a good reason for it though, because most businesses plan for success. If your app, online store, or SaaS becomes popular, you want to be sure that the system powering it can serve all your new customers.

pgml-cms/docs/resources/benchmarks/mindsdb-vs-postgresml.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,7 @@
1+
---
2+
description: "Compare two projects that both aim\Lto provide an SQL interface to ML algorithms and the data they require."
3+
---
4+
15
# MindsDB vs PostgresML
26

37
## Introduction

pgml-cms/docs/resources/benchmarks/postgresml-is-8-40x-faster-than-python-http-microservices.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,7 @@
1+
---
2+
description: PostgresML is a simpler alternative to that ever-growing complexity.
3+
---
4+
15
# PostgresML is 8-40x faster than Python HTTP microservices
26

37
Machine learning architectures can be some of the most complex, expensive and _difficult_ arenas in modern systems. The number of technologies and the amount of required hardware compete for tightening headcount, hosting, and latency budgets. Unfortunately, the trend in the industry is only getting worse along these lines, with increased usage of state-of-the-art architectures that center around data warehouses, microservices and NoSQL databases.

0 commit comments

Comments
 (0)