You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pgml-docs/docs/blog/data-is-living-and-relational.md
+8-8Lines changed: 8 additions & 8 deletions
Original file line number
Diff line number
Diff line change
@@ -39,10 +39,10 @@ A common problem with data science and machine learning tutorials is the publish
39
39
40
40
They are:
41
41
42
-
- usually denormalized into a single tabular form, e.g. a CSV file,
43
-
- often relatively tiny to medium amounts of data, not big data,
44
-
- always static, with new rows never added,
45
-
-and sometimes pre-treated to clean or simplify the data.
42
+
- usually denormalized into a single tabular form, e.g. a CSV file
43
+
- often relatively tiny to medium amounts of data, not big data
44
+
- always static, with new rows never added
45
+
- sometimes pre-treated to clean or simplify the data
46
46
47
47
As Data Science transitions from academia into industry, these norms influence organizations and applications. Professional Data Scientists need teams of Data Engineers to move data from production databases into data warehouses and denormalized schemas which are more familiar, and ideally easier to work with. Large offline batch jobs are a typical integration point between Data Scientists and their Engineering counterparts, who primarily deal with online systems. As the systems grow more complex, additional specialized Machine Learning Engineers are required to optimize performance and scalability bottlenecks between databases, warehouses, models and applications.
48
48
@@ -57,13 +57,13 @@ Instead of starting from the academic perspective that data is dead, PostgresML
57
57
58
58
Relationa data:
59
59
60
-
- is normalized for real time performance and correctness considerations,
61
-
-and has new rows added and updated constantly, which form the incomplete features for a prediction.
60
+
- is normalized for real time performance and correctness considerations
61
+
- has new rows added and updated constantly, which form the incomplete features for a prediction
62
62
63
63
Meanwhile, denormalized data sets:
64
64
65
-
- may grow to billions of rows, and terabytes of data,
66
-
-and often span multiple iterations of the schema, with software bugs introducing outliers.
65
+
- may grow to billions of rows, where single updates multiple into mass rewrites
66
+
- often span multiple iterations of the schema, where software bugs leave behind outliers
67
67
68
68
We think it’s worth attempting to move the machine learning process and modern data architectures beyond the status quo. To that end, we’re building the PostgresML Gym, a free offering, to provide a test bed for real world ML experimentation in a Postgres database. Your personal Gym will include the PostgresML dashboard, several tutorial notebooks to get you started, and access to your own personal PostgreSQL database, supercharged with our machine learning extension.
0 commit comments