Sharding
Nikolay and Michael discuss sharding Postgres — what it means, why and when it's needed, and the available options right now.
Here are some links to some things they mentioned:
Here are some links to some things they mentioned:
- PGSQL Friday monthly blogging event https://www.pgsqlphriday.com/
- Did “sharding” come from Ultima Online? https://news.ycombinator.com/item?id=23438399
- Our episode on partitioning: https://postgres.fm/episodes/partitioning
- Vitess https://vitess.io/
- Citus https://www.citusdata.com/
- Lessons learned from sharding Postgres (Notion 2021) https://www.notion.so/blog/sharding-postgres-at-notion
- The Great Re-shard (Notion 2023) https://www.notion.so/blog/the-great-re-shard
- The growing pains of database architecture (Figma 2023) https://www.figma.com/blog/how-figma-scaled-to-multiple-databases/
- Timescale multi-node https://docs.timescale.com/self-hosted/latest/multinode-timescaledb/about-multinode/
- PgCat https://github.com/postgresml/pgcat
- SPQR https://github.com/pg-sharding/spqr
- PL/Proxy https://plproxy.github.io/
- Sharding GitLab by top-level namespace https://about.gitlab.com/handbook/engineering/development/enablement/data_stores/database/doc/root-namespace-sharding.html
- Loose foreign keys (GitLab) https://docs.gitlab.com/ee/development/database/loose_foreign_keys.html
~~~
What did you like or not like? What should we discuss next time? Let us know via a YouTube comment, on social media, or by commenting on our Google doc!
What did you like or not like? What should we discuss next time? Let us know via a YouTube comment, on social media, or by commenting on our Google doc!
~~~
Postgres FM is brought to you by:
- Nikolay Samokhvalov, founder of Postgres.ai
- Michael Christofides, founder of pgMustard
With special thanks to:
- Jessie Draws for the amazing artwork