← All components
Operations
Coordination / config
Consistent store for leader election, service discovery, shard maps and dynamic config.
When to use
- Crawler/typeahead shard ownership
- Rate-limit rule distribution
Options by provider
The first option is what diagrams show for that provider.
Amazon Web Services
- AWS AppConfigManaged
- AWS Cloud MapManaged
Google Cloud
- Self-hosted etcd on GKESelf-hosted
Microsoft Azure
- Azure App ConfigurationManaged
Open source / self-hosted
- etcdSelf-hosted
- Apache ZooKeeperSelf-hosted
- ConsulSelf-hosted
Related concepts
Used in
- URL shortener
- Range allocator — Gives each generator a unique block of counter values
- API rate limiter
- Config distribution — Pushes rule updates to every limiter (watch)
- Search autocomplete
- Shard map — Prefix range → shard and active trie version
- Web crawler
- Coordinator — Assigns hosts to fetchers (consistent hashing) and elects a leader