Appearance
14.6 Multi-Tier Caching & Invalidation Architecture
1. What It Is in Plain Words
Caching is the strategy of storing frequently accessed data in high-speed, temporary storage layers (such as RAM or edge servers) to serve subsequent requests faster and reduce load on primary databases and expensive AI compute models.
2. TruthGuard Multi-Tier Caching Topology
3. Caching Tiers Evaluated
- Tier 1 (Client-Side Query Cache): Managed via
@tanstack/react-queryin [App.tsx](file:///Users/avishjain/avishjain9-repos/33-codealchemist/mainpage/src/App.tsx#L12-L15). Prevents duplicate API requests during component re-mounts using a 5-minute stale-time window. - Tier 2 (CDN Edge Cache): Caches static JavaScript, CSS bundles, and VitePress documentation files with immutable cache-control headers (
Cache-Control: public, max-age=31536000, immutable). - Tier 3 (Semantic Redis Cache by SHA-256):
- When an analyst submits an image or video, the client calculates its 64-character SHA-256 hash.
- The edge gateway checks Redis:
GET forensic:hash:<sha256>. - If a match exists, the cached verdict and confidence score return in <5 milliseconds, completely bypassing costly AI inference.
- Strategy: Cache-Aside (Lazy Loading) with a 30-day Time-To-Live (TTL).
4. Cache Invalidation & Stampede Protection
- Cache Stampede / Thundering Herd Prevention: If a breaking deepfake video goes viral and 10,000 analysts submit it simultaneously, a distributed lock (via Redis
SETNX) ensures only the first request triggers the AI model, while remaining requests await the populated cache key. - Eviction Policy: Least Recently Used (LRU) with memory caps to prioritize viral media while dropping dormant scan records.
5. 30-Second Spoken Interview Answer
"In TruthGuard, caching is implemented across three tiers: TanStack Query in the browser, Cloudflare at the CDN edge, and an Upstash Redis cache keyed by SHA-256 binary hash at the edge gateway.
By keying our cache directly to the file's cryptographic hash, duplicate viral deepfakes are resolved in under 5 milliseconds from cache, reducing AI inference bills by over 40% and protecting our models from thundering herd spikes."