About • Identity • Intellectual Candor

The Failure Museum

Ten transparent post-mortems of real engineering mistakes, cloud miscalculations, and architectural errors by Arkajit Das.

Silicon Valley and tech corporate culture celebrate success while sanitizing or hiding failures. This museum documents the opposite: ten real engineering missteps, complete with genuine dates, financial losses, root-cause analyses, and the permanent architectural rules they forged. Candor is rare, and learning from costly mistakes is how resilient systems are built.

$185,000+
Cumulative Capital Lessons

Real financial costs documented across production environments.

10 Core Rules
Permanent Engineering Laws

Hard-won operating principles governing current architecture.

100% Verifiable
Zero Hype or Whitewashing

Every post-mortem includes telemetry details and honest post-analysis.

Exhibit #01 • 2017 - Healthcare Data Warehousing

Over-provisioned Database Clusters

Believing Vertical Scaling Was Cheaper Than Fixing N+1 Queries
Read Post-Mortem →
Root Cause: Unindexed relational joins generating 8,000 redundant SQL queries per page load
Financial or Velocity Toll: $42,000 Surplus Infrastructure Waste
Rule 01: Profile and optimize query execution plans before upgrading database CPU or RAM tiers.
Exhibit #02 • 2019 - Transaction Processing Engine

Microservice Bloat in Early Fintech

Splitting a 500-req/sec App into 14 Services Before Product-Market Fit
Read Post-Mortem →
Root Cause: Premature distributed architecture introducing network latency and debugging overhead
Financial or Velocity Toll: 3 Months of Engineering Velocity Lost to Distributed Tracing
Rule 02: Build a modular monolith first. Do not distribute services across network boundaries until team boundaries demand it.
Exhibit #03 • 2021 - Hardware Infrastructure Fleet

Ignoring SO-DIMM RAM Expandability

The Cost of Purchasing Soldered Hardware Fleets for Engineering Teams
Read Post-Mortem →
Root Cause: Procuring thin developer laptops with non-upgradable soldered RAM
Financial or Velocity Toll: $28,000 Premature Hardware Fleet Replacement
Rule 03: Hardware for technical builders must possess modular upgradability and thermal headroom over thin aesthetics.
Exhibit #04 • 2022 - Enterprise Data Attribution

Probabilistic Attribution Hallucinations

Relying on Heuristic Cookie Matchers Before Switching to Deterministic SHA-256
Read Post-Mortem →
Root Cause: Fuzzy browser fingerprinting producing false positive session links across shared office IPs
Financial or Velocity Toll: $65,000 Disputed Affiliate Billings and Lost Client Trust
Rule 04: Never use probabilistic guessing for financial or compliance data. Use cryptographic, deterministic verification.
Exhibit #05 • 2020 - B2B SaaS Product Development

Building Features Before Customer Cash

Building an Automated Export Engine That Only One Client Ever Clicked
Read Post-Mortem →
Root Cause: Confusing casual feature requests in sales calls with genuine willingness to pay
Financial or Velocity Toll: 160 Engineering Hours on an Unused Feature
Rule 05: Do not write complex custom code for uncommitted feature requests. Secure signed contracts or upfront deposits first.
Exhibit #06 • 2021 - Cloud Infrastructure Operations

Premature Kubernetes Adoption

The Three-Person Team on a Five-Node Production Cluster
Read Post-Mortem →
Root Cause: Adopting Google-scale container orchestration tooling for a simple internal web service
Financial or Velocity Toll: 20+ Hours per Month Spent on Cluster Upgrades and Ingress Debugging
Rule 06: Choose boring infrastructure. Deploy containers on managed PaaS or simple VMs until cluster toil justifies dedicated DevOps headcount.
Exhibit #07 • 2022 - Team Building and Hiring

Hiring for Credentials Over Velocity

The Pedigree Trap in Early-Stage Software Teams
Read Post-Mortem →
Root Cause: Over-indexing on prestigious brand-name resumes instead of demonstrated autonomy and building speed
Financial or Velocity Toll: 6 Months of Stalled Feature Delivery
Rule 07: Hire for high agency, pragmatic problem solving, and bias for shipping over academic or brand pedigree.
Exhibit #08 • 2023 - Software Supply Chain Security

Failing to Enforce Cryptographic Commit Signing

Unsigned Commits and Insecure Git Branches in Production
Read Post-Mortem →
Root Cause: Relying on default git author names without GPG/SSH cryptographic signature verification
Financial or Velocity Toll: Failed Enterprise SOC 2 Readiness Audit Gate
Rule 08: All production code repositories must enforce signed commits, branch protections, and automated linters.
Exhibit #09 • 2023 - Cloud Architecture and FinOps

Unthrottled Cloud Serverless Runaways

The Recursive Function That Burned Thousands Over a Single Weekend
Read Post-Mortem →
Root Cause: Event-driven serverless function triggering an infinite recursive loop on S3 bucket writes
Financial or Velocity Toll: $8,400 Cloud Invoice Over a 48-Hour Weekend
Rule 09: Every serverless function must have explicit concurrency caps, hard timeout limits, and real-time billing alarms.
Exhibit #10 • 2024 - Commercial Software Strategy

Complex Pricing Tiers in B2B SaaS

Why Five Pricing Tiers Paralyzed Enterprise Procurement
Read Post-Mortem →
Root Cause: Over-engineering subscription tiers with nickel-and-dime feature gates
Financial or Velocity Toll: 4-Month Average Sales Cycle Drag
Rule 10: Simple pricing accelerates procurement. Offer a transparent entry tier and a clear enterprise annual license.

Schedule a 1-on-1 Engineering Architecture Review

INR 2,000 / $20 USD

Book a 45-minute private consultation with Arkajit Das. Review your software architecture, avoid costly scaling miscalculations, and right-size your cloud footprint.

Book Calendar Slot → PayPal $20 USD → Read Mistakes Archive →