How I built the IMDb message boards, in 2001
In this technical retrospective (2017), @yread shares practical architectural lessons learned from running, scaling, or migrating production software under lean constraints.
Core Principles for Independent Builders:
Defaulting to simpler architectures (such as monolithic frameworks, SQLite, or managed VPS) prevents early engineering bankruptcy.
Evaluating true compute and egress costs reveals that high cloud bills can often be slashed by 80%+ through judicious re-platforming.
Code you write at 2 AM as a solo engineer must be easy to debug six months later without complex microservice dependencies.
Community Debate Themes:
HN engineers debated the tradeoffs between cloud convenience and raw server economics, database indexing strategies, and resisting premature architectural complexity.
CATEGORY Frugal Engineering →
HISTORICAL ERA Cloud & Mobile Era (2014–2019)
COMMUNITY SCORE 290 points
TOTAL DISCUSSIONS 59 comments
That was great to read.
As soon as he said mod_perl I knew where things were headed. Having used both mod_perl and PHP (and ColdFusion - anyone remember that?), perl was just a nightmare to use well for this.
Then when he talked about the custom templates written in perl? That's why PHP was invented, because at its core it is a template language. (i.e. the pages are HTML, with code inside them, rather than code, and HTML is treated as a string.)
I suspect that if the forums had been written in PHP they would not be getting shut down right now.
And yes, I know that people love to hate on PHP (including the author who said he disliked PHP because he didn't use it). But sometimes the tools you choose make a huge difference.
It was a great writeup though, really brought back memories.
I once spent an evening in a darkened restaurant patio overwhelmed to tears as a kind man explained to me his young daughter, hospital-bound and dying of cancer, had used the Harry Potter IMDb boards as her main social life in her last year, and how much that had meant to him and her.
For those of us who have fought an existential struggle throughout our careers with the random pointlessness of many of the things we get paid well to build, I think we can take a great measure of hope from this part of the story.
Thank you for writing this long post, Colin, and thank you for the IMDb message boards.
The threaded replies model was stupid. If a post had 20 replies, I have to click 20 times. Each click to show one reply. Many of the replies were moronic. I ended up just reading the main posts only.
I used many threaded discussion software. The one IMDb used was the most annoying. I have never seen it used on any other site. I guessed it must have been developed in-house and wondered why they never enhanced it.
Thanks for taking the time to write this! Thoroughly enjoyed reading it. It's been some time since I've even thought of mod_perl... A graph of whimsy: http://www.securityspace.com/s_survey/data/man.201701/apachemods.html?mod=cGVybA== ↗
Nice read, although I have to say, 2001 I took my first job as a web developer, writing Java apps that would run on Tomcat. Back then Java was a revelation after fumbling with perl - the experience that code would actually work the first time it was run was amazing... (these days I am tired of Java, though).