January 2018

S M T W T F S
  123456
78910111213
14151617181920
21222324252627
28293031   

Style Credit

Expand Cut Tags

No cut tags

May 21st, 2007

pozorvlak: (Default)
Monday, May 21st, 2007 10:21 am
Back in 1998, I had a job at JET, the Joint European Torus, one of the world centres of research into nuclear fusion. The complex sprawled over most of the former RAF base at Culham, but the heart was the Machine: a huge torus of metal, machined to precisions of thousandths of an inch, which during experiments contained a few milligrammes of heavy hydrogen at a temperature ten times that of the Sun's core.

This machine pumped out what was at the time a daft amount of data: all the instrument readings and all the analyses of those readings came to around 120MB per run of the Machine (or "shot", as they were called). This was then fed into a wonderfully crockish home-brewed database system running on an IBM 390 mainframe. The system pre-dated the current ubiquity of relational databases, so it was actually a hierarchical database, something that most modern geeks haven't even heard of. The system operated in layers: recently requested data was held in RAM, data that hadn't been requested for a while lived on hard drives, data that hadn't been requested for longer than that lived on tape drives, and data that hadn't been requested for long enough was exiled to the Stygian depths of the tape store: your request for, say, deuterium-band emission spectra from May of 1983 would cause a small, red-eyed robot to trundle off into the tape store, fetch the tape with your data series, trundle back, and physically load it into the mainframe. I used to get lifts to work from the database administrator, and he hated the little robot: it was apparently always breaking down, and he'd then have to crawl in and fix it. "And the red eyes are really sinister! It looks like it's plotting against you."


An integral part of the JET database architecture. Possibly.

The JET Joint Undertaking had been founded in 1978, and had been collecting data for most of the time since. This all added up to a lot of data. My friend apparently used to go to conferences for administrators of large databases just to laugh at what everyone else considered "large".

By performing a simple calculation ) we get an estimate of 900 GB (which is to say nine hundred thousand megabytes) for the total amount of data collected by the JET project in twenty years.

As it happens, 900GB is only slightly larger than [livejournal.com profile] dreamstothesky's porn collection, which currently stands at around 880GB...


The JET Machine: red-hot nucleus-on-nucleus action