2003/06/28
01:47:15
Things go boom - things that aren't supposed to go boom. OK, so it's Avalon upgrade weekend. The day's OK, miscellaneous stuff, a good lunch at Chipotle, and a meeting about accounts which wasn't bad. Then the joys of windows. Apparently the ATI AGP video card we had and Athlon chipsets don't agree at all. There's a patch, but in order to install it you need windows running, and yea... But then selecting files for restore takes a long time. Turns out that apparently the server is doing lots of account lookups on the unix side (not sure why - the program is running as root, and the files backed up have no relation to the unix permissions). Anyways, turns out this load is enough to slow down and eventually crash the NIS+ server. To give you an idea of the scale of how many requests, I couldn't get ICMP or ARP packets through the storm to the server for a while... But I noticed the problem when I didn't get email for 20 minutes. And I was able to localize the start of the total outage to within 3 minutes just by scanning the parts of my mail that aren't filtered to places I don't read. I think that means something like I get way too much email... Anyways, I gotta be back at work at 9:30 or so tomorrow morning, so it's time for me to go get some sleep...