[09] WHAT SHOULD I DO IF A SYSTEM CRASHES OR LOCKS UP? Hopefully this will not happen at all to you, but if you experience 'lock ups' or 'freezes', please follow these steps to help prevent your own data loss. Also, it is important to note that you do not have a direct connection to SDF and are mostly likely hopping through 10 or more networks to get to SDF. You can use ping and traceroute to measure lag between your computer and SDF. So, your experience of lag on SDF is subjective and it is very important for you to understand that. Typically a lockup will occur when you are trying to access a file that is resident on the fileserver. For instance, say you are trying to cat a file and instead of seeing the contents you get either nothing or a message similar to: ol1:/sys: not responding Be patient, the fileserver will recover shortly and your task will be completed .. you will probably see: ol1:/sys: is alive again which means your request will actually begin to be processed. During the hang time, you can use ^T (CTRL T) to display the status of your job .. for instance: load: 2.04 cmd: tail 12966 [select] 0.00u 0.00s 0% 808k [select] is the current state of the process id 12966 which is the 'tail' program. If the system is waiting on actual disk I/O, you'll probably see [biowait]. In cases of a hang you may see either [nfsrcvlk] (Network File System Received Lock) or [vnlock] (Virtual Node Lock) which the system will usually recover from, but can be telling of a serious resource problem on the NFS client should this state be prolonged. In the event that the fileserver becomes unavailable, it is important that you do not become impatient and interrupt, quit or suspend your jobs (^C, ^\ or ^Z) but rather, wait them out. If you are patient your chances of losing data will be significantly reduced. Usually the fileserver will respond within a few seconds, but usually no longer. In the case when it is the NFS client's problem (vnlock for more than say 20 seconds) that particular host will most likely need to be reset. More on this. SDF is pushing NetBSD to its limits and we are currently (2003-2004) doing quite a bit of investigation with the uvm/vfs/vnode code developers to help NetBSD become scalable in high usage situations such as the loads we experience on SDF. Solutions we find will be incorporated into the public code. [[misc|back]]