Walk through your hardest debugging investigation

Tell the story of the hardest or most memorable bug you have tracked down. Explain the symptoms, how you narrowed it down, the dead ends, the root cause and the fix, and what you changed afterwards so it would not happen again. A good answer shows a method rather than luck, and is specific about your own part.