I personally do not track it -- but I'm not going for making this an exact science in maintenance, and I've been pretty lucky about not needing to do so. It's such a small part of the whole that I don't worry too much about it. (I do try to account for sauces I put on top of food however -- though even those I don't generally actually measure unless they're really calorie dense.)
Looks like you may be an athlete, though -- are you in a sport where you periodically need to "cut weight'? If so, you may need to track everything during those time -- probably more for the salt than the calories.
Starting Weight: 260 lbs. (November 2010)
Quasi-Maintenance: 165 lbs. (June 2011)
Goal Weight: 150 lbs. (reached December 8, 2011)
Size 22W to Size 4
Currently maintaining within 5 lbs. (+ or -) of goal. I weigh daily, but also use a tape measure and the fit of my clothes to guage how well I'm doing.