If the day is 23 hours and 56 minutes long and we use 24-hour clocks, where do the extra 4 minutes go?

Our clocks do not keep track of this missing time, but every 4 years we all agree to add on another day to the end of February to reset the count at zero again. I wouldn't loose sleep over it...well, maybe 4 minutes!