Does leave time count as work time?

No. “Hours not worked” need not be counted as “hours worked” for purposes of
FLSA wage computations, even if they are counted as work time for some other
purpose such as pensions or for pay computations under employment agreements.