As you may have guessed, willfully refraining from filing a tax return is tax fraud. Punishments for violators include fines, penalties, interest, and yes, even imprisonment, depending on the severity of the violation (amount of taxes owed, repeated violation, sophisticated tax evasion, etc).