If a federal holiday falls on a Saturday, the preceding Friday is a holiday; if a holiday falls on a Sunday the following Monday is a holiday.
State holidays are holidays for the government and public sector in that state and many, but not all, private businesses will give employees the day off.