Firefighters are at the scene of a restaurant fire in the downtown village, a local public safety dispatcher confirmed Tuesday night.