This error means that your display does not have possibility to display the resolution you requested.
1. Open your fretsonfire.ini
2. Find the resolution = line and change it to resolution = 640x480
3. If you are still unable to run the game, find the fullscreen = line and change it to fullscreen = False