Usually this happens if you choose Other HTTP Camera in the Connect To network dialog.
There are two possibilities to adapt the resolution:

  1. Enter your camera's web interface and set the default resolution to the one you want.
  2. Or find the HTTP GET Request Format for your camera and start it with the wanted resolution. Follow this FAQ entry.