SH-4478 Corrected/updated error handling for all retrieval operations.

In case of HTTP errors or parsing/processing errors, fail the
fetch request rather than do a retry spin.  Add logging for all
such failure paths.  Added a development/debug flag to create
probabilistic failures to test these modes and general error
recovery by higher-level layers.