If an image has failed to be generated due to missing GraphViz (or some other issue I guess), it's normally still stored in the plantuml-cache and will be reused even after GraphViz has been installed.
Such failed SVG images should not be stored in the cache.