It sounds like it might be a Brown Rot Fungus (Monillinia spp.). Sanitation is important to help prevent another outbreak next year. Pick up and dispose of all shriveled fruit and other diseased plant parts to reduce the amount of overwintering spores. Sulfur spray applications are probably the best organic prevention method. There are also other petro-chemical fungicide options, some of which may require application by licensed professionals.
If possible, take samples and photos to your local agricultural inspector for their diagnosis and opinion of possible treatment options.