Disclosed is medical intelligent server architecture for computer aided detection that is capable of scaling up for increasing number of patients, and that facilitates modifications and additions of detection services based on various modalities. The architecture is a dedicated server configuration capable of providing services for detecting diseases upon being provided a set of medical images. The architecture is capable of being integrated into existing medical information systems. The architecture for computer aided detection is adaptable to variations in demand for computer aided detection serves, is easily expandable to include new or modified detection services, and is scaleable to accommodate an increasing number of patients and patient images of various types.