In this paper we propose a method which uses multiple video images to establish the pose of a CT volume with respect to video camera coordinates for use in image guided surgery. The majority of neurosurgical procedures require the neurosurgeon to relate the pre-operative MR/CT data to the intra-operative scene. Registration of 2D video images to the pre-operative 3D image enables a perspective projection of the pre-operative data to be overlaid onto the video image. Our registration method is based on image intensity and uses a simple iterative optimization scheme to maximize the mutual information between a video image and a rendering from the pre-operative data. Video images are obtained from a stereo operating microscope, with a field of view of approximately 110 X 80 mm. We have extended an existing information theoretical framework for 2D-3D registration, so that multiple video images can be registered simultaneously to the pre-operative data. Experiments were performed on video and CT images of a skull phantom. We took three video images, and our algorithm registered these individually to the 3D image. The mean projection error varied between 4.33 and 9.81 millimeters (mm), and the mean 3D error varied between 4.47 and 11.92 mm. Using our novel techniques we then registered five video views simultaneously to the 3D model. This produced an accurate and robust registration with a mean projection error of 0.68 mm and a mean 3D error of 1.05 mm.

There is a growing consensus that mutual voxel information based measures hold great promise for fully automated multimodal image registration. We have found that image greyscale binning using a specific variation of contrast- limited histogram equalization (which we call histogram preservation) provides significant reduction of noise and spurious local maxima in the normalized mutual information function without causing significant displacement or smoothing of the global maximum. These effects are also relatively robust in the presence of image subsampling, so that accurate subpixel coregistration of typical medical volume images may be achieved in a few seconds by a very simple optima search algorithm based on a few thousand sampled voxels. In this paper, we illustrate these effects by presenting the results of random tests on patient data. Intramodal performance is evaluated by image self- registration using a variety of patient image volumes. Reregistration error is measured as the mean of the residual Euclidean displacement of the eight corner points of the image volumes after reregistration. The performance of histogram preservation prebinning is compared to linear prebinning, and the effect of image subsampling and number of bins on algorithm speed and accuracy is also assessed.

Point-based registration of images generally depends on the extraction of suitable landmarks. Recently, different 3D operators have been proposed in the literature to detect anatomical point landmarks in 3D images. While the localization performance of 3D operators has already been investigated (e.g., Frantz et al), studies on the detection performance of 3D operators are hardly known. In this paper, we investigate nine 3D differential operators for the detection of 3D point landmarks in MR and CT images. These operators are based on either first, second, or first and second order partial derivatives of an image. In our investigation we use measures, which reflect different aspects of the detection performance of the operators. in the first part of the investigation, we analyze the number of corresponding detections in 3D tomographic images, and in the second part we use statistical measures to determine the detection performance w.r.t. certain landmarks. It turns out that (1) operators based on only first order partial derivative of an image yield a larger number of corresponding points than the other operates and that (2) their performance on the basis of the statistical measures is better.

Spoiled gradient echo volume MR scans were obtained from 5 growth hormone (GH) patients and 6 normal controls. The patients were scanned before treatment and after 3 and 6 months of GH therapy. The controls were scanned at similar intervals. A calibration phantom was scanned on the same day as each subject. The phantom images were registered with a 9 degree of freedom algorithm to measure scaling errors due to changes in scanner calibration. The second and third images were each registered with a 6 degree of freedom algorithm to the first (baseline) image by maximizing normalized mutual information, and transformed, with and without scaling error correction, using sinc interpolation. Each registered and transformed image had the baseline image subtracted to generate a difference image. Two neuro-radiologists were trained to detect structural change with difference images containing synthetic misregistration and scale changes. They carried out a blinded assessment of anatomical change for the unregistered; aligned and subtracted; and scale corrected, aligned and subtracted images. The results show a significant improvement in the detection of structural change and inter-observer agreement when aligned and subtracted images were used instead of unregistered ones. The structural change corresponded to an increase in brain: CSF ratio.

Registration algorithms often require the estimation of grey values at image locations that do not coincide with image grid points. Because of the intrinsic uncertainty, the estimation process will invariably be a source of error in the registration process. For measures based on entropy, such as mutual information, an interpolation method that changes the amount of dispersion in the probability distributions of the grey values of the images will influence the registration measure. With two images that have equal grid distances in one or more corresponding dimensions, a large number of grid points can be aligned for certain geometric transformations. As a result, the level of interpolation is dependent on the image transformation and hence, so is the interpolation-induced change in dispersion of the histograms. When an entropy based registration measure is plotted as a function of transformation, it will show sudden changes in value for the grid-aligning transformations. Such patterns of local extrema impede the optimization process. More importantly, they rule out subvoxel accuracy. Interpolation-induced artifacts are shown to occur in registration of clinical images, both for trilinear and partial volume interpolation. Furthermore, the results suggest that improved registration accuracy for scale-corrected MR images may be partly accounted for by the inequality of grid distances that is a result of scale correction.

We have examined whether automated image registration can be used to combine metabolic information from SPECT knee scans with anatomical information from MRI. Ten patients, at risk of developing OA due to meniscal surgery, were examined. ^99mTc methyldiphosphonate SPECT, T₂-weighted fast spin echo (FSE) MRI, and T₁-weighted, 3D fat-suppressed gradient recalled echo (SPGR) MRI images were obtained. Registration was performed using normalized mutual information. For each patient, FSE data was registered to SPGR data, providing a composite MRI image with each voxel represented by two intensities (I_SPGR, I_FSE). Modifications to the registration algorithm were made to allow registration of SPECT data (one intensity per voxel) to composite MRI data (2 intensities per voxel). Registration sources was assessed by visual inspection of uptake localization over expected anatomical locations, and the absence of uptake over unlikely sites. Three patients were discarded from SPECT-MRI registration tests since they had metallic artifacts that prevented co-registration of MR data. Registration of SPECT to SPGR or FSE data alone proved unreliable, with less than 50% of attempts succeeding. The modified algorithm, treating co-registered SPGR and FSE data as a two-value-per-voxel image, proved most reliable, allowing registration of all patients with no metallic artifacts on MRI.

In this paper we present a new approach for the non-rigid registration of contrast-enhanced breast MRI. A hierarchical transformation model of the motion of the breast has been developed. The global motion of the breast is modelled by an affine transformation while the local breast motion is described by a free-form deformation based on B-splines. Normalized mutual information is used as a voxel-based similarity measure which is insensitive to intensity changes as the result of the contrast enhancement. Registration is achieved by minimizing a cost function which represents a combination of the cost associated with the smoothness of the transformation and the cost associated with the image similarity. The algorithm has been applied to the fully automated registration of 3D breast MRI in volunteers and patients. In particular, we have compared the results of the proposed non-rigid registration algorithm to those obtained using rigid and affine registration techniques. The results clearly indicate that the non-rigid registration algorithm is much better able to recover the motion and deformation of the breast than rigid or affine registration algorithms.

Failure to align images accurately often is due to the optimization algorithms being trapped in local maxima or spurious global maxima of the mutual information function. Strategies contemplated to improve registration involve modifying the optimization scheme or the registration measure itself. We recently found that normalized mutual information (for 2D image registration) provides a larger capture range and that is more robust, with respect to the optimization parameters, than the non-normalized measure. In this paper we assessed the utility of a stochastic global optimization technique for image registration using normalized and non-normalized mutual information. By conducting large-scale studies with patient data in 2D, we established a success rate baseline with the local optimizer only. Formal proof has not yet been found that incorporating the global optimizer does not impair performance. However, experiments to date indicate that its inclusion leads to better (i.e., higher probability of correct convergence) overall performance. More over, studies now underway show good effectiveness of our approach in a variety of 3D cases.

This paper presents a comparison of iso-intensity-based surface extraction algorithms applied to computed tomography (CT) images of the spine. The extracted vertebral surfaces are used in surface-based registration of CT images to physical space, where our ultimate goal is the development of a technique that can be used for image-guided spinal surgery. The surface extraction process has a direct effect on image-guided surgery in two ways: the extracted surface must provide an accurate representation of the actual surface so that a good registration can be achieved, and the number of polygons in the mesh representation of the extracted surface must be small enough to allow the registration to be performed quickly. To examine the effect of the surface extraction process on registration error and run time, we have performed a large number of experiments on two plastic spine phantoms. Using a marker-based system to assess accuracy, we have found that submillimetric registration accuracy can be achieved using a point-to- surface registration algorithm with simplified and unsimplified members of the general class of iso-intensity- based surface extraction algorithms. This research has practical implications, since it shows that several versions of the widely available class of intensity-based surface extraction algorithms can be used to provide sufficient accuracy for vertebral registration. Since intensity-based algorithms are completely deterministic and fully automatic, this finding simplifies the pre-processing required for image-guided back surgery.

We propose a method for estimating intrasurgical brain shift for image-guided surgery. This method consists of five stages: the identification of relevant anatomical surfaces within the MRI/CT volume, range-sensing of the skin and cortex in the OR, rigid registration of the skin range image with its MRI/CT homologue, non-rigid motion tracking over time of cortical range images, and lastly, interpolation of this surface displacement information over the whole brain volume via a realistically valued finite element model of the head. This paper focuses on the anatomical surface identification and cortical range surface tracking problems. The surface identification scheme implements a recent algorithm which imbeds 3D surface segmentation as the level- set of a 4D moving front. A by-product of this stage is a Euclidean distance and closest point map which is later exploited to speed up the rigid and non-rigid surface registration. The range-sensor uses both laser-based triangulation and defocusing techniques to produce a 2D range profile, and is linearly swept across the skin or cortical surface to produce a 3D range image. The surface registration technique is of the iterative closest point type, where each iteration benefits from looking up, rather than searching for, explicit closest point pairs. These explicit point pairs in turn are used in conjunction with a closed-form SVD-based rigid transformation computation and with fast recursive splines to make each rigid and non-rigid registration iteration essentially instantaneous. Our method is validated with a novel deformable brain-shaped phantom, made of Polyvinyl Alcohol Cryogel.

Using an optical-flow technique, we have quantitatively analyzed tissue motion due to artery pulsation accompanied with blood flow in a neonatal cranial ultrasonogram. The tissue motion vector was successfully calculated at each pixel in a series of echo images (32 frames, 640 X 480 pixels/frame, 8 bits/pixel, 33 ms/frame) taken in the brightness mode by using an ultrasound probe of 5.0 MHz. The optical-flow technique used was a gradient method combined with local optimization for 3 X 3 neighbors. From 2D mappings of tissue motion vectors and their time-sequence variations, it was found that the tissue motion due to artery pulsation revealed periodic to-and-fro motion synchronized with heartbeat (300 - 500 ms), clearly distinguishing from unwanted non-periodic motion due to the sway of neonatal head during diagnosis.

This paper introduces a new imaging modality based on existing computed radiography technology to form a total body part image from a series of overlapping subimages. The subimages are exposed simultaneously but digitized individually as normal single-exposure examinations. During exposure, a rectangular grid of attenuating lines is present in the X-ray path to aid in the reconstruction process. A digital image-processing algorithm has been developed to assemble a composite image from the subimages, showing perfect geometric continuity of body parts, a technique termed image `stitching'.

Four main problems have to be solved for template matching based motion compensation in digital subtraction angiography. All the problems are concerned with the similarity measure that is the objective function to be optimized within the template matching procedure: (1) Due to the injection of contrast agent, mask and contrast image are dissimilar, which degrades the quality of some similarity measures. (2) Homogeneous areas in the fluoroscopic images lead to an insufficient quality of the similarity measure. (3) Shift invariant structures in fluoroscopic images (e.g. straight lines or edges) lead to a ridge-like objective function that potentially gives wrong results from the optimization procedure: If a ridge-like structure of the objective function is present, movements along this direction cannot be detected. Therefore, the local accuracy of the estimated motion component parallel to these directions must be ranked low while the corresponding orthogonal direction must be ranked high. We here present a technique to obtain local, directional rankings from the shape of the objective function which especially improves the quality of DSA images obtained from peripheral areas like the shinbone. (4) Inhomogeneous movements inside a single template lead to ambiguous or even irrelevant optima of the objective function: This problem is out of the scope of the present paper and will therefore not be addressed here. The performance of the point-based registration using different weightings in the least squares procedure (equally, isotropic and anisotropic weighting) has been compared. The isotropic and anisotropic weighting turned out to be superior to the equally weighted least squares procedure.

Over the past 20 years, many problems in Bayesian inference that were previously intractable can now be fairly routinely dealt with using a computationally intensive technique for exploring the posterior distribution called Markov chain Monte Carlo (MCMC). Primarily because of insufficient computing capabilities, most MCMC applications have been limited to rather standard statistical models. However, with the computing power of modern workstations, a fully Bayesian approach with MCMC, is now possible for many imaging applications. Such an approach can be quite useful because it leads not only to `point' estimates of an underlying image or emission source, but it also gives a means for quantifying uncertainties regarding the image. This paper gives an overview of Bayesian image analysis and focuses on applications relevant to medical imaging. Particular focus is on prior image models and outlining MCMC methods for these models.

A fully automated algorithm was developed to segment the brain from T1-weighted volume MR images. Automatic non- uniformity correction is performed prior to segmentation. The segmentation algorithm is based on automatic thresholding and morphological operations. It is fully 3D and therefore independent of scan orientation. The validity and performance of the algorithm were evaluated by comparing the automatically calculated brain volume with semi- automated measurements in 10 subjects. The amount of non- brain tissue included in the automatic segmentation was calculated. To test reproducibility, the brain volume was calculated in repeated scans in another 10 subjects. The mean and standard deviation of the difference between the semi-automated and automated measurements were 0.6% and 2.8% of the mean brain volume, respectively, which is within the inter-observer variability of the semi-automatic method. The mean amount of non-brain tissue contained in the segmented brain mask was 0.3% of the mean brain volume, with a standard deviation of 0.2%. The mean and standard deviation of the difference between the total volumes calculated from repeated scans were 0.4% and 1.2% of the mean brain volume, respectively.

A hierarchical Markov random field (MRF) model for mammographic structure segmentation using multiple spatial and intensity image resolutions is proposed. The general image model is formed by a sequence of representations at different spatial and intensity scales. Through the hierarchical structure of the MRF model, components at different local spatial resolutions are used to condition the corresponding intensity resolution and the spatial distribution of the intensity components. As a first step, only breast skin edge and non fat breast parenchyma (Cooper's ligaments, blood vessels and fibroglandular tissue) have been included into the model and implemented. Three basic priors for the local spatial intensity distribution (texture) are defined. An iterated conditional mode (ICM) optimization procedure is implemented, the lower resolution representations are used sequentially to form the initial image configurations for the ICM procedure. The proposed approach was tested using 100 digitized mammograms (at a resolution of 100 microns and 12 bits per pixel). The mammograms are from three different views and different breast parenchyma densities. Results for breast skin edge and breast parenchyma were obtained and evaluated visually. For all cases, the location of the three possible structures (skin, parenchyma and background) was identified correctly.

A probabilistic deformable model for the representation of brain structures is described. The statistically learned deformable model represents the relative location of head (skull and scalp) and brain surfaces in MR/SPECT images pairs and accommodates the significant variability of these anatomical structures across different individuals. To provide a training set, a representative collection of 3D MRI volumes of different patients have first been registered to a reference image. The head and brain surfaces of each volume are parameterized by the amplitudes of the vibration modes of a deformable spherical mesh. For a given MR image in the training set, a vector containing the largest vibration modes describing the head and the brain is created. This random vector is statistically constrained by retaining the most significant variations modes of its Karhunen-Loeve expansion on the training population. By these means, both head and brain surfaces are deformed according to the anatomical variability observed in the training set. Two applications of the probabilistic deformable model are presented: the deformable model-based registration of 3D multimodal (MR/SPECT) brain images and the segmentation of the brain from MRI using the probabilistic constraints embedded in the deformable model. The multi-object deformable model may be considered as a first step towards the development of a general purpose probabilistic anatomical atlas of the brain.

In the past, we have presented three user-steered image segmentation paradigms: live wire, live lane, and the 3D extension of the live-wire method. In this paper, we introduce an ultra-fast live-wire method, referred to as live-wire-on-the-fly, for further reducing user's time compared to live wire. For both approaches, given a slice and a 2D boundary of interest in this slice, we translate the problem of finding the best boundary segment between any two points specified by the user on this boundary to the problem of finding the minimum-cost path between two vertices in a weighted and directed graph. The entire 2D boundary is identified as a set of consecutive boundary segments, each specified and detected in this fashion. A drawback in live wire is that the speed for optimal path computation depends on image size, compromising the overall segmentation efficiency. In this work, we solve this problem by exploiting some properties of graph theory to avoid unnecessary minimum-cost path computation during segmentation. Based on 164 segmentation experiments from an actual medical application, we demonstrate that live-wire- on-the-fly is about 1.5 to 33 times faster than live wire for actual segmentation, although the pure computational part alone is found to be over a hundred times faster.

This paper introduces global shape modeling by means of Markov random fields and describes its use in medical image segmentation. The key point positions representing the shape of an object are assumed to be multivariate Gaussian distributed with a certain covariance structure which relates to the Markov property with respect to some neighborhood system. Since the neighborhood of a key point potentially contains both nearby and long distant key points, global key point interaction is not only realized by propagated local key point interaction, but also directly by long distant key point interaction. We restrict ourselves to the subclass of decomposable models, since a closed form expression for the maximum likelihood estimate of the covariance matrix from a set of training shapes is available in this case. The neighborhood system is either a priori defined or estimated. Our model building procedure is demonstrated for the 2D shape of spinal vertebra. The suitability of the derived shape models is investigated by generating new shape samples according to the models. Finding the object's boundary in a grey value image is formulated as maximum a posteriori estimation incorporating the shape model as a priori model. Our model-based segmentation procedure includes an easy and effective interactive improvement of the segmentation outcome.

We present a method for enforcing a topological constraint, homeomorphism to a sphere, on a set of volumetric data. A graph-based topological representation is created from voxel connectivity within the volume and automatically edited to have the desired topology. The volume is forced to match this structure, resulting in a topologically spherical surface. The method is fully automated and has the advantage of operating on the volume data prior to tessellation, significantly reducing computational costs compared to mesh- based methods. We demonstrate the method on a simple test volume and on the surface of a cerebral cortex obtained from a magnetic resonance image volume.

In this paper, we report on a semi-automatic approach to segmentation of carotid arteries from 3D ultrasound (US) images. Our method uses a deformable model which first is rapidly inflated to approximately find the boundary of the artery, then is further deformed using image-based forces to better localize the boundary. An operator is required to initialize the model by selecting a position in the 3D US image, which is within the carotid vessel. Since the choice of position is user-defined, and therefore arbitrary, there is an inherent variability in the position and shape of the final segmented boundary. We have assessed the performance of our segmentation method by examining the local variability in boundary shape as the initial selected position is varied in a freehand 3D US image of a human carotid bifurcation. Our results indicate that high variability in boundary position occurs in regions where either the segmented boundary is highly curved, or the 3D US image has poorly defined vessel edges.

We propose a new technique for elastic deformation restriction of active contour models to particular object shapes. For this purpose we apply localized multi-scale contour parametrization based on the 1D dyadic Wavelet Transform (WT) as a multi-scale boundary curve analysis tool. Our approach determines the WT-coefficients within a certain scale range, which differ significantly from the correspondent WT-coefficients of the most similar model in a training set. Those WT-coefficients are replaced by the correspondent model WT-coefficients to perform the reconstruction of the contour. The difference of the original deformed contour and the reconstructed contour is used as inner snake forces. By this technique it can be avoided, that the deformable contour is trapped into disturbing local minima of the snakes potential due to noise or irrelevant image features. The contour deformation method is integrated in a coarse to fine segmentation frame based on a multiscale image edge representation using the local modulus maxima of the dyadic Wavelet Transform. For detection of the object's position and initialization of the snake we apply a multiresolution binary matched filter at a coarse scale containing few detail information.

Tangible solutions to practical image segmentation are vital to ensure progress in many applications of medical imaging. Toward this goal, we previously proposed a theory and algorithms for fuzzy connected object definition in n- dimensional images. Their effectiveness has been demonstrated in several applications including multiple sclerosis lesion detection/delineation, MR Angiography, and craniofacial imaging. The purpose of this work is to extend the earlier theory and algorithms to fuzzy connected object definition that considers all relevant objects in the image simultaneously. In the previous theory, delineation of the final object from the fuzzy connectivity scene required the selection of a threshold that specifies the weakest `hanging-togetherness' of image elements relative to each other in the object. Selection of such a threshold was not trivial and has been an active research area. In the proposed method of relative fuzzy connectivity, instead of defining an object on its own based on the strength of connectedness, all co-objects of importance that are present in the image are also considered and the objects are let to compete among themselves in having image elements as their members. In this competition, every pair of elements in the image will have a strength of connectedness in each object. The object in which this strength is highest will claim membership of the elements. This approach to fuzzy object definition using a relative strength of connectedness eliminates the need for a threshold of strength of connectedness that was part of the previous definition. It seems to be more natural since it relies on the fact that an object gets defined in an image by the presence of other objects that coexist in the image. All specified objects are defined simultaneously in this approach. The concept of iterative relative fuzzy connectivity has also been introduced. Robustness of relative fuzzy objects with respect to selection of reference image elements has been established. The effectiveness of the proposed method has been demonstrated using a patient's 3D contrast enhanced MR angiogram and a 2D phantom scene.

This paper extends a previously reported theory and algorithms for fuzzy connected object definition. It introduces `object scale' for determining the neighborhood size for defining affinity, the degree of local hanging togetherness between image elements. Object scale allows us to use a varying neighborhood size in different parts of the image. This paper argues that scale-based fuzzy connectivity is natural in object definition and demonstrates that this leads to a more effective object segmentation than without using scale in fuzzy concentrations. Affinity is described as consisting of a homogeneity-based and an object-feature- based component. Families of non scale-based and scale-based affinity relations are constructed. An effective method for giving a rough estimate of scale at different locations in the image is presented. The original theoretical and algorithmic framework remains more-or-less the same but considerably improved segmentations result. A quantitative statistical comparison between the non scale-based and the scale-based methods was made based on phantom images generated from patient MR brain studies by first segmenting the objects, and then by adding noise and blurring, and background component. Both the statistical and the subjective tests clearly indicate the superiority of scale- based method in capturing details and in robustness to noise.

Injuries of the menisci are one of the most common internal derangement of the knee. To examine them with noninvasive, we propose an automated segmentation method of the menisci region from MR image. The method is composed of two steps based on fuzzy logic. First, we segment the cartilage region by thresholding of the intensity. We then extract the candidate region of the menisci as the region between the cartilages. Second, we segment the menisci voxels from the candidate region based on fuzzy if-then rules obtained from knowledge of location and intensity. We applied our method to five MR data sets. Three of them are the normal knees and the others are with some injuries. Quantitative evaluation by a physician shows that this method can successfully segment the menisci for the all. The generated visualizations will help medical doctor to diagnose the menisci with noninvasive.

Studies reported in the literature indicate that breast cancer risk is associated with mammographic densities. Although, an objective, repeatable quantitative measure of risk derived from mammographic densities will be of great use in recommending alternative screening paradigms and/or preventive measures, image processing efforts toward this goal seem to very sparse in the literature, and automatic and efficient methods do not seem to exist. In this paper, we describe and validate an automatic and reproducible method to segment glandular tissue regions from fat within breasts from digitized mammograms using scale-based fuzzy connectivity methods. Different measures for characterizing density are computed from the segmented regions and their accuracies in terms of their linear correlation across two different projections (CC and MLO) are studied. It is shown that quantization of glandularity taking into account the original intensities is more accurate than just considering the segmented areas. This makes the quantification less dependent on the shape of the glandular regions and the angle of projection. A simple phantom experiment is done that supports this observation.

This work is concerned with the implementation of a fully 3D-consistent, automatic segmentation of bone structures in CT images. The morphological watersheds algorithm has been chosen as the base of the low-level segmentation. The over- segmentation, a phenomenon normally involved with this transformation, has been sorted out successfully by inserting modifying modules that act already within the algorithm. When dealing with a maxillofacial image, this approach also includes the possibility to provide two different divisions of the image: a fine-grained tessellation geared to the following high-level segmentation and a more coarse-grained one for the segmentation of the teeth. In the knowledge-based high-level segmentation, probabilistic considerations make use of specific properties of the 3D low-level regions to find the most probable tissue for each region. Low-level regions that cannot be classified with the necessary certainty are passed to a second stage, where--embedded in their respective environment--they are compared with structural patterns deduced from anatomical knowledge. The tooth segmentation takes the coarse-grained tessellation as its starting point. The few regions making up each tooth are grouped to 3D envelopes--one envelope per tooth. Matched filtering detects the bases of these envelopes. After a refinement they are fitted into the fine- grained, high-level segmented image.

In this paper, we present a new approach for segmenting regions of bone in MRI volumes using a deformable model. Our method takes into account the partial volume effects that occur with MRI data, thus permitting a precise segmentation of these bone regions. Partial volume is estimated, in a narrow band around the deformable model, at each iteration of the propagation of the model. Segmentation of the skull in medical imagery is an important stage in applications that require the construction of realistic models of the head. Such models are used, for example, to simulate the behavior of electro-magnetic fields in the head and to model the electrical activity of the cortex in EEG and MEG data.

This work presents a reliable automatic segmentation algorithm for multispectral MRI data sets. We propose the use of an automatic statistical region growing algorithm based on a robust estimation of local region mean and variance for every voxel on the image. The best region growing parameters are automatically found via the minimization of a cost functional. Furthermore, we propose a hierarchical use of relaxation labeling, region splitting, and constrained region merging to improve the quality of the MRI segmentation. We applied this approach to the segmentation of MRI images of anatomically complex structures which suffer signal fading and noise degradations.

This paper presents a general statistical framework for modeling deformable object. This model is devoted being used in digital brain atlases. We first present a numerical modeling of brain sulci. We present also a method to characterize the high inter-individual variability of basic cortical structures on which the description of the cerebral cortex is based. The aimed applications use numerical modeling of brain sulci to assist non-linear registration of human brains by inter-individual anatomical matching or to better compare neuro-functional recordings performed on a series of individuals. The utilization of these methods is illustrated using a few examples.

3D MR angiogram offers a means for visualizing the entire cerebral vessels from any orientation and for detecting the stenotic lesions. In this paper we proposed a new 3D tracking method for reconstructing cerebral vessels from MR angiograms. Then, based on the image analysis and visualization results of the vessel trees, various important information can be computed. In vessel extraction, an urchin tracking technique is proposed to extract each segment of the vessel trees. The behaviors of the urchin including pinpricks growing, moving, and sub-urchin generation are designed and implement. Our scheme is also capable of handling the problem of the vessel bifurcation. In vessel display, semi-boundary technique was employed. The system performed in the vessel extraction takes roughly 15 seconds on a PC Pentium 166 for a 256 X 256 X 60 8-bits 3D angiogram. Compared with conventional methods, we proposed a fast and stable method to obtain the 3D vessel trees.

Surface-based interpolation and registration, radiation treatment, and 3D visualization of 2D sliced data from CT or MRT require a precise reconstruction of 3D organ surfaces from 2D segmentation results. Current surface-reconstruction algorithms are based on surface triangulations using heuristics to correlate and connect adjustment object slices. The approaches described in the literature can be divided into triangulations using optimization procedures, Delauny triangulations, and topology-based correlations. All approaches assume a global and invariant vertically oriented correlation strategy that can be applied equally to every organ and every slice. Surface and correlation characteristics vary greatly among bony structures and organs such as the eyes and the brain. An adjusted reconstruction of each organ according to its individual tissue characteristics is necessary to avoid errors in following processing steps such as interpolation, registration, and radiation treatment. To this end, we have designed a model-based surface-reconstruction algorithm that takes individual surface characteristics into account and allows the integration of anatomical knowledge. 3D surface models are generated from sliced data or any other source of anatomical knowledge. These models are later adjusted to the segmentations, compensating for artifacts and incomplete data.

We develop an approximate theoretical formula for fast computation of the covariance of PET images reconstructed using maximum a posteriori (MAP) estimation. The results assume a Poisson likelihood for the data and a quadratic prior on the image. The covariance for each voxel is computed using 2D FFTs and is a function of a single data dependent parameter. This parameter is computed using a modified backprojection. For a small region of interest (ROI), the correlation can be assumed to be locally stationary so that computation of the variance of an ROI can be performed very rapidly. Previous approximate formulae for the variance of MAP estimators have performed poorly in areas of low activity since they do not account for the non- negativity constraints that are routinely used in MAP algorithms. Here a `truncated Gaussian' model is used to compensate for the effect of the non-negativity constraints. Accuracy of the theoretical expressions is evaluated using both Monte Carlo simulations and a multiple-frame ¹⁵O- water brain study. The Monte Carlo studies show that the truncated Gaussian model is effective in compensating for the effect of the non-negativity constraint. These results also show good agreement between Monte Carlo covariances and the theoretical approximations. The ¹⁵O-water brain study further confirms the accuracy of the theoretical approximations.

We address the issue of using deformable models to reconstruct the shape of unknown objects in the context of 3D tomography. We focus on the reconstruction of piecewise- uniform radioactive distributions such as in blood pool or lung imaging. We represent the unknown distribution by a set of closed surfaces defining uniformly emitting regions in space. The methods implemented so far tend to directly deform the surfaces. Rather than deforming the surface models themselves, we explore the deformation of the space in which the surfaces are contained to match a set of scintigraphic measurements. We focus on the use of free-form deformations to describe the continuous transformation of space. We illustrate this approach by reconstructing simulated scintigraphic data of the lungs.

A technique for the automatic correction of motion artifacts in MR images was developed. The algorithm uses only the raw (complex) data from the MR scanner, and requires no knowledge of the patient motion during the acquisition. It operates by searching over the space of possible patient motions and determining the motion which, when used to correct the image, optimizes the image quality. The performance of this algorithm was tested in coronal images of the rotator cuff in a series of 144 patients. A four observer comparison of the autocorrelated images with the uncorrected images demonstrated that motion artifacts were significantly reduced in 48% of the cases. The improvements in image quality were similar to those achieved with a previously reported navigator echo-based adaptive motion correction. The results demonstrate that autocorrelation is a practical technique for retrospectively reducing motion artifacts in a demanding clinical MRI application. It achieves performance comparable to a navigator based correction technique, which is significant because autocorrection does not require an imaging sequence that has been modified to explicitly track motion during acquisition. The approach is flexible and should be readily extensible to other types of MR acquisitions that are corrupted by global motion.

Truncated Projection Computer Tomography (TPCT) is an imaging method that, in contrast to conventional CT, collects projection data along only a segment of each integration path. We examine three aspects of TPCT in this article. First, we present computer simulations of data acquisition and image reconstruction for TPCT. The reconstruction algorithm is iterative and sometimes referred to as the Algebraic Reconstruction Technique or ART. Failings of the technique, when used in this application, motivate our examination of objects with annular support. We find that, for a rect truncation window, TPCT naturally segments an object whose support is a disk into annular sub- objects. Finally, we introduce an analytical TPCT reconstruction formula. This reconstruction formula amounts to inversion of the incomplete Radon transform.

Maximum Likelihood estimation based Expectation Maximization (EM) reconstruction algorithm has shown to provide good quality reconstruction for PET. Our previous work introduced the multigrid and multiresolution concept for PET image reconstruction using EM. This work transforms the MGEM and MREM algorithm to a Wavelet based Multiresolution EM algorithm by extending the concept of switching resolutions in both image and data spaces. The multiresolution data space is generated by performing a 2D-wavelet transform on the acquired tube data that is used to reconstruct images at different spatial resolutions. Wavelet transform is used for multiresolution reconstruction as well as adapted in the criterion for switching resolution levels. The advantage of the wavelet transform is that it provides very good frequency and spatial (time) localization and allows the use of these coarse resolution data spaces in the EM estimation process. The multiresolution algorithm recovers low frequency components of the reconstructed image at coarser resolutions in fewer iterations, reducing the number of iterations required at finer resolution to recover high frequency components. This paper also presents the design of customized biorthogonal wavelet filters using the lifting method, which are used for data decomposition and image reconstruction.

In this work we examine the accuracy of four periodic interpolation methods--circular sampling theorem interpolation, zero-padding interpolation, periodic spline interpolation, and linear interpolation with periodic boundary conditions--for the task of interpolating additional projections in a few-view sinogram. We generated 100 different realizations each of two types of numerical phantom--Shepp-Logan and breast--by randomly choosing the parameters that specify their constituent ellipses. Corresponding sinograms of 128 bins X 1024 angles were computed analytically and subsampled to 16, 32, 64, 128, 256, and 512 views. Each subsampled sinogram was interpolated to 1024 views by each of the methods under consideration and the normalized root-mean-square-error (NRMSE) with respect to the true 1024-view sinogram computed. In addition, images were reconstructed from the interpolated sinograms by FBP and the NRMSE with respect to the true phantom computed. The non-parametric signed rank test was then used to assess the statistical significance of the pairwise differences in mean NRMSE among the interpolation methods for the various conditions: phantom family (Shepp-logan or breast), number of measured views (16, 32, 64, 128, 256, or 512), and endpoint (sinogram or image). Periodic spline interpolation was found to be superior to the others in a statistically significant way for virtually every condition.

We have developed a Bayesian approach to the analysis of neural electromagnetic (MEG/EEG) data that can incorporate or fuse information from other imaging modalities and addresses the ill-posed inverse problem by sampling the many different solutions which could have produced the given data. From these samples one can draw probabilistic inferences about regions of activation. Our source model assumes a variable number of variable size cortical regions of stimulus-correlated activity. An active region consists of locations on the cortical surface, within a sphere centered on some location in cortex. The number and radii of active regions can vary to defined maximum values. The goal of the analysis is to determine the posterior probability distribution for the set of parameters that govern the number, location, and extent of active regions. Markov Chain Monte Carlo is used to generate a large sample of sets of parameters distributed according to the posterior distribution. This sample is representative of the many different source distributions that could account for given data, and allows identification of probable (i.e. consistent) features across solutions. Examples of the use of this analysis technique with both simulated and empirical MEG data are presented.

Functional cardiac imaging with 3rd generation CT scanners is challenging, because the temporal resolution seems to be limited to approximately 2/3 of the rotation time of the gantry. We propose a new method for high temporal resolution volume heart imaging with multirow detectors based on a retrospective electrocardiogram-gated rebinning procedure. The limited time resolution is overcome using time consistent projection data retrieved from more than one cardiac cycle. In principle the method provides volume heart imaging with adjustable time resolution at arbitrary cardiac phases. It can be applied both for spiral and axial scan imaging. The presented study is based on computer simulations incorporating a model of the human heart taking into account anatomy, motion and heart rate variability. For multirow detectors we were able to show that good image quality can be obtained even during systole with temporal resolution which even exceeds that provided by an Electron Beam Scanner in standard mode of operation. Using an area detector with detector height > 3 cm (center of rotation) the total measurement time is within one breathhold for complete volume imaging of the heart. Furthermore, freezing motion of the coronary arteries during enddiastole allows high quality 3D display of coronary anatomy.

We present a spiral scan cone beam reconstruction algorithm in which image reconstruction proceeds via backprojection in the object space. In principle the algorithm can reconstruct sectional ROI in a long object. The approach is a generalization of the cone beam backprojection technique developed by Kudo and Saito in two aspects: the resource- demanding normalization step in the Kudo and Saito's algorithm is eliminated through the technique of data combination which we published earlier, and the elimination of the restriction that the detector be big enough to capture the entire image of the ROI. Restricting the projection data to the appropriate angular range required by data combination can be accomplished by a masking process. The mask consists of a top curve and a bottom curve formed by projecting the spiral turn above and the turn below from the current source position. Because of the simplification resulting from the elimination of the normalization step, the most time-consuming operations of the algorithm can be approximated by the efficient step of line-by-line ramp filtering the cone beam image in the direction of the scan path, plus a correction term. The correction term is needed because data combination is not properly matched at the mask boundary when ramp filtering is involved. This correction term to the mask boundary effect can be computed exactly. The results of testing the algorithm on simulated phantoms are presented.

The use of computer graphic techniques to produce 3D and reformatted images from a set of axial computed tomography (CT) images has generated significant interest in recent years. The axial CT images are generated with the projection data set weighted, prior to the reconstruction, to combat motion artifacts, data inconsistency, or redundant data samples. In this paper, we investigate the potential bias introduced to the reconstruction as a result of the interaction of the projection weights and the iso-center misalignment (ISM). Although the error is not easily detected in axial CT images, it can be quite visible in 3D or multi-planar reformed images. We first present a theoretical framework to analyze and predict the bias. The theoretical model quantitatively links the amount of object shift in the reconstructed images with the ISM and projection weighting function. The theoretical prediction is validated by both computer simulations and phantom experiments. Based on the analytical model, several schemes to combat this artifact are subsequently presented.

The principles and operations of 4-slice helical CT are discussed. The SSP, image noise and artifacts of a 4-slice scanner are measured by phantom scans and compared with theoretical predictions and the measurements of single-slice CT. The evaluation of these physical attributes for all helical imaging modes of 4-slice scanner is summarized in an operation chart. The preliminary studies indicate that comparing with single-slice helical CT, the volume coverage speed of 4-slice helical CT can be at least twice as fast with fully comparable image quality, or, in many cases, 3 times as fast with diagnostically comparable image quality. Two examples are given to illustrate the clinical benefit of the speed performance improvement (and operation flexibility) provided by 4-slice helical CT.

A hybrid classifier which combines an unsupervised adaptive resonance network (ARTs) and a supervised linear discriminant classifier (LDA) was developed for analysis of mammographic masses. Initially the ART2 network separates the masses into different classes based on the similarity of the input feature vectors. The resulting classes are subsequently divided into two groups: (1) classes containing only malignant masses and (2) classes containing both malignant and benign or only benign masses. All masses belonging to the second group are used to formulate a single LDA model to classify them as malignant and benign. In this approach, the ART2 network identifies the highly suspicious malignant cases and removes them from a training set, thereby facilitating the formulation of the LDA model. In order to examine the utility of this approach, a data set of 348 regions of interest (ROIs) containing biopsy-proven masses (169 benign and 179 malignant) were used. Ten different partitions of training and test groups were randomly generated using 73% of ROIs for training and 27% for testing. Classifier design including feature selection and weight optimization was performed with the training group. The test group was kept independent of the training group. The performance of the hybrid classifier was compared to that of an LDA classifier alone. Receiver Operating Characteristics (ROC) analysis was used to evaluate the accuracy of the classifier. The average area under the ROC curve (A_z) for the hybrid classifier was 0.81 as compared to 0.78 for LDA. The A_z values for the partial areas above a true positive fraction of 0.9 were 0.34 and 0.27 for the hybrid and the LDA classifier, respectively. These results indicate that the hybrid classifier is a promising approach for improving the accuracy of classification in CAD applications.

On mammograms, certain kinds of features related to masses (e.g., location, texture, degree of spiculation, and integrated density difference) tend to be relatively invariant, or at last predictable, with respect to breast compression. Thus, ipsilateral pairs of mammograms may contain information not available from analyzing single views separately. To demonstrate the feasibility of incorporating multi-view features into CAD algorithm, `single-image' CAD was applied to each individual image in a set of 60 ipsilateral studies, after which all possible pairs of suspicious regions, consisting of one from each view, were formed. For these 402 pairs we defined and evaluated `multi-view' features such as: (1) relative position of centers of regions; (2) ratio of lengths of region projections parallel to nipple axis lines; (3) ratio of integrated contrast difference; (4) ratio of the sizes of the suspicious regions; and (5) measure of relative complexity of region boundaries. Each pair was identified as either a `true positive/true positive' (T) pair (i.e., two regions which are projections of the same actual mass), or as a falsely associated pair (F). Distributions for each feature were calculated. A Bayesian network was trained and tested to classify pairs of suspicious regions based exclusively on the multi-view features described above. Distributions for all features were significantly difference for T versus F pairs as indicated by likelihood ratios. Performance of the Bayesian network, which was measured by ROC analysis, indicates a significant ability to distinguish between T pairs and F pairs (A_z equals 0.82 +/- 0.03), using information that is attributed to the multi-view content. This study is the first demonstration that there is a significant amount of spatial information that can be derived from ipsilateral pairs of mammograms.

A Case-Based Reasoning (CBR) system has been developed to predict the outcome of excisional biopsy from mammographic findings. CBR is implemented by comparing the current case to all previous cases and examining the outcomes for those previous cases that match the current case. Patients from breast screening who have suspicious findings on their diagnostic mammogram, are candidates for biopsy. The false positive rate for the decision to biopsy is currently between 66% and 90%. The CBR system is designed to support the decision to biopsy. The mammograms are read by clinicians using a standard reporting lexicon (BI- RADS^TM). These findings are compared to a database of findings from cases with known outcomes (from biopsy). The fraction of similar cases that were malignant is returned. The clinician can then consider this result when making the decision regarding biopsy. The system was evaluated using round-robin sampling scheme and performed with a Receiver Operating Characteristic area of 0.77.

A new CAD mass detection system was developed using adaptive and multi-scale processing methods for improving detection sensitivity/specificity, and its robustness to the variation in mammograms. The major techniques developed in system design include: (1) image standardization by applying a series of preprocessing to remove extrinsic signal, extract breast area, and normalize the image intensity; (2) multi- mode processing by decomposing image features using directional wavelet transform and non-linear multi-scale representation using anisotropic diffusion; (3) adaptive processing in image segmentation using localized adaptive thresholding and adaptive clustering; and (4) combined `hard'-`soft' classification by using a modified fuzzy decision tree and committee decision-making method. Evaluations and comparisons were taken with a training dataset containing 30 normal and 47 abnormal mammograms with totally 70 masses, and an independent testing dataset consisting of 100 normal images, 39 images with 48 minimal cancers and 25 images with 25 benign masses. A high detection performance of sensitivity TP equals 93% with false positive rate FP equals 3.1 per image and a good generalizability with TP equals 80% and FP equals 2.0 per image are obtained.

In computer-aided diagnosis, a frequently-used approach is to first extract several potentially useful features from a data set. Effective features are then selected from this feature space, and a classifier is designed using the selected features. In this study, we investigated the effect of finite sample size on classifier accuracy when classifier design involves feature selection. The feature selection and classifier coefficient estimation stages of classifier design were implemented using stepwise feature selection and Fisher's linear discriminant analysis, respectively. The two classes used in our simulation study were assumed to have multidimensional Gaussian distributions, with a large number of features available for feature selection. We investigated the effect of different covariance matrices and means for the two classes on feature selection performance, and compared two strategies for sample space partitioning for classifier design and testing. Our results indicated that the resubstitution estimate was always optimistically biased, except in cases where too few features were selected by the stepwise procedure. When feature selection was performed using only the design samples, the hold-out estimate was always pessimistically biased. When feature selection was performed using the entire finite sample space, and the data was subsequently partitioned into design and test groups, the hold-out estimates could be pessimistically or optimistically biased, depending on the number of features available for selection, number of available samples, and their statistical distribution. All hold-out estimates exhibited a pessimistic bias when the parameters of the simulation were obtained from texture features extracted from mammograms in a previous study.

In this study it is shown that the performance of a statistical method for detection of microcalcification clusters in digital mammograms, can be improved substantially by using a second step of classification. During this second step, detected clusters are automatically classified into true positive and false positive detected clusters. For classification the k-nearest neighbor method was used in a leave-one-patient-out procedure. The sensitivity level of the method was adjusted both in the first detection step as in the second classification step. The Mahalanobis distance was used as criterion in the sequential forward selection procedure for selection of features. This primary feature selection method was combined with a classification performance criterion for the final feature selection. By applying the initial detection at various levels of sensitivity, various sets of false and true positive detected clusters were created. At each of these sets the classification ca be performed. Results show that the overall best FROC performance after secondary classification is obtained by varying sensitivity levels in both the first and second step. Furthermore, it was shown that performing a new feature selection for each different set of false and true positives is essential. A large database of 245 digitized mammograms with 341 clusters was used for evaluation of the method.

We review components-of-variance models for the uncertainty in estimates of the area under the ROC curve, A_z, for the case of classical discriminants where we wish the uncertainty to generalize to a population of training cases as well as to a population of testing cases. A key observation from our previous work facilitates the use of resampling strategies to analyze a finite data set and classifier in terms of the components-of-variance models. In particular, we demonstrate the use of the statistical bootstrap in combination with a four-term variance model to solve for the contributions of the uncertainty in A_z that result from a given finite training sample, a given finite test sample, and their interaction. At the same time one obtains an expression from which one can predict the change in uncertainty in estimates of A_z that would result from a given change in the number of training samples and change in the number of test samples. This expression provides a quantitative design tool for estimating the size that would be required in a larger pivotal study from the results of a smaller pilot study for the purpose of achieving a desired precision in A_z and the desired generalizability.

We present preliminary results of a study in which Fractal Interpolation Function Models (FIFM) are used to generate a fractal dimension (fd) feature to discriminate between benign and malignant masses on digitized mammograms. The FIFM method identifies boundary segments that are approximately self-affine and can be accurately modeled with multiple fractal interpolation functions (FIF). The fd of a segment is estimated to be the mean of the fds from the FIF models of that segment. An overall fd feature is computed as the mean of multiple segment fds. The statistical approach provides a stability to the overall fd feature. The FIFM feature may be useful in improving the performance of computer-assisted-diagnosis systems.

This paper presents a curvature based approach to characterize the internal intensity structure of pulmonary nodules in thin-section CT images. This approach makes use of shape index, curvedness, and CT value to represent locally each voxel in a 3D pulmonary nodule image. From the distribution of shape index, curvedness, and CT value over the 3D pulmonary nodule image a set of 3D moment features, histogram features, and 3D texture features is computed to classify benign and malignant pulmonary nodules. Linear discriminant analysis is used for classification and a receiver operating characteristic (ROC) analysis is used to evaluate the classification accuracy. The potential usefulness of the curvature based features in the computer- aided differential diagnosis is demonstrated by using ROC curves as the performance measure.

We are developing an automated method for the detection of lung nodules in helical computed tomography (CT) images. This technique incorporates 2D and 3D analyses to exploit the volumetric image data acquired during a CT examination. Gray-level thresholding is used to segment the lungs within the thorax. A rolling ball algorithm is applied to more accurately define the segmented lung regions. The set of segmented CT sections, which represents the complete lung volume, is iteratively thresholded, and a 10-point connectivity scheme is used to identify contiguous 3D structures. Structures with volumes less than a predefined maximum value comprise the set of nodule candidates, which is then subjected to 2- and 3-D feature analysis. To distinguish between candidates representing nodule and non- nodule structures, the values of the features are merged through linear discriminant analysis. When applied to a database of 17 helical thoracic CT cases, gray-level thresholding combined with the volume criterion detected 82% of the lung nodules. Linear discriminant analysis yielded an area under the receiver operating characteristic curve of 0.93 in the task of distinguishing between nodule and non- nodule structures within this set of nodule candidates.

In this article we build on our past attempts to reconstruct a 3D, time-varying bolus of radiotracer from first-pass data obtained by the dynamic SPECT imager, FASTSPECT, built by the University of Arizona. The object imaged is a CardioWest total artificial heart. The bolus is entirely contained in one ventricle and its associated inlet and outlet tubes. The model for the radiotracer distribution at a given time is a closed surface parameterized by 482 vertices that are connected to make 960 triangles, with nonuniform intensity variations of radiotracer allowed inside the surface on a voxel-to-voxel basis. The total curvature of the surface is minimized through the use of a weighted prior in the Bayesian framework, as is the weighted norm of the gradient of the voxellated grid. MAP estimates for the vertices, interior intensity voxels and background count level are produced. The strength of the priors, or hyperparameters, are determined by maximizing the probability of the data given the hyperparameters, called the evidence. The evidence is calculated by first assuming that the posterior is approximately normal in the values of the vertices and voxels, and then by evaluating the integral of the multi- dimensional normal distribution. This integral (which requires evaluating the determinant of a covariance matrix) is computed by applying a recent algorithm from Bai et. al. that calculates the needed determinant efficiently. We demonstrate that the radiotracer is highly inhomogeneous in early time frames, as suspected in earlier reconstruction attempts that assumed a uniform intensity of radiotracer within the closed surface, and that the optimal choice of hyperparameters is substantially different for different time frames.

A major task in diagnostic medicine is to determine whether or not an individual has a normal or abnormal anatomy by examining medical images such as MRI, CT, etc. Unfortunately, there are few quantitative measures that a physician can use to discriminate between normal and abnormal besides a couple of length, width, height, and volume measurements. In fact, there is no definition/picture of what normal anatomical structures--such as the brain-- look like let alone normal anatomical variation. The goal of this work is to synthesize average 3D anatomical shapes using deformable templates. We present a method for empirically estimating the average shape and variation of a set of 3D medical image data sets collected from a homogeneous population of topologically similar anatomies. Results are shown for synthesizing the average brain image volume from a set of six normal adults and synthesizing the average skull/head image volume from a set of five 3 - 4 month old infants with sagittal synostosis.

The accuracy of image-guided neurosurgery generally suffers from brain deformations due to intraoperative changes, e.g., brain shift or tumor resection. In order to improve the accuracy, we developed a biomechanical model of the human head which can be employed for the correction of preoperative images. By now, the model comprises two different materials. The correction of the preoperative image is driven by a set of given landmark correspondences. Our approach has been tested using synthetic images and yields physically plausible results. Additionally, we carried out registration experiments with a preoperative MR image and a corresponding postoperative image simulating an intra-operative image. We found, that our approach yields good prediction results, even in the case when correspondences are given in a small area of the image only.

The problem of matching two images can be posed as the search for a displacement field which assigns each point of one image to a point in the second image in such a way that a likelihood function is maximized ruled by topological constraints. Since the images may be acquired by different scanners, the intensity relationship between intensity levels is generally unknown. The matching problem is usually solved iteratively by optimization methods. The evaluation of each candidate solution is based on an objective function which favors smooth displacements that yield likely intensity matches. This paper is concerned with the construction of a likelihood function that is derived from the information contained in the data and is thus applicable to data acquired from an arbitrary scanner. The basic assumption of the method is that the pair of images to be matched is assumed to contain roughly the same proportion of tissues, which will be reflected in their gray-level histograms. Experiments with MRI images corrupted with strong non-linear intensity shading show the method's effectiveness for modeling intensity artifacts. Image matching can thus be made robust to a wide range of intensity degradations.

In a previous meeting, we described a computational approach to MRI morphometry, in which a spatial warp mapping a reference or atlas image into anatomic alignment with the subject is first inferred. Shape differences with respect to the atlas are then studied by calculating the pointwise Jacobian determinant for the warp, which provides a measure of the change in differential volume about a point in the reference as it transforms to its corresponding position in the subject. In this paper, the method is used to analyze sex differences in the shape and size of the corpus callosum in an ongoing study of a large population of normal controls. The preliminary results of the current analysis support findings in the literature that have observed the splenium to be larger in females than in males.

Left/right craniofacial asymmetry is typically measured by comparing distances between standard anatomical landmarks. However, these measurements are of limited use for visualizing and quantifying the asymmetry at non-landmark locations. This work presents a method for calculating, measuring and visualizing the planar deviation of the midsagittal surface for the purpose of craniofacial dysmorphology assessment, pre-operative corrective surgery planning, and post-operative evaluation. A set of midsagittal landmarks are used to define a reference midsagittal plane and to define a non-planar surface that passes through the landmarks. The surface is modeled as a thin-plate spline that can be visualized in 3D using a virtual reality markup language browser and it can be fused with the original volume rendered CT data using VoxelView^TM.

A novel method that allows the development of surface point based 3D statistical shape models is presented. Fourier decomposition and multiple 2D contours have previously been proposed for the development of statistical shape models of 3D medical objects. Unlike Fourier decomposition the presented method can be applied to shapes of arbitrary topology. Furthermore, the method described here results in a true 3D shape model, independent, for example, from slice orientations of contour images. Given a set of medical objects, a statistical shape model can be obtained by Principal Component Analysis. This technique requires that a set of complex shaped objects is represented as a set of vectors that on the one hand uniquely determine the shapes of the objects and on the other hand are suited for a statistical analysis. The correspondence between the vector components and the respective shape features has to be the same for all shape parameter vectors to be considered. We present a novel approach to the correspondence problem for complex 3D objects. The underlying idea is to develop a template shape and to fit this template to all objects to be analyzed. Although we used surface triangulation to represent the shape the method can easily be adapted to work with other representations. The method is successfully applied to obtain a statistical shape model for the lumbar vertebrae.

If organs are represented by a compact and non-ambiguous mathematical function, many actually interactive diagnostics on tomographic images can be performed automated. Such a representation is constructed from the organ's surface by mapping characteristic topographic structures (landmarks) onto identical function variables. Organs scanned by tomographic images series--periacetabular region of 14 hip joints imaged by X-ray CT--may be segmented. Their surface's contour points are approximated by tensor-product-B-splines (TPBSs). In a reference TPBS surface model landmarks are denoted interactively to define a mapping `variable-pair of the TPBS vs. landmark'. The patient TPBS models are mapped onto the reference model by fitting the model function values. The fit, and so the landmark identification, is performed by a homology function, which is applied to the patient model's variable plane. For simply shaped organs, the transformation of the tomographic to the topographic representation was possible using only the values and first order derivatives of the TPBSs. The presented landmark identification method avoids unnecessary assumptions of model deformation mechanism and has low computational costs.

Detection of tumors in mammograms is limited by the very marked statistical variability of normal structure rather than image noise. This presentation reports investigation of the statistical properties of patient tissue structures in digitized x-ray projection mammograms, using a database of 105 normal pairs of craniocaudal images. The goal is to understand statistical properties of patient structure, and their effects on lesion detection, rather than the statistics of the images per se, so it was necessary to remove effects of the x-ray imaging and film digitizing procedures. Work is based on the log-exposure scale. Several algorithms were developed to estimate the breast image region corresponding to a constant thickness between the mammographic compression plates. Several analysis methods suggest that the tissue within that region, assuming second- order stationarity, is described by a power law spectrum of the form P(f) equals A/f^(beta ), where f is radial spatial frequency and (beta) is about 3. There is no evidence of a flattening of the spectrum at low frequencies. Power law processes can have a variety statistical properties that seem surprising to an intuition gained using mildly random processes such as smoothed Gaussian or Poisson noise. Some of these will be mentioned. Since P(f) is approximately a 3rd order pole at zero frequency, spectral estimation is challenging.

The detection of sources responsible for coherent components in ultrasound signals, has been a difficult task. In this work, we explore the idea of using phase coherence as a measure of the level of structured regularity present in the scattering medium. If the scattering sites are located randomly, then the reflected signal should be incoherent. This is the case of purely diffuse scattering. If, however, there is structure in the scattering medium, then the reflections from those sites will have some non-random phase relationship. In this work, the phase distribution is characterized as follows. For each demodulation frequency, we plot the power as a function of phase. This is computed for all frequencies in the usable bandwidth of the transducer. For each frequency, the power is uniformly distributed across phase from 0 to 2 (pi) for a purely incoherent signal. Systematic deviations from the uniform distribution may indicate the presence of coherent scattering components. This approach was first verified using simulation data, then applied to two sets of clinical ultrasound data. We have achieved good classification performance (area under the ROC curve, A_z equals 0.86 +/- 0.04) using two features extracted from this analysis of phase.

Previously, we have demonstrated the ability of Bayesian image estimation (BIE) to reduce scatter and improve image contrast to noise ratio (CNR) in chest radiography without degradation of resolution. Here, we compare the effectiveness of BIE to a standard 12:1 grid. Images of a geometric phantom with two inches of added polystyrene were obtained both with and without a 12:1, 150 lp/mm grid. Images were acquired with standard protocols: 120 kVp, 72 inch source to image distance, and PA positioning. Images were acquired on a calibrated photostimulable phosphor system. An image exposure was used corresponding to the same patient dose as when acquiring film/screen chest images using a phototimer. The image acquired without the grid was processed by BIE for 6 iterations. Contrast, noise, and CNR were calculated and compared for the image acquired with the grid and the BIE processed image in different regions. BIE processing improved image CNR by 200 to 350% over that provided by the anti-scatter grid for the different regions. BIE provides higher CNR than that of a 12:1 grid. Because of this increase in CNR, Bayesian processed images will show an increase in detectability of low contrast objects, such as subtle lung nodules.

Complex-valued weights are used in the first layer of a feed forward neural network to produce a `transform' neural network. This network was applied to a phase-uncertain sine wave detection task against a Gaussian white noise background. When compared with results of a human observer study on this task by Burgess et al., performance of the transform network was found to be nearly equal to that of an ideal observer and far superior to that of the human observers. Performance was found to be dramatically affected by initial values of the weights, which is explained in terms of concepts from statistical decision theory.

We have developed an automated image-classification method for the examination of urinary sediment. Urine contains many kinds of particles of various colors and sizes. To classify these particles automatically, we developed a hierarchical modular neural network (HMNN) to enable accurate classification of urinary-sediment images. Simulations results showed that a neural network with a modular structure can classify artificially generated patterns more accurately than a single neural network (SNN). By using a HMNN, any kind of particle contained in urine can be automatically classified. We compared the classification accuracy when using the HMNN to that with a SNN and found that the classification accuracy for some classes of particles when using the HMNN was 25% to 30% higher than when using the SNN. With the HMNN, the examination accuracy was sufficient to allow automation of the examination process.

In this study, we investigated the efficacy of an anisotropic diffusion filter in reducing noise and suppressing and/or removing image artifacts with minimal degradation of image resolution in the 3D reconstructed microtomography (micro-CT) images. The preprocessed projection images of the micro-CT scanner were filtered using the anisotropic affine filter. The tomographic images of test phantoms and of real tissue specimens were reconstructed using conebeam filter backprojection technique from the filtered projections, and compared to the images reconstructed from original projection images. The image variance in 3D reconstructed image slices was estimated by computing the spatial variance inside a selected region of interest in the tomographic image of a plexiglass cylinder. The computed tomography (CT) image grayscale profiles of glass microspheres and of rat kidneys in 3D reconstructed image slices were compared to show the effect of the filtering on image resolution. The affine anisotropic filtering reduced the variance in the selected region of the micro-CT image. The comparison of intensity profiles across the glass spheres in the tomographic slices indicated that the filtering did not result in any significant loss of resolution. The filtering either reduced the magnitude of the streak artifacts or removed them completely while suppressing the ring artifacts substantially.

Digital mammography has the potential to provide radiologists with a tool which can detect tumors earlier and with greater accuracy then film based systems. Although a digital mammography system can provide much greater contrast when compared with a conventional film system, the ability to detect small artifacts associated with breast cancer is limited by a reduced spatial resolution due to screen unsharpness and scatter induced fog. In this paper we model the radiological image formation process as the convolution of a linear shift invariant point spread function (PSF) with the projected tissue density source function. We model the PSF as consisting of two components--screen unsharpness and scatter. We present results from a method designed to compensate for screen unsharpness. The screen PSF was measured and subsequently used in an iterative deconvolution algorithm which incorporated wavelet based de-noising between steps in order to reduce noise amplification. When applied to a University of Leeds TORMAX breast phantom the results show as much as a two-fold improvement in resolution at the 50 percent MTF level. Our results show that the regularized deconvolution algorithm significantly improves the signal-to-noise ratio in the restored image.

This paper extends the diffeomorphic landmark matching as described by Joshi in IR² and IR³ to spherical geometries. Spherical maps, which are in one-to-one correspondence with a cortical surface, are useful in visualization since they bring the buried cortex into full view and preserve topology.

A coordinate system is described which provides a natural means for representing hexagonally-organized pixels. The coordinate system has the unusual property that its basis vectors are not orthogonal. Vector-space properties and operations are described in this coordinate system, and shown to be straightforward computations. Some image processing algorithms, including calculations of image gradients and variable-conductance diffusion, are expressed and analyzed.

A new approach to image interpolation is proposed. Different from the conventional scheme, the interpolation of a digital image is achieved with a sub-unity coordinate shift technique. In the approach, the original image is first shifted by sub-unity distances matching the locations where the image values need to be restored. The original and the shifted images are then interspersed together, yielding an interpolated image. High quality sub-unity image shift which is crucial to the approach is accomplished by implementing the shift theorem of Fourier transformation. It is well known that under the Nyquist sampling criterion, the most accurate image interpolation can be achieved with the interpolating function (sinc function). A major drawback is its computation efficiency. The present approach can achieve an interpolation quality as good as that with the sinc function since the sub-unity shift in Fourier domain is equivalent to shifting the sinc function in spatial domain, while the efficiency, thanks to the fast Fourier transform, is very much improved. In comparison to the conventional interpolation techniques such as linear or cubic B-spline interpolation, the interpolation accuracy is significantly enhanced. In order to compensate for the under-sampling effects in the interpolation of 3D medical images owing to a larger inter-slice distance, proper window functions were recommended. The application of the approach to 2- and 3-D CT and MRI images produced satisfactory interpolation results.

We have developed a texture feature extraction method for MRI utilizing the recently developed multiwavelet theory. Texture based features are used in Eigenimage Filtering to enhance analysis results of tumor patient MRI studies. The steps of the proposed method are as follows: (1) Each original image is convolved with a Gaussian filter. This step suppresses the image noise. (2) Each of the resulting images is convolved with eight multiwavelet coefficient matrices. (3) The output of each filter is stored in a separate image (feature plane). This step generates features (images) in which texture information is enhanced. (4) Local energy of each feature is calculated by squaring the feature values. This step converts variance disparities into mean value differences and transforms large values of local pass- band energy into large image gray levels. (5) Eigenimage filter is applied to different sets of MRI images and the results are compared. First, it is applied to the conventional MRI images (T1-weighted, T2-weighted, and proton density weighted). Then, it is applied to the set consisting of these images and the texture feature images generated in the previous step for them. Finally, it is applied to four original images (three conventional and a non-conventional). (6) The eigenimages obtained in the previous step are compared. This step illustrates presence and significance of the texture information present in MRI and role of the proposed method in extracting these features. Applications of the proposed method to MRI studies of brain tumor patients illustrate that the method successfully extracts texture features which are useful in tumor segmentation and characterization.

For the spot detection in 2D electrophoresis images an approach which is based on the combination of the watershed transformation (WST) with a-priori knowledge is presented. To identify spot regions in the over segmented result of the WST two types of regions have to be found: Regions that correspond to a complete spot and regions that cover only a part of a spot. The first localization step, the gray value analysis, is based on the assumptions that spot regions have significantly higher gray values than the background and that they border on a background region. Since not all remaining regions are spot or partial spot regions, additionally a curvature analysis is done. Here the a-priori knowledge is used that regarding a gel image as a surface, the shape of a spot is obviously convex. Consequently, considering the second derivative all required spot and partial spot regions can be obtained by the regions of convex curvature. In a final merging step all partial spot regions covering one spot have to be combined to only one spot region. As merging criterion two spot characteristics are used. A spot should have an approximately elliptical shape and partial spot regions of one spot should have a local convex curvature in a small neighborhood along their boundary.

To assist radiologists and physicians in diagnosing, and in treatment planning and evaluating in liver oncology, we have developed a fast and accurate segmentation of the liver and its lesions within CT-scan exams. The first step of our method is to reduce spatial resolution of CT images. This will have two effects: obtain near isotropic 3D data space and drastically decrease computational time for further processing. On a second step a 3D non-linear `edge- preserving' smoothing filtering is performed throughout the entire exam. On a third step the 3D regions coming out from the second step are homogeneous enough to allow a quite simple segmentation process, based on morphological operations, under supervisor control, ending up with accurate 3D regions of interest (ROI) of the liver and all the hepatic tumors. On a fourth step the ROIs are eventually set back into the original images, features like volume and location are immediately computed and displayed. The segmentation we get is as precise as a manual one but is much faster.

In this paper a new image registration methodology for matching anatomical medical images is presented. It is based on a point-to-point matching methodology that uses the Cauchy- Navier splines transformation to model the deformable anatomical behavior associated with non-rigid body medical image registration. These transformations are illustrated by matching corresponding CT and MR images of the Thorax. By applying Cauchy-Navier splines transformation to landmarks created using segmentation method, an improved performance is achieved. The Cauchy-Navier spline is compared to thin plate spline and multi-quadratic methods.

In this paper, a new local registration method is introduced. The method enables regional refinements to an initial coarse global alignment of two magnetic resonance angiography (MRA) volume datasets through the use of snake-based local elastic deformations on blood vessel curves. The curves are deformed based on corresponding salient features (points of bifurcation and high curvature) that are extracted using a multi-stage method. The extraction involves first tracing blood vessel curves from depth-enhanced maximal intensity projections of the original volume data and then fitting B-splines to the traced structures. The framework for a new approach to volume warping which completes the refinement process for all points in the datasets is also introduced. The local registration method offers the promise registering data collected over time from a patient.

This paper describes a new method for detecting structural brain differences based on the analysis of deformation fields. Deformations are obtained by an intensity-based nonlinear registration routine which transforms one brain onto another one. We present a general multivariate statistical approach to analyze deformation fields in different subjects. This multivariate general linear model provides the implementation of most forms of experimental designs. We apply our method to the brains of 85 schizophrenic patients and 75 healthy volunteers to examine, whether low frequency deformations are sufficiently sensitive to detect regional deviations in the brains of both groups. We demonstrate the application of the multivariate general linear model to a subtractive (modeling group differences) and a parametric design (testing a linear relationship between one variable and the deformation field).

2D/3D registration makes it possible to use pre-operative CT scans for navigation purposes during X-ray fluoroscopy guided interventions. We present a fast voxel-based method for this registration task, which uses a recently introduced similarity measure (pattern intensity). This measure is especially suitable for 2D/3D registration, because it is robust with respect to structures such as a stent visible in the X-ray fluoroscopy image but not in the CT scan. The method uses only a part of the CT scan for the generation of digitally reconstructed radiographs (DRRs) to accelerate their computation. Nevertheless, computation time is crucial for intra-operative application and a further speed-up is required, because numerous DRRs must be computed. For that reason, the suitability of different volume rendering methods for 2D/3D registration has been investigated. A method based on the shear-warp factorization of the viewing transformation turned out to be especially suitable and builds the basis of the registration algorithm. The algorithm has been applied to images of a spine phantom and to clinical images. For comparison, registration results have been calculated using ray-casting. The shear-warp factorization based rendering method accelerates registration by a factor of up to seven compared to ray-casting without degrading registration accuracy. Using a vertebra as feature for registration, computation time is in the range of 3-4s (Sun UltraSparc, 300 MHz) which is acceptable for intra-operative application.

Image registration is a correlation procedure that allows either the complementary study of images obtained from different modalities, or enables the analysis of images obtained by the same modality but at different times. Applied to a variety of clinical and investigational problems, image registration can offer a major advance in diagnostic imaging. In this paper, we present an automated multi-modality registration algorithm based on hierarchical feature extraction. Two kinds of shape representations -- edges and surfaces (skin surface, inner skull surface, and outer brain surface) -- are extracted hierarchically from different image modalities. The registration is then performed using the user- specified (but automatically extracted) corresponding features. Both the robustness of the algorithm and the registration accuracy using different registration features are compared in this paper. The preliminary results show that the use of edge and surface features could succeed over a large range of geometric displacements. The results also indicate that neither the edge nor the surface feature is clearly superior in terms of registration accuracy. Using the edge feature could, however, have the advantage of eliminating the surface segmentation step which requires extra complexity, variability, and time cost. We have shown the proposed 3D registration algorithm provides a simple and fast method for automatic registration of CT and MR image modalities. Preliminary results using our registration algorithm are comparable to those obtained by other techniques.

X-ray digital subtraction angiography (DSA) images frequently suffer from misregistration artifacts. Commercial systems use whole-image manual and semi-automated registration techniques that can be tedious to use. Frequently, patient motion leads to complex artifacts that whole-image registration cannot remove. Available computer technology makes warping registration feasible and timely. We evaluated 6 different warping registration algorithms using 10 subjects. Image quality of subtracted images was evaluated using numerical scoring to specific image quality questions. To aid image quality comparison, images were displayed side-by-side on a single 21-inch monitor. The case mix consisted of 15 DSA images, with significant substraction artifacts, taken from the feet, legs, abdomen, chest and head. In 92% of cases, warping registration dramatically improved subtraction image quality while whole-image translation methods showed little or no improvement. It was also found that the most successful warping method varied from case to case. Based on this study, we propose a combination of warping registration techniques.

We present an automatic, multi-resolution correlation based approach for elastic image registration. The technique presented assumes no a priori information (such as landmarks or segmentation), which makes it suitable for a wide class of image registration tasks. We also present preliminary results of the technique on a variety of images.

Researchers of computer-assisted surgical systems are seeking to reduce the invasiveness of spinal procedures through the use of intra-operative ultrasound (US). Given a favorable registration of vertebral US images to pre-operative CT scans, the individual vertebrae in physical space would be mapped to the patient's corresponding image space. In this work a method is proposed for transcutaneous localization of a lumbar vertebra in US images and a subsequent registration of vertebral surfaces from US and CT. In this study, US scans of a life-size plastic spine phantom were obtained using B-mode transducers of frequencies 3.5 and 4.5 MHz. The spine was immersed in a water tank and images from the L2 vertebra were captured in the transverse plane. A point-to-surface registration that is a modification of the Besl/McKay algorithm was applied to extracted US vertebral surface points and a triangulated surface representation of corresponding CT scans. The results of this registration have been qualitatively assessed, and both data sets visually algin along the entire L2 vertebra. Presently, more than 250,000 lumbo-sacral spinal surgeries are performed annually; consequently, minimizing the intervention in this region could have an extensive positive effect for both the procedure and the patient.

To assist in understanding a relationship between stenotic change in coronary arteries and change in myocardial function, we are developing a method of registration and superimposed display of the coronary arterial tree on a myocardial SPECT (Single Photon Emission Tomography). Firstly we introduce a fully 3-dimensional registration and display method. A 3- dimensionally reconstructed coronary arterial tree data is also transferred to a bull's eye map representation. We also introduce a semi 3-dimensional method. By this method, original 2-dimensional coronary angiograms are directly, i.e. without 3-dimensional reconstruction, transferred to a bull's eye map representation by referring a manually defined left ventricular long axis on angiograms and referring an epicardial surface data obtained from SPECT.

A new method is introduced for the registration of MRI and CT scans of the head, based on the first order geometry of the images. Registration is accomplished by optimal alignment of gradient vector fields between respective MRI and CT images. We show that the summation of the squared inner products of gradient vectors between images is well-behaved, having a strongly peaked maximum when images are exactly registered. This supports our premise that both magnitude and orientation of edge information are important features for image registration. A number of experimental results are presented demonstrating the accuracy of our performance.

This paper addresses a key issue of providing clinicians with visual feedback to validate a computer-generated registration of pre-operative and intra-operative data. With this feedback information, the clinician may decide to proceed with a computer-assisted intervention, revert to a manual intervention, or potentially provide information to the computer system to improve the registration. The paper focuses on total hip replacement (THR) surgery, but similar techniques could be applied to other types of interventions or therapy, including orthopedics, neurosurgery, and radiation therapy. Pre-operative CT data is used to plane the surgery (select an implant type, size and precise position), and is registered to intra-operative X-ray images, allowing to execute the plan: mill a cavity with the implant's shape. (Intra-operative X-ray images must be calibrated with respect to the surgical device executing the plan). One novel technique presented in this paper consists of simulating a post-operative X-ray image of the tissue of interest before doing the procedure, by projecting the registered implant onto an intra-operative X- ray image (corrected for distortion or not), providing clinicians with familiar and easy to interpret images. As an additional benefit, this method provides new means for comparing various strategies for registering pre-operative data to the physical space of the operating room.

An image segmentation algorithm based on region growing with robust estimation, using the mode of the region elements, is presented. With this algorithm it is possible to do brain MRI segmentation with reasonable results and speed, specially in connected regions in which region growing methods are well suited. Head MRI from eight normal volunteers were used to run the segmentation program and the result was validated by an MR neuroradiologist. Border elements can be included doing a small correction, white and gray matter were segmented easily and more complex functional areas can be obtained too.

In this paper a system for 3-D quantitative analysis of human spontaneous intracerebral brain hemorrhage (ICH) is described. The purpose of the developed system is to perform quantitative 3-D measurements of the parameters of ICH region and from computed tomography (CT) images. The measured parameter in this phase of the system development is volume of the hemorrhage region. The goal of the project is to measure parameters for a large number of patients having ICH and to correlate measured parameters to patient morbidity and mortality.

To support ophthalmologists in their daily routine and enable the quantitative assessment of progression of Cytomegalovirus infection as observed on series of retinal angiograms, a methodology allowing an accurate comparison of retinal borders has been developed. In order to evaluate accuracy of borders, ophthalmologists have been asked to repeatedly outline boundaries between infected and noninfected areas. As a matter of fact, accuracy of drawing relies on local features such as contrast, quality of image, background..., all factors which make the boundaries more or less perceptible from one part of an image to another. In order to directly estimate accuracy of retinal border from image analysis, an artificial neural network (a succession of unsupervised and supervised neural networks) has been designed to correlate accuracy of drawing (as calculated form ophthalmologists' hand-outlines) with local features of the underlying image. Our method has been applied to the quantification of CMV retinitis. It is shown that accuracy of border is properly predicted and characterized by a confident envelope that allows, after a registration phase based on fixed landmarks such as vessel forks, to accurately assess the evolution of CMV infection.

In the segmentation process based on a watershed algorithm, a proper seed extraction is very important for segmentation quality because improper seeds can produce undesirable results such as over-segmentation or under-segmentation. Especially, an appropriate seed-extraction algorithm is indispensable in segmenting XCT body images where many organs, except lungs and bones, are in very narrow gray-level ranges with very low contrasts. In the proposed scheme, we divide an image into 4 sub-images by windowing its gray-level histogram, and extract proper seeds from each sub-image by different method according to its characteristic. Then, by using all the seeds obtained from the four separated sub-images, we perform the watershed algorithm to complete the image segmentation. The proposed segmentation method has been successfully applied to X-ray CT body images.

In recent years, deformable models have become popular in the field of medical image analysis. We have applied a member of this family, a discrete dynamic contour model, to the task of mass segmentation in digital mammograms. The method was compared to a recently published region growing method on a dataset of 214 mammograms. Both methods need a starting point. In a first experiment, for each mass the center of gravity of the annotation was used. In a second experiment, a pixel-based initial detection step was used to generate starting points. The latter starting points are often located less proper for good segmentation, requiring the methods to be robust. The performance was measured using an overlap criterion based on the annotation made by an experienced radiologist and the segmented region. The discrete contour model proved to be a robust method to segment masses, and outperformed a probabilistic region growing method. However, just like for the region growing methods, a good choice for the seed point appeared to be of great importance.

We propose a method for the automatic segmentation, recognition and measurement of neuronal fibers in microscopic images of nerves. This permits a quantitative analysis of the distribution of the areas of the fibers, while nowadays such morphometrical methods are limited by the practical impossibility to process large amounts of fibers in histological routine. First, the image is thresholded to provide a coarse classification between myelin (black) and non-myelin (white) pixels. The resulting binary image is simplified using connected morphological operators. These operators simplify the zonal graph, whose vertices are the connected areas of the binary image. An appropriate set of semantic rules allow us to identify a number of white areas as axon candidates, some of which are isolated, some of which are connected. To separate connected fibers -- candidates sharing the same neighboring black area -- we evaluate the thickness of the myelin ring around each candidate area through Euclidean distance transformation by propagation with a stopping criterion on the pixels in the propagation front. Finally, properties of each detected fibers are computed and false alarms are suppressed. The computational cost of the method is evaluated and the robustness of the method is assessed by comparison to the manual procedure. We conclude that the method is fast and accurate for our purpose.

In this paper, we address the NSPS (a Neurological Surgery Planning System developed at the Neurological Surgery Department of Wayne State University) approaches for segmenting and representing lesions in MRI brain images. Initially, the 2D segmentation algorithm requires the input of a seed (an individual pixel or a small region) and a threshold to control the formation of a lesion region. The 3D segmentation algorithm requires the input of a seed, along with the threshold computed automatically from the corresponding three sample thresholds of lesion regions in sagittal, coronal, and axial views, to form a lesion volume. Then, a novel method is developed to represent the segmented lesion regions with feature point histograms, obtained by discretizing and counting the angles produced from the resulting Delaunay triangulation of a set of feature points which characterize the shape of the lesion region. The proposed shape representation technique is translation, scale, and rotation independent. Through various experiment results, we demonstrate the efficacy of the NSPS methodologies. Finally, based on the lesion representation scheme, we present a prototype system architecture for neurological surgery training. The implemented system will work in a Web-based environment, allowing neurosurgeons to query and browse various patients-related medical records in an effective and efficient way.

This article investigates the effects of resolution on the automated segmentation and classification of mammographic masses. A set of 39 mammographic images containing 40 masses are digitized at two resolutions: 220 micrometer and 8 bits per pixel and 180 micrometer and 16 bits per pixel. An expert mammographer classified the shape of all 40 masses as round, lobular, or irregular, and manually segmented the masses from the lower resolution images. The masses in both sets are automatically segmented with a Markov Random Field-based method. Two groups of shape features are extracted from the segmented masses in each set of images: (1) compactness, radial distance mean, standard deviation, entropy, zero- crossing count, and roughness index, and (2) wavelet-based scalar-energy features. Linear discriminant analysis and a minimum Euclidean distance classifier are used to automatically separate the mass shapes into the three classes determined by the expert. The effects of the resolution and method of segmentation on the classification process are analyzed for both groups of shape features.

We use three features, the intensity, texture and motion to obtain robust results for segmentation of intracoronary ultrasound images. Using a parameterized equation to describe the lumen-plaque and media-adventitia boundaries, we formulate the segmentation as a parameter estimation through a cost functional based on the posterior probability, which can handle the incompleteness of the features in ultrasound images by employing outlier detection.

Accurate segmentation is a key issue in medical image analysis. Segmentation aids the tasks of object representation and structure quantification. Currently, many methods are introduced in 3D slice medical image segmentation. Conventionally, each slice image was segmented in 2D space and reconstructed in 3D space for 3D analysis, so it required more time and effort. Thus, this paper presents a modified geometric active contour model in 3D domain for reducing user's efforts, shortening the processing time and detecting an exact edge of object. This method uses a new speed function based on the level set approach developed by Sethian and the fast marching method for its fast implementation. The main idea of the level set methodology is to embed the propagating interface as the particular level set of a higher dimensional function (hypersurface) flowing along gradient force and curvature force. This technique retains the attractive feature which is its topological and geometric flexibility of the contour in recovering objects with complex shapes and unknown topologies. And the other feature is that this method is easily applied to the 3D domain easily. The fast marching method is a fast algorithm using the fact that the interface in the level set method is flowing in one direction. We apply the proposed model to various 2D, 3D images such as synthetic image, CT and MR Angiogram. From the results, the presented model confirms that it works very naturally and efficiently with the desired features of 2D and 3D medical images.

This paper shows a novel medical image segmentation method applied to blood vessel segmentation from magnetic resonance angiography volume data. The principle idea of the method is fuzzy information granulation concept. The method consists of 2 parts: (1) quantization and feature extraction, (2) iterative fuzzy synthesis. In the first part, volume quantization is performed with watershed segmentation technique. Each quantum is represented by three features, vascularity, narrowness and histogram consistency. Using these features, we estimate the fuzzy degrees of each quantum for knowledge models about MRA volume data. In the second part, the method increases the fuzzy degrees by selectively synthesizing neighboring quantums. As a result, we obtain some synthesized quantums. We regard them as fuzzy granules and classify them into blood vessel or fat by evaluating the fuzzy degrees. In the experimental result, three dimensional images are generated using target maximum intensity projection (MIP) and surface shaded display. The comparison with conventional MIP images shows that the unclarity region in conventional images are clearly depict in our images. The qualitative evaluation done by a physician shows that our method can extract blood vessel region and that the results are useful to diagnose the cerebral diseases.

The combination of the watershed transformation on graphs with a tissue classification is presented. The watershed transformation on graphs results in hierarchical segmentation volumes that differ in region number and size. If an anatomical object corresponds to a region in a segmentation volume it has to be selected, since the region would be merged with the most similar neighbor region in the following volume. Such an object selection can be done using object descriptions. A possible approach is presented in this paper.

We present a hierarchical multi-object surface-based deformable atlas for the automatic localization and identification of brain structures in MR images. The atlas is a multi-object mesh of 3D fully connected surfaces built upon a face centered cubic grid. The registration of the atlas to a patient's MR image is done in two steps: a global registration followed by a multi-object active surface deformation. First, the cortical surface and the ventricular system are segmented using directional watersheds. The global registration is a second degree transformation whose coefficients minimize a distance measure between these surfaces and the equivalent surfaces in the atlas. As a refinement step, the globally registered atlas surfaces are locally deformed using multi-object active surfaces. The external force driving the surfaces towards the edges in the image is a decreasing function of the gradient, and includes prior image information. The active surface equations are then solved using the finite element method. The surfaces of the multi-object mesh are deformed in a hierarchical way, starting with objects exhibiting very well defined features in the image to objects showing less obvious features. Experiments involving several sub-cortical atlas objects are presented.

Image segmentation is considered one of the essential steps in medical image analysis. Cases such as classification of tissue structures for quantitative analysis, reconstruction of anatomical volumes for visualization, and registration of multi-modality images for complementary study often require the segmentation of the brain to accomplish the task. In many clinical applications, parts of this task are performed either manually or interactively. Not only is this proces often tedious and time-consuming, it introduces additional external factors of inter- and intra-rater variability. In this paper, we present a 3D automated algorithm for segmenting the brain from various MR images. This algorithm consists of a sequence of pre-determined steps: First, an intensity window for initial separation of the brain volume from the background and non-brain structures is selected by using probability curves fitting on the intensity histogram. Next, a 3D isotropic volume is interpolated and an optimal threshold value is determined to construct a binary brain mask. The morphological and connectivity processes are then applied on this 3D mask for eliminating the non-brain structures. Finally, a surface extraction kernel is applied to extract the 3D brain surface. Preliminary results from the same subjects with different pulse sequences are compared with the manual segmentation. The automatically segmented brain volumes are compared with the manual results using the correlation coefficient and percentage overlay. Then the automatically detected surfaces are measured with the manual contouring in terms of RMS distance. The introduced automatic segmentation algorithm is effective on different sequences of MR data sets without any parameter tuning. It requires no user interaction so variability introduced by manual tracing or interactive thresholding can be eliminated. Currently, the introduced segmentation algorithm is applied in the automated inter- and intra-modality image registration. It will furthermore be used in different applications such as quantitative analysis of normal and abnormal brain tissues.

A three-dimensional active surface model has been suggested as a possible solution to the difficult problem of segmenting lymph nodes in CT x-rays. In this paper, a computationally simple active surface, or balloon, is proposed which requires minimal user interaction or a priori shape knowledge. A structure is proposed for the balloon model in which each balloon point is guaranteed a fixed number of neighbors, and a method is provided for adding points to the model while still maintaining that structural regularity. Equations are provided for deriving surface energy from 3D shape and 3D image data. Minimal user interaction is required, with only a single point somewhere inside the node needed to initialize the algorithm. The balloon naturally inflates to find the correct surface due to a unique candidate point selection algorithm that is biased in favor of outward moves. Preliminary results show the model to be successful in finding boundaries in synthetic 3-D images.

Nodule growth is a key characteristic of malignancy. The measurement of nodule diameter on chest radiographs has been unsatisfactory due to insufficient accuracy and reproducibility. Additionally, the frequent use of high resolution CT scanners has increased the detection rate of very small nodules. On one hand, the small nodules present even greater diagnostic difficulties and, on the other hand, are more frequently benign, resulting in higher rates of unnecessary surgery. In this paper we present a 3-D algorithm to improve the consistency of nodule segmentation on multiple scans. The multi-criterion, multi-scan segmentation algorithm has been developed based on the fact that a typical small pulmonary nodule has distinct difference in density at the boundary and relatively compact shape, and that other tissues in the lung do not change in size over time. Our preliminary results with in-vivo nodules have shown the potential of applying this practical 3-D segmentation algorithm to clinical settings.

Acute pyelonephritis is a serious disease in children that may result in irreversible renal scarring. The ability to localize the site of urinary tract infection and the extent of acute pyelonephritis has considerable clinical importance. In this paper, we are devoted to segment the acute pyelonephritis area from kidney SPECT images. A two-step algorithm is proposed. First, the original images are translated into binary versions by automatic thresholding. Then the acute pyelonephritis areas are located by finding convex deficiencies in the obtained binary images. This work gives important diagnosis information for physicians and improves the quality of medical care for children acute pyelonephritis disease.

In this paper we describe an evaluation technique that quantifies both the accuracy and variability in semiautomatic segmentation algorithms. The particular interest of the study is the evaluation of an active contour method for 2-D carotid artery lumen segmentation in ultrasound images. The active contour method used is known as the Geometrically Deformed Model (GDM). This segmentation method to be evaluated requires a single seed to be placed in the target region by the operator. The evaluation approach is based on the contour probability distribution (CPD), which is obtained by generating contours of the object using a set of possible seed locations. A contour matching procedure provides local displacement measures between any two contours, which in turn allow the calculation of the local CPD of a group of contours. The mean contour can be compared to an operator defined contour to provide accuracy measurements, and the variance can provide measures of local and global variability. The evaluation results from multiple images can be pooled to generate statistics for a more complete evaluation of a semi- automatic segmentation method.

As part of an R&D project in mixed text/image database design, the National Library of Medicine has archived a collection of 17,000 digitized x-ray images of the cervical and lumbar spine which were collected as part of the second National Health and Nutrition Examination Survey (NHANES II). To make this image data available and usable to a wide audience, we are investigating techniques for indexing the image content by automated or semi-automated means. Indexing of the images by features of interest to researchers in spine disease and structure requires effective segmentation of the vertebral anatomy. This paper describes work in progress toward this segmentation of the cervical spine images into anatomical components of interest, including anatomical landmarks for vertebral location, and segmentation and identification of individual vertebrae. Our work includes developing a reliable method for automatically fixing an anatomy-based coordinate system in the images, and work to adaptively threshold the images, using methods previously applied by researchers in cardioangiography. We describe the motivation for our work and present our current results in both areas.

The purpose of this paper is to develop a method for prostate gland segmentation in MR image by combining the two scan planes and Fourier descriptor technique. Because not all of the prostate gland in MR image slices have clear boundary that between a prostate gland and its surrounding soft tissues. In this study, the paper improves the problems by using the two scan planes method. And, reconstructing the prostate gland by the image deformable model that integrates the Fourier descriptor method and energy continuity concept. The two scan planes method uses two MR prostate image sets; one is axial and the other is coronal. The coronal image set is for supplementing the base and the apex regions of the prostate gland in the axial image set. By this method, the prostate gland segmentation in MR images will be obtained more correctly. Then the known boundary images of the axial and coronal images can be reconstructed to 3-D image by the Fourier descriptor technique. The technique of this study integrates the spatial coordinate, energy continuity concept and Fourier descriptor to describe the objects for time sequence or spatial related images. Therefore, the model of this work can estimates the interpolation or exterpolational images that from the known images and reconstructs them to three-dimensional object efficiently and accurately.

This paper outlines the exploration of two methods to detect texture in a digital cryosection image from the Visible Human Project. For the purpose of this research, texture is defined as a regular or irregular placement of color in an image. A higher-level decision-making algorithm was employed to extract different body tissues: fat, muscle, and bone. This algorithm was designed on the premise that each body tissue has a different visible texture. Another method utilized an artificial intelligence approach, a neural net, to extract textured tissues. Each problem demands a unique neural net; hence, this neural net is customized in terms of the image dataset and the goal of texture detection.

Interactive tools for segmenting 2-D and 3-D images are presented. These tools allow a user to quickly revise a segmentation result obtained from an automatic method. A thresholding technique is described that finds a unique threshold value for each homogeneous region in an image. The threshold value is found such that variance in the region is minimized under change in the threshold value. Curve- and surface-fitting methods are described that can accurately represent a region boundary in 2-D or 3-D with a parametric curve or a surface, respectively. A curve or a surface is optimized to minimize the number of control points representing a region with a prescribed accuracy. The optimized curve or surface is then revised by moving its control points interactively. Once a curve or a surface is found to accurately enclose a region of interest, it is quantized to produce the final 2-D region contour or 3-D region surface. These interactive tools can be used to revise unsatisfactory results obtained from any automatic segmentation method.

We propose an abstract concept of data fusion based on finite automata and fuzzy sets to integrate and evaluate different sources of information, in particular results of multiple image segmentation procedures. We give an example of how the method may be applied to the problem of mammographic image segmentation to combine results of region growing and closed- contour detection techniques. We further propose a measure of fuzziness to assess the agreement between a segmented region and a reference contour. Results of application to breast tumor detection in mammograms indicate that the fusion results agree with reference contours provided by a radiologist to a higher extent than the results of the individual methods.

An iterative algorithm has been developed for automatic detection of breast masses from digitalized mammograms. The procedure has been divided in two stages. The first one based on the histogram analysis of the input image. The second one employs a topological analysis from the results obtained in the first stage. The final output is a set of interest regions that are defined as suspicious areas by the system. These suspicious regions should be harder studied in order to present a final diagnosis. The developed system may be used together with any other suspicious area diagnosis algorithms. In this way a computer assisted diagnosis (CAD) program to assist radiologists in his mammography interpretation task could be easy developed.

This paper presents an approach for fusion of the two major cardiovascular imaging modalities, angiography and intravascular ultrasound (IVUS). While the path of the IVUS catheter, which follows the vessel curvature during pullback, is reconstructed from biplane angiograms, cross-sectional information about the vessel is derived from IVUS. However, after mapping of the IVUS frames into their correct 3-D locations along the catheter path, their orientations remain ambiguous. We determine the relative catheter twisting analytically, followed by a statistical method for finding the absolute orientation from the out-of-center position of the IVUS catheter. Our results as obtained from studies with cadaveric pig hearts and from three patients undergoing routine coronary intervention showed a good match of the absolute orientation by the algorithm. In all tested cases, the method determined the visually correct orientations of the IVUS frames. Local distortions were reliably identified and discarded.

Dense breasts, that usually are characteristic of women less than 40 years old, difficult many times early detection of breast cancer. In this work we present the application of some image processing techniques intended to enhance the contrast in dense breast images, regarding the detection of clustered microcalcifications. The procedure was, firstly, determining in the literature the main techniques used for mammographic images contrast enhancement. The results indicate that, in general: (1) as expected, the overall performance of the CAD scheme for clusters detection decreased when applied exclusively to dense breast images, compared to the application to a set of images without this characteristic; (2) most of the techniques for contrast enhancement used successfully in generic mammography images databases are not able to enhance structures of athirst in databases formed only by dense breasts images, due to the very poor contrast between microcalcifications, for example, and other tissues. These features should stress, therefore, the need of developing a methodology specifically for this type of images in order to provide better conditions to the detection of breast suspicious structures in these group of women.

Purpose: The prognosis of melanoma, an invasive and malignant skin tumor, strongly relies on early detection. Unfortunately differentiating early melanomas from other less dangerous pigmented lesions is a difficult task even for trained observers since they may have near physical characteristics. Dermatoscopy, a new non-invasive technique which makes subsurface structures of skin accessible to in vivo examination provides standardized images of black tumors that seem convenient for numerical analysis. The objective of this project is to develop a computer-based diagnostic system which takes advantage of dermatoscopic images to characterize black tumors and help to detect melanoma. Methods: Dermatologists ground their diagnosis on the observation of some characteristic features in images of black tumors. Similarly, our approach consists in classifying parts of images of skin tumors (called windows thereafter) by a two-stage procedure. First, a contextual coding of widows is achieved by GHA network (Generalized Hebbian Algorithm). The second stage involves a classical feedforward network (a multilayer perceptron) which performs a classification of coded windows. Both stages rely on learning to achieve their task. The GHA network operates a Principal Component-like analysis of windows. During that phase, sets of primitive images fitted to various contexts are constituted, each set being appropriate for the description of some aspects of the windows (contrast, texture, border, color, ...). Windows can subsequently be coded by projection on these bases. Finally, a supervised learning is carried out to build up the classifier, using parts of characterized images with respect to the features under consideration. Results: Most of the interesting features detectable in black tumors can be observed in 16*16 pixel windows, providing resolution is properly chosen. The analysis of such windows by our system shows that classification is properly achieved when 20 primitive windows at least are considered for windows coding. Preliminary results dealing with the detection of several features of lesions have been found encouraging. Conclusion: The use of model-free approach, directly applied on image and based on learning by sample has been found efficient. Adapting this approach to the detection of melanoma appears a promising way.

The aim of the study was to investigate effective image analysis methods for the discrimination of two oral lesions, oral lichenoid reactions and oral leukoplakia, using only color information. Five different color representations (RGB, Irg, HSI, I₁I₂I₃ and La*b*) were studied and their use for color analysis of mucosal images evaluated. Four common classifiers (Fisher's linear discriminant, Gaussian quadratic, kNN-Nearest Neighbor and Multilayer Perceptron) were chosen for the evaluation of classification performance. The feature vector consisted of the mean color difference between abnormal and normal regions extracted from digital color images. Classification accuracy was estimated using resubstitution and 5-fold crossvalidation methods. The best classification results were achieved in HSI color system and using linear discriminant function. In total, 70 out of 74 (94.6%) lichenoid reactions and 14 out of 20 (70.0%) of leukoplakia were correctly classified using only color information.

Analysis of biomedical images is an important step in quantification of various diseases such as human spontaneous intracerebral brain hemorrhage (ICH). In particular, the study of outcome in patients having ICH requires measurements of various ICH parameters such as hemorrhage volume and their change over time. A multiresolution probabilistic approach for segmentation of CT head images is presented in this work. This method views the segmentation problem as a pixel labeling problem. In this application the labels are: background, skull, brain tissue, and ICH. The proposed method is based on the Maximum A-Posteriori (MAP) estimation of the unknown pixel labels. The MAP method maximizes the a-posterior probability of segmented image given the observed (input) image. Markov random field (MRF) model has been used for the posterior distribution. The MAP estimation of the segmented image has been determined using the simulated annealing (SA) algorithm. The SA algorithm is used to minimize the energy function associated with MRF posterior distribution function. A multiresolution SA (MSA) has been developed to speed up the annealing process. MSA is presented in detail in this work. A knowledge-based classification based on the brightness, size, shape and relative position toward other regions is performed at the end of the procedure. The regions are identified as background, skull, brain, ICH and calcifications.

Computed Tomography (CT) images have become an essential element in the derivation of a clinical radiation oncology treatment plan. The intent of this study was to assess how wavelet compression influences calculated dose distribution in radiotherapy treatment planning due to changes in pixel values in the CT. Chest CT images for radiotherapy were put into a 2D wavelet compression engine and compressed to a ratio of 30:1. A radiotherapy treatment plan was constructed to generate a dose distribution within the CT image. Images subjected to compression were analyzed using Dose Volume Histograms (DVHs) and compared to the DVHs generated for the uncompressed chest CT. The lossy wavelet compression operation irreversibly changes pixel values in the CT. These changes in the CT can give rise to errors in the dose calculations performed by treatment planning systems that account for tissue inhomogeneities in the image. The DVHs for 30:1 compression using this wavelet engine were highly similar to the DVHs obtained using the uncompressed image. A paired comparison test was used to compare the DVH data. Image compression of CT for radiation therapy treatment planning results in changes in the dose distribution within the patient.

A new mathematical technique for information fusion based on random sets, developed and described by Goodman, Mahler and Nguyen (The Mathematics of Data Fusion, Kluwer, 1997) can be useful for estimation of functional brian images. Many image estimation algorithms employ prior models that incorporate general knowledge about sizes, shapes and locations of brain regions. Recently, algorithms have been proposed using specific prior knowledge obtained from other imaging modalities (for example, Bowsher, et al., IEEE Trans. Medical Imaging, 1996). However, there is more relevant information than is presently used. A technique that permits use of additional prior information about activity levels would improve the quality of prior models, and hence, of the resulting image estimate. The use of random sets provides this capability because it allows seemingly non-statistical (or ambiguous) information such as that contained in inference rules to be represented and combined with observations in a single statistical model, corresponding to a global joint density. This paper illustrates the use of this approach by constructing an example global joint density function for brain functional activity from measurements of functional activity, anatomical information, clinical observations and inference rules. The estimation procedure is tested on a data phantom with Poisson noise.

This paper presents an automatic computer system for analyzing the structural shape of cutaneous melanocytic lesion borders. The computer system consists of two steps: pre-preprocessing the skin lesion images and lesion border shape analysis. In the preprocessing step, the lesion border is extracted from the skin images after the dark thick hairs are removed by a program called DullRazor. The second step analyzes the structural shape of the lesion border using a new measure called sigma-ratio. The new measure is derived from scale- space filtering technique with an extended scale-space image. When comparing the new measure with other common shape descriptors, such as compactness index and fractal dimensional, sigma-ratio is more sensitive to the structural protrusions and indentations. In addition, the extended scale- space image can be used to pinpoint the locations of the structural indentations and protrusions, the potential problem areas of the lesion.

Nuclear medicine imaging is a widely used commercial imaging modality which relies on photon detection as the basis of image formation. As a diagnosis tool, it is unique in that it documents organ function and structure. It is a way to gather information that may be otherwise unavailable or require surgery. Practical limitations on imaging time and the amount of activity that can be administered safely to patients are serious impediments to substantial further improvements in nuclear medicine imaging. Hence, improvements of image quality via optimized image processing represent a significant opportunity to advance the state-of-the-art int his field. We present in this paper a new multiscale image restoration method that is concerned with eliminating one of the major sources of error in nuclear medicine imaging, namely Poisson noise, which degrades images in both quantitative and qualitative senses and hinders image analysis and interpretation. The paper then quantitatively evaluates the performances of the proposed method.

This pilot study investigates the effect of discrete wavelet compression on automated mammographic mass shape classification. Commonly used shape features are extracted from masses for uncompressed and compressed images. These features include radial distance mean, standard deviation, entropy, zero-crossing count, roughness index, area-ratio, and compactness. The effects of the compression on these features are analyzed. Next, linear discriminant analysis is used to appropriately weight the features, and a minimum Euclidean distance classifier is used to separate the mass shapes into three classes: round, nodular, and stellate. The classification results are compared between the uncompressed and compressed images.

In this paper, a straightforward method of estimating the CT projections is applied to simplified pre-processing, simplified reconstruction filtering, and to low-dose and local CT image reconstruction. The method relies on the projection- to-projection data redundancy that is shown to exist in CT. In the pre-processing application, the output of a few, angularly sparse fully pre-processed projections, is utilized in a linearization model to estimate directly the output of pre- processing for all the other projections. In the reconstruction filtering application, and with projection i and k being fully filtered, intermediate projection j low frequency components are estimated by a linear combination of projections i and k. That estimate is then subtracted from projection j, and the resulting high-frequency components are then filtered without zeropadding. By linearity the same combination of fully filtered projections i and k is added back to projection j. A factor two simplification is obtained, that can be leveraged for reconstruction speed or cost reduction. The local reconstruction application builds on the filtering method, by showing that truncated data is sufficient for calculating a filtered projection high-frequencies, while a very simple projection completion model is shown to be effective in estimating the low frequencies. Image quality comparisons are described.

This paper presents a computer-based classification scheme for masses in mammograms. The developed scheme is based on an introduced measure of surface fluctuation that captures texture roughness associated with the surface of an abnormality mass area. First local maxima/minima along rows and columns of a marked abnormality area in a mammogram are located. Morphological erosion is then applied to these maxima/minima to obtain the degree of surface roughness or coarseness within this area. The erosion is done for many sizes of a structuring element. This process is similar to the texture 'feeling' one gets by moving a finger horizontally and vertically on a surface. The developed scheme was tested on 108 mammograms with pathologically proven results; 55 benign and 53 malignant masses. All mammograms were digitized at 50- micron resolution. The Receiver Operating Characteristic (ROC) curves for different sizes of a structuring element were plotted. The average area underneath these curves was obtained to be 0.92. The corresponding clinical evaluation by the radiologist gave an area of 0.86. The results obtained indicate the potential of using this classification scheme as an electronic second opinion to lower the number of unnecessary biopsies.

We present an evaluation technique of two dimensional (2D) nuclear magnetic resonance (NMR) chemical shift images (CSI) to analyze spatial differences of metabolite distributions and/or concentrations between groups of probands. Thus, chemical shift imaging is not only used as localization technique for NMR-spectroscopy, but the information of the complete spectroscopic image is used for the evaluation process. ³¹P CSI of the human brain were acquired with a Philips Gyroscan ACSII whole-body scanner at 1.5 T. CSI for different phosphorus metabolites were generated, all representing the same anatomical location. For each metabolite the CSI of two groups of subjects were compared with each other using the general linear model implemented in the widely distributed SPM96 software package. With this approach, even covariates or confounding variables like age or medication can be considered. As an example for the application of this technique, variations in the distribution of the ³¹P metabolite phosphocreatin between unmedicated schizophrenic patients and healthy controls were visualized. To our knowledge, this is the first approach to analyze spatial variations in metabolite concentrations between groups of subjects on the basis of chemical shift images. The presented technique opens a new perspective in the evaluation of 2D NMR spectroscopic data.

We present a robust method for automatically constructing an ellipsoidal skeleton (e-skeleton) from a set of 3D points taken from NMR or TDM images. To ensure steadiness and accuracy, all points of the objects are taken into account, including the inner ones, which is different from the existing techniques. This skeleton will be essentially useful for object characterization, for comparisons between various measurements and as a basis for deformable models. It also provides good initial guess for surface reconstruction algorithms. On output of the entire process, we obtain an analytical description of the chosen entity, semantically zoomable (local features only or reconstructed surfaces), with any level of detail (LOD) by discretization step control in voxel or polygon format. This capability allows us to handle objects at interactive frame rates once the e-skeleton is computed. Each e-skeleton is stored as a multiscale CSG implicit tree.

The purpose of the study was to develop a computer tool that can distinguish between atretic (non-ovulatory) and viable (ovulatory) bovine ovarian follicles on the basis of ultrasonographic image texture. Ovarian follicles of heifers (n equals 14) were removed at four physiologically important time points during the estrous cycle. Regions of interest (ROI) in the center of the follicular antrum of the largest follicle in in vitro images were selected manually. The follicles were classified as viable or atretic on the basis of texture quantified with two metrics: standard deviation (D) and energy (E) of gray-scale values in the wavelet transformed ROI images. The sensitivities S and specificities S_p varied between S equals 0.30 and S_p equals 1.00 and S equals 0.93, S_p equals 0.67 when a minimum distance classifier was used. The computer algorithm was able to distinguish between atretic and viable ovarian follicles based ultrasonographic textures of follicular fluid that were not discernible to the human eye. The ROC analysis demonstrated that the texture classification of follicular fluid may be developed into a clinically useful diagnostic tool. It is anticipated that the computer tool will allow diagnostic assessment of reproductive competence of ovarian follicles in women.

The Scaling-Index-Method (SIM) has been extended by applying weighting functions which take into account the information available on the noise characteristics. The transformation of an image by applying the weighted Scaling-Index-Method yields a measure which depends on the local correlation of the image pixels and the noise structure in the image. In nuclear medicine imaging, the methods based on the SIM enables to extract sources superimposed by strong noise or to discriminate real sources from tomographic artifacts.

This paper describes a method for the fully automatic and reliable segmentation of the bones in a radiograph of the child's hand. The problem consists in identifying the contours of the bones and the difficulty lies in the large variability of the anatomical structures, according to age, hand pose or individual. The model shall not force any standard interpretation, hence we use a simple hierarchical geometric model that provides the only information required for the identification of the chunks of contours. The phalangeal and metacarpal resulting segmentation is proved robust over a set of many hundred of images and measurements of shapes, sizes, areas, ..., are now quite allowed. The next step consists in extending the model for more accurate measurements and also for the localization of the carpal bones.

An adaptive median filter algorithm to remove impulse noise in x-ray images and speckle in ultrasound images is presented. The ordinary median filter tends to distort or lose fine details in an image. Also, a significant amount of the original information in the image is altered. The proposed algorithm considers the local variability over the entire image to ensure that the fine details are preserved and more than 90 percent of the original information is retained. The robustness of the algorithm is demonstrated by applying it to images from different modalities like diagnostic x-ray, CT, portal imaging and ultrasound.

In this paper we describe the design and implementation of a new approach for voxel clustering. Clustering helps to group voxels with similar properties to enable manipulation of voxels as a single cluster. This new algorithm performs a clustering based on a marching slice segmentation algorithm. We propose to use this clustering for volume deformation, volume analysis and volume morphing. The algorithm has been implemented and tested using the visible human dataset.

A progressive reconstruction technique is presented in magnetic resonance (MR) imaging. To do so, matching pursuit algorithm is applied to MR Imaging. For MR imaging, Fourier basis set is used as a dictionary of MP algorithm. In the progressive reconstruction algorithm proposed in this paper, the inner products of object signal and basis functions are utilized instead of those of residual signals and basis functions for original matching pursuit algorithm. By reconstructing the object hierarchically, one can achieve a quick recognition of image during data acquisition, i.e., at each phase encoding step, the image is reconstructed and updated progressively while, in conventional, image reconstruction is performed after all phase encoding steps. To verify the proposed technique, computer simulations and experiments with whole body MRI system are performed.

An accurate and reliable detection of temporal changes from a pair of images has considerable interest in the medical science. Traditional registration and subtraction techniques can be applied to extract temporal differences when,the object is rigid or corresponding points are obvious. However, in radiological imaging, loss of the depth information, the elasticity of object, the absence of clearly defined landmarks and three-dimensional positioning differences constraint the performance of conventional registration techniques. In this paper, we propose a new method in order to detect interval changes accurately without using an image registration technique. The method is based on construction of so-called pattern histogram and comparison procedure. The pattern histogram is a graphic representation of the frequency counts of all allowable patterns in the multi-dimensional pattern vector space. K-means algorithm is employed to partition pattern vector space successively. Any differences in the pattern histograms imply that different patterns are involved in the scenes. In our experiment, a pair of chest radiographs of pneumoconiosis is employed and the changing histogram bins are visualized on both of the images. We found that the method can be used as an alternative way of temporal change detection, particularly when the precise image registration is not available.

To diagnosis the lung cancer as to determine if it has malignant or benign nature, it is important to understand the spatial relationship among the abnormal nodule and other pulmonary organs. But the lung field has very complicated structure, so it is difficult to understand the connectivity of the pulmonary organs using Thin-section CT images. This method consists of two parts. The first is the classification of the pulmonary structure based on the anatomical information. The second is the quantitative analysis that is then applicable to differential diagnosis, such as differentiation of malignant or benign abnormal tissue.

Lung cancer is known as one of the most difficult cancers to cure. The detection of lung cancer in its early stage can be helpful for medical treatment to limit the danger. A conventional technique that assists the detection uses helical CT, which provides information of 3D cross sectional images of the lung. We expect that the proposed technique will increase diagnostic confidence. However, mass screening based on helical CT images leads to a considerable number of images for the diagnosis, this time-consuming fact makes it difficult to be used in the clinic. To increase the efficiency of the mass screening process, we had proposed a computer-aided diagnosis (CAD). In this paper, we describe lung cancer detection based on helical CT Images using curved surface morphology analysis. Firstly, we extract the lung area from the original image. Secondly, we compute shape index value of the lung area. Thirdly, we extract the ROI (Region Of Interest) from the computed shape index value. Finally, we apply the diagnosis rule using neural network and detect the suspicious regions. We show here the result of our algorithm which is applied to helical CT images of 390 patients.

In this paper, we describe a computer assisted diagnosis algorithm of coronary calcifications based on helical X-ray CT images which are used at the mass screening process for lung cancer diagnosis. Our diagnostic algorithm consists of four processes: Firstly, we choose the heart slices from the CT images which was taken from the mass screening, we classify the heart slices to three section. Second, we extract the heart region on each slice by the shape of the lung area and the body of vertebra. Third, the candidate regions of the coronary calcifications are detected by the difference calculus and thresholding process. Finally, to increase the effectiveness of the diagnostic processing, we cancel the artifacts included in the candidate regions by the diagnostic rules defined by us. We show here the result of our algorithm which is applied to helical CT images of 462 patients analyzed for lung cancer screening.

In this paper, we present a computer-aided diagnosis (CAD) system for lung cancer to detect nodule candidates at an early stage from the present and the early helical CT screening of the thorax. We developed an algorithm that can compare automatically the slice images of present and early CT scans for the assistance of comparative reading in retrospect. The algorithm consists of the ROI detection and shape analysis based on comparison of each slice image in the present and the early CT scans. The slice images of present and early CT scans are both displayed in parallel and analyzed quantitatively in order to detect the changes in size and intensity affection. We validated the efficiency of this algorithm by application to image data for mass screening of 50 subjects (total: 150 CT scans). The algorithm could compare the slice images correctly in most combinations with respect to physician's point of view. We validated the efficiency of the algorithm which automatically detect lung nodule candidates using CAD system. The system was applied to the helical CT images of 450 subjects. Currently, we are carrying out the clinical field test program using the CAD system. The results of our CAD system have indicated good performance when compared with physician's diagnosis. The experimental results of the algorithm indicate that our CAD system is useful to increase the efficiency of the mass screening process. CT screening of thorax will be performed by using the CAD system as a counterpart to the double reading technique actually used in herical CT screening program, not by using the film display.

The aim of this study was to develop a computerized stereo- flicker chronoscopy and chronometry system to improve the technique of neuroretinal optic disc rim assessment. Digitized stereo photographs of 22 eyes of glaucoma patients were analyzed subjectively by computerized flickering of serial images, and objectively by measuring the width of the neuroretinal rim at 18 positions around the optic disc. A major source of error was identified as color changes in the images over time. Color adjustment algorithms were developed and the assessments and measurements were repeated. For chronometry after color adjustment there was improvement to most of the tests on the data: agreement (50% to 73%), specificity (45% to 84%), positive agreement (50% to 71%) and negative agreement (50% to 73%). Sensitivity remained constant at about 55%.

PET imaging can quantify metabolic processes in-vivo; this requires the measurement of an input function which is invasive and labor intensive. A non-invasive, semi-automated, image based method of input function generation would be efficient, patient friendly, and allow quantitative PET to be applied routinely. A fully automated procedure would be ideal for studies across institutions. Factor analysis (FA) was applied as processing tool for definition of temporally changing structures in the field of view. FA has been proposed earlier, but the perceived mathematical difficulty has prevented widespread use. FA was utilized to delineate structures and extract blood and tissue time-activity-curves (TACs). These TACs were used as input and output functions for tracer kinetic modeling, the results of which were compared with those from an input function obtained with serial blood sampling. Dynamic image data of myocardial perfusion studies with N-13 ammonia, O-15 water, or Rb-82, cancer studies with F-18 FDG, and skeletal studies with F-18 fluoride were evaluated. Correlation coefficients of kinetic parameters obtained with factor and plasma input functions were high. Linear regression usually furnished a slope near unity. Processing time was 7 min/patient on an UltraSPARC. Conclusion: FA can non-invasively generate input functions from image data eliminating the need for blood sampling. Output (tissue) functions can be simultaneously generated. The method is simple, requires no sophisticated operator interaction and has little inter-operator variability. FA is well suited for studies across institutions and standardized evaluations.

Several image-degrading factors limit the diagnosis of breast calcification from preoperative mammograms. We use specimen radiographs and algorithmically 3D-simulated calcification to produce high-quality data for testing a computerized differential diagnosis system. The preliminary results show that a computer can indeed differentiate explicitly between several mammographically characteristic calcification types. For a radiologist, such a detailed diagnosis could be more useful than simply characterizing the malignancy of the calcification. The results show new possibilities for the future diagnosis systems based on direct digital preoperative imaging.

This work describes the three-dimensional reconstruction of clustered microcalcifications based on only two digitized mammograms. First, the mammograms are examined separately to detect suspicious areas automatically. A further investigation separates microcalcifications from other structures. Based on an optimized region matching and on a specially adapted inverse discrete radon-transformation the corresponding volume is estimated from two projections and visualized by a continuously rotating object. But do two projections of a cluster carry enough information to reconstruct its three- dimensional arrangement sufficiently? We use Shannon's definition of information to estimate a lower bound of preserved information, described as the ratio of average information contained in the projections and average information contained in the volume, for simplified scenarios. Assuming two orthogonal projections of a cubic volume containing k binary representations of microcalcification positions the average information in the projections is determined by the combinatorial quantity of admissible arrangements and the size n³ of the volume. The combinatorial quantity of legal three-dimensional arrangements of microcalcification positions describes the average information carried by the volume. We showed that the amount of preserved information in the projections is more than 95% if k equals n/2 positions are found in both projections; it will exceed 98% if k equals n/4 positions are set.

We present a new method for the detection and measurement of volume changes in human hippocampi in serial Magnetic Resonance Imaging (MRI). The method follows a two-stage approach: (1) precise co-registration and intensity matching of the initial (baseline) and follow-up scan, and (2) refinement and segmentation propagation of the hippocampi outlines drawn in the baseline scan by an expert observer to the matched scan (co-registered and intensity matched follow- up scan of the time series). The first step is performed using MRreg, a rigid registration tool based on cross-correlation and intensity matching, and the second step makes use of the concept of active contour models for tracking the hippocampi outlines in the time series.

A new method is presented, which enables the reliable measurement of the femoral head sphere parameters (center coordinates and diameter) from tomographic image data, even when the raw data are erroneous. The hip joints of 13 newborns were scanned by a self developed 3-D ultrasound system. After automatic image segmentation, the femoral head is represented by spatially arranged voxel clouds. The 3-D image data are substantially corrupted by different types of errors. Moreover, the data only describe a segment of a sphere, whose area is about 10% of the sphere. This circumstance increases the identification problem. The problem of fitting the sphere parameters is solved by a robust technique based on rejection strategies for irrelevant points and data sets. The method was applicable in 21 of 26 cases. Substantial differences between automatically and expert determined sphere parameters were only observed for highly corrupted data sets, where the identification problem is inherently unstable. The identification method yielded correct and reliable identification of geometric measures from 3-D ultrasound image volumes and promises to be applicable also for other parameterized geometries and other tomographic image modalities as X-ray CT or MRI.

Graf's method is a successful procedure for the diagnostic screening of developmental dysplasia of the hip. In a defined 2-D ultrasound (US) scan, which virtually cuts the hip joint, landmarks are interactively identified to derive congruence indicators. As the indicators do not reflect the spatial joint structure, and the femoral head is not clearly visible in the US scan, here 3-D US is used to gain insight to the hip joint in its spatial form. Hip joints of newborns were free-hand scanned using a conventional ultrasound transducer and a localizer system fixed on the scanhead. To overcome examiner- dependent findings the landmarks were detected by automatic segmentation of the image volume. The landmark image volumes and an automatically determined virtual sphere approximating the femoral head were visualized color-coded on a computer screen. The visualization was found to be intuitive and to simplify the diagnostic substantially. By the visualization of the 3-D relations between acetabulum and femoral head the reliability of diagnostics is improved by finding the entire joint geometry.

Digital subtraction angiography, whether based on traditional X-ray or MR, suffers from patient motion artifacts. Until now, the usual remedy is to pixel shift by hand, or in some cases performing a global pixel shift semi-automatically. This is time consuming, and cannot handle rotations or local varying deformations over the image. We have developed a fully automatic algorithm that provides for motion compensation in the presence of large local deformations. Our motion compensation is very accurate for ordinary motions, including large rotations and deformations. It does not matter if the motions are irregular over time. For most images, it takes about a second per image to get adequate accuracy. The method is based on using the phase from filter banks of quadrature filters tuned in different directions and frequencies. Unlike traditional methods for optical flow and correlation, our method is more accurate and less susceptible to disturbing changes in the image, e.g. a moving contrast bolus. The implications for common practice are that radiologists' time can be significantly reduced in ordinary peripheral angiographies and that the number of retakes due to large or local motion artifacts will be much reduced.

Today's digital radiography systems mostly use unsharp masking-like image enhancement techniques based on splitting input images into two or three frequency channels. This method allows to enhance very small structures (edge enhancement) as well as enhancement of global contrast (harmonization). However, structures of medium size are not accessible by such enhancement. We develop and test a nonlinear enhancement algorithm based on hierarchically repeated unsharp masking, resulting in a multiscale architecture allowing consistent access to structures of all sizes. The algorithm is noise- resistant in the sense that it prevents unacceptable noise amplification. Clinical tests performed in the radiology departments of two major German hospitals so far strongly indicate the superior performance and high acceptance of the new processing.