Back Projection (Under Construction)

Back projection is the process by which we generate our 3D model. As was discussed earlier, one of the goals of single particle analysis is to use 2D images formed by TEM to reconstruct a 3D model of the original object. In this section, we will see how the generated projections are "added up" to recreate the model.

Introduction

A cube and three possible projections that can be generated from it
Three possible projections and their A cube and three possible projections that can be generated from it
Figure 1. Example image of how a cube generates different projections depending on the angle of projection (top). These same projections can then be used to regenerate the cube through back projection (bottom).

As its name implies, back projection is the inverse function of projection. When an n-dimensional object is projected, each projection is an n-1 dimensional sum of its density along the projection axis. Therefore, a sphere would have circles as its projections. A cube, on the other hand, would produce either squares, diamonds, or other intermediate parallelograms (Figure 1 top) depending on the direction of projection. The actual shape, of course, depends on the orientation from which the projection was made. The reverse function (Figure 1 bottom) is called back projection and regenerates the original object.

Schematic animation of a back projection example
Figure 2. Animation showing how back projected 1D projections (white lines) can be merged to form a 2D object (white circle in center). As more projections are added, the original object becomes more defined.

Since a projection can be thought of as a "squishing" of the object, back projection is then the "smearing" of the projections back onto each other. The sum of the back projected projections regenerates the original object. In the example above, a cube generated different paralleograms in projection. In Figure 2, back projected circles were used to reconstruct the original sphere. When a circle is "smeared" along its axis towards the center of the space, it forms a line. In each frame of the animation in Figure 2, more of these back projected lines are added at different angles. As the amount of projections used is increased, the lines complement each other where they intersect. The result is that the sphere at the intersect point becomes better defined. Thus, the back projection of the projections can reconstruct the original object.

Back projection with a detailed example

The following example presents a more detailed view of back projection using a more complicated model with extra features and details.

Model used for back projection
Figure 3. Picture of the 2D model that will be reconstructed by back projection.
Sinogram of the model
Figure 4. Sinogram generated by applying a Radon transform to the model. Each row of the sinogram represents a diffrent projection through the model.

The Radon transform is an algorithm that transforms an original image into a series of equiangular projections. When applied to a 2D object, the output of the Radon transform is a series of 1D lines. For easier representation, the lines are often stacked on top of each other, generating a sinogram. The sinogram in Figure 4 is the Radon transform of Figure 3.

Animation of back projection
Figure 5. Animation of the 2D reconstruction of the model from Figure 3. Each frame of the animation adds more projections that help improve the quality of the reconstruction.

To create the different figures for this example, the following SPIDER script was used: b00.radon.spi. This script generates a Radon transform from the input model, extracts each individual projection from the sinogram, and modifies the projections so that they can be averaged. While the script is not a mathematically accurate description of back projection, conceptually it is similar. Finally, it can be easily modified for other presentational examples.

Back projection in the real world

The above descriptions dealt with an ideal sample. All the information from the original model was known. This made it easy for the reconstruction programs to recreate the original model with high fidelity. But what happens with a real world example? Data is often missing or inaccessible.

In the previous steps of the reconstruction process, the experimental particles were centered and aligned. Lastly, each experimental projection was assigned a set of Euler angles that define its position in space relative to its origin from the original model.

An incompletely reconstructed object
Figure 6. The reconstructed model with only half of the projections used. Since the projections only spanned part of the available angles, some features are sharper in one direction than in the other. Smears are visible in the directions that were overrepresented.

To generate Figure 5 all the projections were evenly spaced around the origin. All of Euler space was covered. In a real world example, the experimental projections are usually either randomly distributed or heavily biased and clustered towards one orientation. Ideally, an even, random distribution is prefered. However, this is rarely the case. When experimental projections are clustered, some views will be over represented over others. This results in a skewed final reconstruction. Figure 6 is such an example of a biased reconstruction. The original model is the same as in Figure 3, but the back projection was only limited to half the projection data set.

NEXT

Refining the Model