Online data reduction with a DSP-FPGA multiprocessor system

For the detection of cracks and corrosion in pipelines an ultrasonic measuring system (pig) was developed. During the pipeline inspection there is no communication to the outside world, the accumulated data have to be stored on a mass storage device. The amount of data for a 250 kilometre run is in the range of about 700 TBytes at a rate of 2.8 GByte/s. This amount of data has to be filtered, reduced and compressed by a factor of 7000 to store it on a storage device. To overcome these difficulties a massive parallel multiprocessing system with ASICs and DSPs was developed. Each of the system modules has a computing power of more then 1200 MOPS. The complete computing power is installed in a volume the size of a shoe box.