It is often the case that linear time-invariant (or for discrete-time systems, linear shift-invariant) systems are connected together in various ways, so that the output of one may be the input to another, or two or more systems may share the same input. In such cases we can often find an equivalent system impulse response that takes into account all the component systems. In this post we focus on the serial and parallel connections of LTI systems in both the time and frequency domains. Much more complex interconnections can be constructed from these two basic kinds of connections.
Let’s first look at a serial connection of two systems, then we’ll move on to a parallel connection. A serial connection of two systems just means that the output of the first system forms the input to the second system.
Let’s go through the mathematics that describes an equivalent system for the serially connected systems in Figure 1. As we progress we’ll present results with a bit less detail, but for this first example of interconnected systems, we’ll look at all the details.
The basic mathematical problem is to find an expression for the response in terms of the input and the two impulse response functions . Using what we’ve already established about linear time-invariant systems in the Signal Processing ToolKit posts, we can write the following two expressions
where denotes convolution. We are looking for an expression that does not explicitly contain . Let’s do the obvious and substitute from (1) into (2).
and we notice that the inner integral is the function
evaluated at . So our expression becomes
The equivalent system has an impulse-response function that is the convolution of the two individual impulse-response functions and , as illustrated in Figure 2.
We can use induction to prove that the serial connection of LTI systems has an impulse-response function that is equal to the convolution of the component-system impulse-response functions, as shown in Figure 3.
Now let’s turn to the parallel connection of two linear time-invariant systems, as depicted in Figure 4.
The math is simpler here:
The equivalent system is found by adding to ,
So the equivalent system for a parallel connection is simply the sum of the two component systems’ impulse response functions. For the parallel connection of linear time-invariant systems , we have the equivalent impulse response
which is illustrated in Figure 5.
The equivalent systems for serial and parallel connections of discrete-time linear shift-invariant systems follow the same rules as those above for continuous-time linear time-invariant systems. The mathematics is nearly identical, with convolution integrals replaced by convolution sums.
We can gain more insight into the nature of the output of an interconnected set of systems if we look at the input-output relations in the frequency domain. Starting again with the serial connection of two linear time-invariant systems (Figure 1), we have the temporal input-output relation
where denotes convolution. We’ve already established in the Signal Processing Toolkit that the Fourier transform of a signal that is equal to the convolution of two functions is the product of the Fourier transforms of those two functions: convolution in the time domain is multiplication in the frequency domain. This means that (19) can be easily transformed to yield the input-output relationship for the serial connection of two linear time-invariant systems given by
which is illustrated in Figure 6.
Using the result shown in Figure 3, we find that the equivalent transfer function for the serial connection of LTI systems with transfer functions is simply their product,
as illustrated in Figure 7.
It should now come as no surprise (Equation (18)) that the parallel connection of linear time-invariant systems has an equivalent transfer function that is simply the sum of the individual-system transfer functions, as shown in Figure 8.
A linear time-invariant system is completely characterized (in terms of determining the output for any input) by its impulse-response function. The Fourier transform of the impulse-response function also, therefore, completely characterizes the system, and that function is called the transfer function or frequency response. The output is related to the input through multiplication by the transfer function,
So a spectral component of the input, , is scaled by the transfer function evaluated at the frequency of the spectral component, , to produce the spectral component at the output . Since can be a complex number, both the magnitude and phase of the spectral component in can be modified by the system, delivering (‘transferring’) the spectral component to .
In the case of the serial connection of linear time-invariant systems, the scaling of the input spectral component is simply the multiplication of all the individual scaling functions from the connected systems, or . To annihilate the spectral component at in the output, for example, all that is required is that at least one of the component systems has a transfer function that is zero at .
In the case of the parallel connection of linear time-invariant systems, the equivalent impulse-response function is the sum of the component-system impulse-response functions, and so the equivalent transfer function is the sum of the component-system transfer functions. The spectral component in the input with frequency is scaled by the sum of the component-system transfer functions, or . To annihilate a spectral component of the input so that it does not appear in the output requires that this sum be zero. A sufficient, but not necessary, way to do that is to make sure each is zero.
A bandpass filter is a linear time-invariant system that has a transfer function that is zero (or very small) for all input frequencies except those in the two intervals
where . Only a contiguous subset, or band, of frequencies is passed through the system, not all frequencies. We can construct a bandpass filter from a lowpass filter and a highpass filter in serial connection. A lowpass filter passes all frequencies in the interval and a highpass filter passes all frequencies in the two intervals
Consider the serial connection of a lowpass filter and a highpass filter shown in Figure 9. The maximum frequency that is passed by the lowpass filter (the `cutoff frequency’) is , and the minimum frequency that is passed by the highpass filter (its cutoff frequency) is . Crucially, . When we connect these two linear time-invariant systems serially, we multiply their transfer functions, obtaining the transfer function shown in the figure. Here, and .
The inverse of a bandpass filter is called a notch filter or bandstop filter. Such a linear time-invariant system passes all frequencies except those in the two intervals
The notch filter can be created by the parallel connection of a suitable lowpass filter with a highpass filter, as shown in Figure 10. Here we must have . The equivalent system is the sum of the two transfer functions, or .
Complex Arrangement of Filters
In this final example of the interconnection of linear time-invariant systems, consider the arrangement of seven different systems shown in Figure 11. Just think if we had to figure out the equivalent system by dealing with the time-domain convolutions. It would be a mess of integrals.
Instead, let’s look at it through the frequency-domain lens of the transfer function.
Significance of Connected LTI Systems in CSP
CSP is mostly about nonlinear, as opposed to linear, mathematical operations, so that the role of LTI systems and their interconnected versions mostly has to do with their effects on a signal prior to application of CSP. A canonical example involves a pulse-amplitude-modulated signal (such as PSK and QAM), with a pulse-shaping LTI system (filter) , a propagation-channel LTI system , and a reception LTI system . These systems are connected in series (the output of one forms the input of the next), so that the equivalent LTI system that connects the modulated impulse train at the transmitter to the received signal is . This equivalent system can then be used to determine the spectral correlation function or the cyclic cumulants.