At long last, I am picking up the modulation-recognition (MR) topic again. My plan is to describe the core MR algorithm I’ve developed using cyclic cumulants in this post, and then in a third and final post present some performance results using simulated and captured signals.
Recap of Part I Post
The Part-I post introduced the basic MR problem statement, provided four distinct important problem variations, and discussed the problem aspects that render the problem a perennial one.
The four variations are summarized next.
Radio-Frequency Scene Analysis. The most general version of the problem, as described in my introductory post and my wicked-problem post. For an arbitrary RF scene, detect, characterize, and classify all signals in the scene regardless of their durations, bandwidths, signal-to-interference-and-noise ratios (SINRs), types, and parameters. The cocktail-party problem for radios ™.
Conventional Modulation Classification. The least general version of the problem involves determining the type of a single signal in noise, with moderate-to-high SNR, that is at complex baseband or very close to it. This is the problem considered by most modulation-classification papers of the past four decades, including some of mine.
Cognitive-Radio Modulation Classification. In a modern twist on the problem, cognitive-radio classification involves quickly determining the type of a signal in each of a number of assigned frequency channels used by two kinds of users: Primary and Secondary. The Primary users are the licensed users, and they have right-of-way access to the channels. The Secondary users are non-licensed opportunistic users, attempting to make use of the channels while the Primary users are not. Secondaries must be able to determine what kind of signal is occupying a channel, even if the perceived inband SNR of that occupant is low.
Cochannel Modulation Classification. A difficult version of the problem occurs when two or more signals in the scene can be both contemporaneous and spectrally overlapping. This is called the cochannel signal condition. When the two signals have comparable power, then they each experience a signal-to-interference-and-noise ratio (SINR) of less than zero decibels. So typically the cochannel condition implies low SNR. Moreover, for feature-based classifiers, the features must be signal-selective to be effective, and for trained classifiers, such as trained convolutional neural networks, the training set needs to include all expected (or possible, depending on your biases) combinations of the signals, leading to a combinatorial explosion in the size of the training and testing datasets.
In the Part-I post I assert that the MR problem has not been definitively solved because of the large number of problem dimensions, including catalog size, SNR, cochannel complications, data-record length, sampling bandwidth, desire for real-time operation, and the amount and type of available prior information. I elaborated on this in my speculation that the MR problem is a wicked problem. I also discuss commonly used MR performance measures such as the confusion matrix for decision labels and square-root mean-squared error (RMSE) for parameter estimates. I then describe the major classes of solution approaches, including decision-theoretic, feature-based, and machine-learning. Finally, I present simulated examples that show exactly why various features fail in some important real-world situations.
In this post, I’ll describe my mathematical approach to modulation recognition (decision-theoretic leading to a final principled feature-based algorithm). In Part III, I’ll illustrate the approach with numerical examples.
Algorithm Approach
The mathematical approach to the MR problem is sketched in the companion papers My Papers [26,28], and has roots in a less well-motivated approach I took in My Papers [25]. The remainder of this section, and the section on algorithm development, is an explication of [25,26,28] without the heavy constraint of publication page limits.
Key Background Ideas
Hypothesis Testing
A core idea is that of hypothesis testing. When confronted with a data record containing a single signal with unknown type and parameters, we can imagine forming a sequence of hypotheses (proposed explanation) about that signal. On the first hypothesis, the signal is a BPSK signal. On the second, it is a QPSK signal. On the third, it is an OFDM signal. You can imagine going on like this for some time, leading to a set of, say, hypotheses. Which one, if any, is true? You might add a final hypothesis such as None of the first
hypotheses is true. We would call that the None-of-the-Above (NOTA) or Unknown hypothesis.
The formation of hypotheses can be quite simple, as in the binary hypothesis testing problem (BHTP). In the BHTP, there are only two hypotheses. A typical example is hypothesis zero (called ) for which the signal is not present in the data and hypothesis one (
) for which the signal is present in the data. The problem is to decide between them in some principled or even optimal manner. I used this most basic problem set up in the cycle-detectors post.
Many MR situations are not simple, and this leads to the consideration of more complex sets of hypotheses. For example, the first hypothesis could be Type-A Signal is Present and the second could be Type-A Signal is Present with Cochannel Type-B Signal. If there are, say, signal types of interest, and all two-signal cochannel combinations are possible (of interest), then you could formulate
distinct two-signal combinations. We could also include all
of the single-signal hypotheses and the NOTA hypothesis. That would lead to a multi-hypothesis problem having
hypotheses. If you have signal types of interest, this leads to
hypotheses. (Ouch.)
Complete Probabilistic Characterizations
We’ll have to carefully consider which hypotheses we include in an MR problem statement, but the discussion above avoided concrete examples of the contents of an individual hypothesis. We said things similar to ‘on hypothesis seven, the signal is BPSK.’ But what exactly does ‘signal is BPSK’ mean here, mathematically? This goes to the heart of my musings on BPSKness in several CSP Blog posts, such as All BPSK Signals and Is RFSA a Wicked Problem?
When we say that on the seventh hypothesis, the data is composed of BPSK plus noise, what does that mean? Here are some possibilities:
- The inphase component of the data (real part) has a graph (plot of the amplitude versus time) that is consistent with that of a BPSK signal with particular values of the pulse-shaping function, bit rate, carrier frequency offset, and allowable transmitted bit sequences.
- The estimated power spectral density is consistent with that of the power spectral density of a BPSK signal with particular parameter values. If you subtract the power-spectrum estimate from the theoretical power spectrum, and summed the absolute value of the resulting difference, the number would be small compared to the energy in the power spectra.
- The set of detectable second-order cycle frequencies for the signal in the data conforms to the pattern of second-order cycle frequencies for a BPSK signal with modern modulation-efficient pulses, such as square-root raised-cosine pulses. The non-conjugate pattern is a single non-zero cycle frequency
. The conjugate pattern is a triplet of cycle frequencies
with
and
.
But, what is the optimal way to form the hypothesis? What is the complete description of BPSKness? If we can capture the full description of what it means for a data sequence or a continuous voltage record to correspond to BPSK–and only to BPSK–then that description would be a good one to use in hypothesis formulation.
Are any of the three alternatives above complete descriptions, in some relevant sense, of BPSKness? Let’s discuss (remember, no page limits here!).
For the first description alternative, we can conceive of a table containing all possible inphase sampled-data or continuous-time functions that correspond to an instance of the BPSK signal in question. That is, fix the bit rate, carrier frequency offset, carrier phase, symbol clock phase, pulse-shaping function, and power (amplitude), and create a table entry for each possible sequence of transmitted bits. We could then do that for all combinations of bit rate, carrier frequency offset, carrier phase, symbol-clock phase, pulse-shaping function, and power. This leads to a very large table–infinite if we take seriously all possible values of, say, the carrier phase (which is an uncountably infinite set because it is a real number).
In the end, we have a table with infinite rows each containing a finite-length complex-valued sequence or function of time. Here, we can formulate a hypothesis for BPSK such as On Hypothesis Seven, the Signal in the Given Data Appears in the BPSK Table. How to make use of this kind of hypothesis, provided we actually have the table? We could form the difference between the data and each row of the table and retain the index of the row for which the sum of the absolute error is minimum. Then repeat that for similar tables for other modulations of interest (you can see the infinities stacking up here I hope). Finally, choose as the modulation-type decision the one corresponding to the minimum table error. For this to be good, we’d have to ensure that the tables for different signal types don’t have significant numbers of identical entries. (Ponder the question of whether a table for QPSK and a table for BPSK will have any identical entries.)
Alternative one isn’t practical–we can’t make these ideal tables and trying to make approximations will also be difficult due to combinatorial explosion. This idea of BPSKness as a giant list of voltage trajectories does bring to mind modern approaches to MR that attempt to create very large I/Q training datasets, which are nothing more than truncated versions of the tables I’ve described. But we have seen over the past five years where that gets us.
The second description alternative is to describe the essential nature of the signal in terms of its power spectrum. Does the estimated power spectrum for the input data match, in some suitable numerical sense, a stored ideal (theoretical) power spectrum for one of the signals of interest? A problem with this alternative is that the power spectrum is not unique for many sets of signal types of interest. I’ve belabored this in other contexts, and it is easily seen to be true. For example, all unit-power PSK and QAM signals with balanced constellations, identical pulse-shaping functions, and independent and identically distributed symbol sequences have identical power spectra.
The third alternative above involves the pattern of second-order cycle frequencies for a signal. In this description, BPSKness involves two small sets of real numbers together with their differences and the relation between the elements of the two sets. If we consider three different signal types: BPSK, QPSK, and AM-DSB, and denote the symbol rate of the PSK signals as and the carrier frequency of all three signals as
, then the signals are described by these cycle-frequency patterns:
BPSK:
QPSK:
AM-DSB:
The three sets (second-order cycle-frequency patterns) are highly distinct, which is good for MR. But the flaw in this signalness description is similar to the flaw for the second alternative description that used the power spectrum: A large number of distinct signal types of interest also possess the same cycle-frequency pattern as QPSK. Examples include 8QAM, 16QAM, 64QAM, -DQPSK, a huge number of continuous-phase-modulated (CPM) signals (My Papers [8]), and others. In fact, there are several distinct signal types that map to the BPSK second-order cycle-frequency pattern: All pulse-amplitude-modulated (PAM) signals with symmetric real-valued constellations. These are sometimes called amplitude-shift-keyed (ASK) signals, such as 4ASK, 8ASK, 16ASK, etc., for which the symbol constellation points lie on the real axis in the complex plane.
So a big obstacle in the way of setting up a multiple-hypothesis MR problem is how to describe the hypotheses such that each hypothesis captures something unique about the associated signal. And at the same time, avoiding descriptions that are infinite, like the tables above. Some plausible descriptions end up forming undesirable equivalence classes–multiple distinct signals will have identical descriptions in their hypotheses.
But we know that, for instance, QPSK and 16QAM are distinct signal types even if their PSD-based descriptions form an equivalence class. Or do we? Why do we think they are distinct? The question becomes: What does a signal label mean? If all the 16QAM signals are crammed into a box labeled 16QAM, how do we construct the contents of that box? Exactly how do we do that?
I draw your attention back to alternative description one, the infinite table of I/Q trajectories. We’ve seen that before! In the context of random processes, it is the ensemble. And we have a way of generating the entries in the table–the elements of the ensemble–using mathematics. We can write an expression that covers all of the uncountable infinity of ensemble elements; that expression is the ensemble generator. For 16QAM, it is
where and
can be random variables. These are the amplitude (determines power), transmitted symbols, symbol interval (reciprocal of symbol rate), symbol-clock phase, carrier (offset) frequency, and carrier phase, respectively.
Most generally, a random process is completely specified by the collection of all possible th-order joint probability density functions for sets
. For the random process in (2), these joint density functions can be determined from the probability density functions for each of the involved random variables.
If we wish, we can add more random variables to this process. For example, we can introduce a propagation-channel model such as the discrete multipath channel. For every ensemble element generated by (2), we’d have another uncountable infinity of new ensemble elements, each produced by applying a randomly chosen channel to the chosen element.
So we do have one answer to the question of what constitutes BPSKness: An infinite set of multidimensional (joint) probability density functions. Once those are specified, we can create a random process that will produce all BPSK signals conforming to the underlying random-variable distributions, which is an uncountably infinite set.
The final step in creating hypothesis descriptions is to realize that the set of all possible joint probability density functions for the random process can be expressed in terms of all possible th-order temporal moment functions–we can sidestep writing down the density functions and just write down the moments. And we already know that we can write down all the joint moments if we know all the joint cumulants. Therefore, our description of signalness can take the following equivalent forms:
- The ensemble: A table with an uncountable infinity of rows, each corresponding to one instance of the signal, which means a sample path of the signal’s random-process characterization.
- All joint probability density functions for sets like
.
- All
th-order temporal moment functions for products like
.
- All
th-order temporal cumulant functions for sets like
.
Likelihood
Consider a random variable and an associated hypothesis-testing problem with hypotheses
. On hypothesis zero,
, the random variable has density function
and on hypothesis one, it has density
. The likelihood ratio is given by
When this ratio is greater than one, the interpretation is that the observed data () is more likely to have arisen under hypothesis
than under
. If the ratio takes an exponential form, the natural logarithm is often applied to gain access to the exponent, which is reasonable because the logarithm is monotonic, so no decisions will be inappropriately reversed. The log-likelihood ratio (LLR) is then
.
Suppose the random variable is Gaussian on
with mean
and variance
. Then the two densities are easily expressed as
A maximum-likelihood decision would then compute each of the likelihoods and choose the hypothesis corresponding to the maximum of those likelihoods.
Problem Statement Evolution
The goal is now to craft a problem statement that captures the modulation-recognition problem and that is mathematically tractable. We also want the problem statement to be as general as possible, so that it is applicable to a large set of modulated signals. To achieve this goal, we present a sequence of problem statements. At first, the problem statements will be equivalent, but eventually we will introduce variations or approximations that result in problem statements that are tractable, and that are not equivalent to the most general problems from the beginning of the sequence.
We want to process some sampled data and decide if that data contains one of distinct signal types drawn from some catalog of types
. That is, each element of the set
is a label
and there are
such labels. Leaving aside the NOTA or Unknown decision, we have
hypotheses.
On the th hypothesis
, the data contains a signal with type
.
For each signal type in
, we conceive of the collection of all possible
-type signals as a random process characterizing signal
, which means we know all the joint PDFs for that random process. For convenience, we assume that the autocorrelation function for the
random process has a value of one at lag
–the elements of
are unit-power random processes. (We do not make this assumption about the power of the received signal under study.)
Now let’s consider some label (drop the subscript
for convenience). Denote by
the collection of all
th-order probability density functions for signal type
. The (infinite) set
contains the complete probabilistic description of random process
. For any signal (sample path)
we use the notation
which we read as the signal is distributed as
.
Problem One
Let’s consider the multiple hypothesis problem given by
for . Choosing hypothesis
is equivalent to declaring that
contains the signal with label
plus white Gaussian noise (
).
Although it is possible to know for many signal types, it is typically difficult to obtain that information, and it is even more difficult to measure the elements of
from data. We are thus inspired to reformulate the problem.
For an arbitrary probability density function, say
that depends on some vector of random variables , we can find the characteristic function by Fourier transformation in the
variables,
Moreover, the characteristic function itself is a Taylor series involving the moment functions for the sets , or
where the th-order time-varying moment is given by
All the possible moments are found in the multidimensional Taylor-series expansion of the characteristic function. For example, the th-order moment corresponding to the product of possibly repeated terms
where
is given by the coefficient in the series that corresponds to the term
The point here is that the characteristic functions are completely specified by the set of all possible th-order moments for
. In turn, due to the uniqueness of the Fourier transform (under mild conditions on the involved functions), the characteristic functions completely specify the set of all possible joint probability density functions.
Let’s use some compact notation to try to capture these ideas, which will be critical for our succession of hypotheses-laden problem formulations. Let the symbol denote all possible moment functions for signals with the
th label in
. Then the following two statements are equivalent:
Saying that a signal is characterized by an infinite set of probability density functions is equivalent to saying that the signal is characterized by an infinite set of th-order moments, provided the moments correspond to the density functions.
Finally, we make the connection to cumulants. As we saw in the SPTK post on the characteristic function, the natural logarithm of the characteristic function has a series representation in which the coefficients of the various orders of the frequency variables are the cumulants. That is, in the notation we’re using here,
So if you knew all the cumulants, you could construct the logarithm of the characteristic function, and if you know the logarithm of the characteristic function, you can use exponentiation to obtain the characteristic function itself, and if you know the characteristic function, you know the probability density functions. Let’s denote the infinite set of cumulants by . Then we arrive at the equivalencies
I emphasize “equivalencies” here–this is not approximately true, it is exactly true. We can now formulate a second problem.
Problem Two
The original problem (7), posed in terms of the infinite set of joint probability density functions , is equivalent to a problem posed in terms of an infinite set of moment functions
,
On the th hypothesis, the data
contains a noisy signal that has moments
. We have good reasons for preferring cumulants over moments, which leads to Problem Three.
Problem Three
The problems (7) and (17) are equivalent to a problem posed in terms of an infinite set of cumulant functions ,
We can also pose problems in terms of the distribution, moments, or cumulants of the data itself, rather than just for the signal component of the data. Let’s use the notation to refer to all the probability density functions for the sum
. To fully capture the probabilistic nature of the data, let the symbol
denote the collection of all probability density functions for
. The symbols
and
similarly denote the sets of moments and cumulants, respectively.
Problem Four
Problem Five
Problem Six
Problems Four, Five, and Six are actually more general than the previous problems because they also include the full probability structure of the noise .
We would now like to develop a problem statement that deals with measurable quantities and one with a solution that can be implemented (in software) for a catalog of interest. It turns out that both probability density functions and higher-order moments are difficult to estimate or use for various reasons in many scenarios, but that cumulants are relatively easy to estimate and lead to useful algorithm generalizations in scenarios involving multiple cochannel signals and noise with unknown parameters.
Elements of take the form
where is the set of all distinct partitions of the index set
. Each element of
is a collection of
subsets of the index set such as
where the union of the subsets
is the index set and the
subsets are all distinct (their intersections are the emptyset). The size of
is
, so that the sum of the
is
.
In (22), the symbol denotes the
th-order temporal moment function for
. It will be helpful in the following progression of problem statements to recall that cumulants for Gaussian random variables, processes, and signals are zero for
.
Problem Seven
Here we are saying that on the th hypothesis, the observed data has a set of cumulants that are equal to the sum of the cumulants for the
th signal,
, plus the cumulants for the noise component of the data.
As an aside, we can imagine at this point extending Problem Seven to include cochannel signals. We could have a matrix of hypotheses , for example, where the
th hypothesis means that the data has a set of cumulants equal to the sum of those for signal type
, signal type
, and the noise component,
Problem Seven gets us closer to a set of hypotheses that involve measured quantities, but isn’t quite there yet, since the specified cumulants are the theoretical cumulants, and so require an infinite ensemble or an infinite-duration signal to average over.
The cumulants can be estimated directly from the data given knowledge of their variation with . Moreover, the standard estimates are asymptotically independent and Gaussian.
There is a serious dimensionality problem remaining regarding the lag vector and the order variable
. To move toward mitigating the high dimensionality of the quantities involved in the hypotheses, we now make the move from time-varying cumulants to their Fourier-series components, the cyclic cumulants.
For the RF communication signals of typical interest to RF scene analysis and modulation recognition, the cumulants are periodically or polyperiodically time-variant, and so we have the Fourier-series representation encountered in the cyclic cumulant post,
where are the cycle frequencies for the
th signal type for order
.
We note the equivalence of the time-varying cumulant for signal type and the set of cyclic cumulants for signal type
,
Problem Eight
In this next problem formulation, the hypotheses relate to sets of cyclic cumulants rather than to sets of time-varying cumulants, which eliminates the time variable from our setup,
for all cycle frequencies
for which the signal type has a non-zero cyclic cumulant, and
.
So far we have not sacrificed any optimality since the information exploited in Problem Eight is identical to that exploited in Problem One, and in both cases the information consists of the complete (exhaustive) probabilistic description of the involved signal types.
However, the dimensionality of the involved quantities is very large for . The high-dimensional variables include the
-dimensional delay vector
, all orders
, and the potentially infinite sets of cycle frequencies
. While most communication signals possess a finite set of cycle frequencies for any finite order
, some, such as the rectangular-pulse PSK signals. possess infinite sets of cycle frequencies.
We have two basic choices for dimensionality reduction: restrict the order or restrict the lag vector
. Before delving into the dimensionality-reduction issue, however, let’s make one final modification to our problem statement.
Problem Nine
The modification consists of deleting (neglecting) the cyclic cumulant that corresponds to signal power, which means the cyclic cumulant for and
. This is also known as the autocorrelation function.
for all cycle frequencies
for which the signal type has a non-zero cyclic cumulant except
, and
.
We have left off any mention of the cyclic cumulants for the white Gaussian noise process in Problem Nine because of the peculiarities of the higher-order cumulants for Gaussian variables and signals,
We thereby avoid the “second-order stationary” probabilistic parameter but also lose optimality, and we gain sweet simplicity. Moreover, a case of great practical interest corresponds to for multiple values of
. That is, the signals have identical power spectra and therefore the power spectrum and, equivalently, the autocorrelation, do not help to distinguish these signals from each other.
Another good reason for leaving the autocorrelation out of the hypotheses is that when we generalize the hypotheses to the case of cochannel signals, that parameter reflects all of the cochannel signals, not just the th. This is also true of cyclic cumulants for
, which are the traditional stationary-signal higher-order statistics.
Problem Ten: The Order-Reduced Classifier
A major simplification of Problem Nine is to severely restrict the order . In particular, we allow a single value of the order:
. This leads to the suboptimal (because we are throwing away almost all of the probabilistic information about the involved signals) hypotheses given by
for ,
and
.
Problem Eleven
The set of hypotheses (30) suggests the following practical problem, where the limit probabilistic parameter for the received data is replaced by a noisy estimate,
for ,
, and where
is white Gaussian noise.
Problem Eleven is recognized as a known-signal-in-noise problem (a matched-filtering problem). The problem is easy when the cycle frequencies for the different hypotheses are disjoint–that is, when the signals all have different cycle frequencies. We focus on the harder problem, which is of substantial practical interest, where all the signals have the same cycle frequency sets,
for all indices
.
Problem Eleven is then simplified to
for ,
.
Further simplifications are possible. Note that the information in a single cyclic cumulant function requires only lag variables
to capture. That is, we usually work with the reduced-dimension cyclic temporal moment and cumulant functions
where the -dimensional lag vector
is given by
More generally, we simply use the -dimensional function
with arbitary
.
Let’s name the second-order cycle frequencies as in
. Then Problem Eleven can be expressed as
for ,
, and
.
Finally, we make the simplifying assumption that the noise is Gaussian, independent of
, and white so that we can simplify the notation to
.
Solution to Problem Eleven: The ORC
If the amplitude and the delay (relative to the assumed signal model’s temporal origin)
are known, then (34) is truly a known-signal problem. However, these parameters need to be estimated in practice because we can’t assume we know the amplitude and delay of a signal we are trying to recognize. We find these later; for now, assume we have available estimates
and
.
For each and
,
is an independent Gaussian random variable with mean value
and variance . Assume each cyclic cumulant has approximately finite support contained within the interval
for
large enough. Form the vector
by separating the real and imaginary parts of the cyclic cumulant,
where
Through this sequence of definitions, approximations, and assumptions (some quite probably questionable), we arrive at a vector where each component is a real random variable with known mean and variance
. Let’s use the simplified notation
to enable us to write the joint probability density function for the elements of as the product of
marginal Gaussian distribution functions,
Let’s simplify the notation for the mean values,
Our density function can be slightly simplified to
We can now compute the logarithm of the density function (which is also a likelihood function), which will simplify finding its extremal values, leading to a method of signal classification. That is, we want to find the index for which the density function is maximum.
The logarithm converts the products to sums,
Substituting the definition of back into this compact expression leads to
If we want to maximize the conditional density function over the various signal-type hypotheses indexed by , we can maximize the log-likelihood function, which leads to minimizing the right term of (47), which cannot be positive. Therefore, our signal-class index estimate is
Discussion
The order-reduced version of our general problem results in a relatively simple distance-based classifier embodied by Equation (48). This classifier compares all cyclic autocorrelation functions in the catalog of known types with the measured cyclic autocorrelation functions obtained from the data at hand. It can work provided no entries of the catalog set are scaled versions of each other:
where is the set of cumulants restricted to order
.
Unfortunately, there are many signals for which the condition (49) does not hold. In particular, all PSK signals with four or more points in their constellation, and where the constellation is doubly symmetric in the complex plane, have identical second-order statistics. This can be referred to as an equivalence class. The signals for which (49) does not hold form a subset of signal types that are equivalent with respect to the lens of second-order limit parameters (time-varying mean and time-varying autocorrelation).
To accurately distinguish between signals that fall into such an equivalence class, we can consider a delay-reduced version of the general problem instead of the order-reduced version (Problem Nine). For this new problem variant, we restrict the range of the -dimensional delay vector
to the origin and restrict the order
to some integer
. This thinking leads us to Problem Twelve.
Problem Twelve
Our hypotheses are now given by
for ,
, and
. That last constraint just means we don’t want to include the conventional (non-cyclic) autocorrelation (equivalently, we want to exclude the power spectrum). For each value of the order
, let the set of cycle frequencies
be represented by the
as before,
where is the number of
th-order cycle ferquencies.
The formulation in (49) can be expressed in terms of the specific cycle frequencies ,
where ,
, and
. The variant of Problem Twelve in (51) is again recognized as a known-signal-in-noise problem. Let’s assume that we can find hypothesis-dependent estimates of the amplitude and delay given by
and
.
We next introduce the concept of cumulant warping in which each th-order reduced-dimension cyclic cumulant is raised to the power
. This attenuates the typical rapid growth of the cyclic-cumulant magnitude with order
, which prevents the cumulants with the largest order
from dominating the eventual classification statistics (which you haven’t yet seen). The warping means that each considered cyclic cumulant is scaled by
and so all the various involved cumulants are commensurate with signal power.
The next Problem Twelve variant is
where ,
, and
.
Let’s now (naively) assume that these nonlinearly transformed cyclic cumulants can be estimated with variance independent of both and
where ,
, and
. Here the random variable
models the estimation error, and it has zero mean and a variance independent of
and the cycle frequency
.
For convenience, let’s compact the notation
Then our final variant of Problem Twelve is simply
where ,
, and
.
The interpretation of Problem Twelve is that on the th hypothesis, a particular (large) set of measured cyclic cumulants is equal to a noisy version of the ideal cyclic cumulants for the signal corresponding to
. The trick is that the cyclic cumulants are severely restricted in terms of the delay vector
and the maximum considered order
.
Solution to Problem Twelve
Since (56) is a form of the known-signal-in-noise problem, we can immediately write the solution,
Or, back substituting for the variables to express it directly in terms of cyclic cumulants,
The interpretation of the solution to Problem Twelve is that the best decision index corresponds to the minimum of the sum of squared distances between the signal’s ideal cyclic cumulants and the corresponding measured cyclic cumulants, or what I call cyclic-cumulant matching.
Reverie
That was a lot. And, I am sorry to say, not one figure has yet been placed into this exposition. We ended up with two likelihood-based (decision theoretic) signal classifiers that are each a major simplification of a much more complete and imposing signal classifier. Along the way, we thought hard about how to capture the probabilistic essence of a manmade communication signal. As I say elsewhere on the CSP Blog, what makes a BPSK signal a BPSK signal? What is BPSKness? I opted to pursue a series of problem statements that focused on the notion that a signal’s unique signalness can be completely captured by the infinite set of all of its cumulants.
In this post we are able to take a lot of time, and a lot of words and equations, to get us to a potentially useful algorithm. Now compare what we did here with what I wrote in My Papers [28], which also presents the order-reduced and delay-reduced classifiers. I simply can’t go through all the intermediate steps in a published paper–there is always a severe page limit relative to the writing and equations required by a complicated R&D algorithm-development project.
Extensions
Power-Constrained Classification
The restriction on distinct catalog elements for both the order-reduced and delay-reduced classifiers can be eased if prior information on the signal power is available.
Order-Reduced Classifier with Power Constraint
Since all catalog elements arise from signal models with unit power, the variable represents the power of the received signal. The variable we’ve been calling
is an estimate of the signal power conditioned on hypothesis
–this power estimate is dependent on information contained in the
th hypothesis.
Suppose, though, that we obtain a hypothesis-independent estimate of denoted by
. Then we can use this estimate directly in the classifier, substituting each dependent estimate with the independent one, or we can constrain the decision to be one of the signal-type hypotheses for which the dependent power estimate is close to the independent one,
subject to
We choose the maximum likelihood catalog entry subject to a constraint on the estimated power level; estimated power levels that are too far removed from the independent estimate are grounds for exclusion of the corresponding signal hypotheses.
We have increased our tolerance to similar catalog entries for the order-reduced classifier, but it still fails when two catalog entries are actually identical. Such entries would yield identical dependent power levels, rendering the constraint useless to discriminate between them.
Delay-Reduced Classifier with Power Constraint
We can introduce the same constraint to the delay-reduced classifier to accommodate warped cyclic-cumulant catalog entries that are scaled versions of each other,
subject to
Discussion
The use of the power constraint in the two derived classifiers might seem strange. Why not simply replace the hypothesis-dependent power estimates with the hypothesis-independent power estimate
and compute the likelihoods? This will work just fine, I’ll wager, and is essentially equivalent to the constraint. However, that method will not be available when we generalize the problem to multiple cochannel signals because we can only obtain a hypothesis-independent estimate of the sum of the involved signal powers, not estimates of their individual power levels. That may be a bit strong of a statement. When the signals have different spectral shapes and/or their relative center frequencies are significantly different (so that they only overlap partially spectrally), you might be able to get at power estimates for each signal. But when the signals have similar spectral shapes and their centers are closely spaced, you will just observe a smooth lump of energy in the power spectrum. How much does each signal contribute?
If I give you the sum of two students’ test scores (say, 152), can you tell me the two scores?
Multiple Cochannel Signals
Our cochannel signal model is a simple generalization of our original model (7),
The cochannel model for which the are disjoint in either time or frequency or both reduces to a set of single-signal-in-noise problems of the sort previously considered. This can be accomplished by segmenting the input data in time and frequency using algorithms such as that described in the post on automatic spectral segmentation. So we assume here that the
signals overlap in time and at least partially in frequency so that they cannot be separated by time gating and/or linear time-invariant filtering.
We now develop a sequence of hypothesis-testing problems that parallels the previous single-signal development. In this development, we assume the number of signals is known or estimated prior to signal classification. (In practice, we don’t invoke this assumption. The number of signals is estimated jointly with blind estimation of all the cycle frequencies exhibited by the data.)
In the single-signal case, a hypothesis consisted of the identification of a probability structure for the signal,
We now identify a hypothesis with the selection of a probability structure that incorporates the individual probability structures for each of the constituent signals. Let’s introduce some vector notation here,
where a vector of signals
and is a vector of amplitudes
and denotes a matrix transpose.
We say that has probability structure
,
Problem Thirteen
Our first cochannel-signal hypothesis is simply
We can form equivalent problem statements using either moments or cumulants,
The cumulant formulation is preferred because the cumulant structure of , which contains multiple statistically independent signals, is vastly simpler than the moment structure. This is a consequence of the additive (“cumulants accumulate”) nature of cumulants, which nature the moments do not possess,
Since the signals are presumed to be independent, the cumulants for the sum signal are just the sums of the individual-signal cumulants,
Let’s use the notation to indicate that
for our data signal
. “The data is distributed as a particular (infinite) set of (infinite) sets of cumulants indexed by
.
Problem Fourteen
In this problem, our hypotheses take the form of “the data on hypothesis is distributed as a collection of cumulant sets, one for each signal that is present,”
This is equivalent to the following formulation in terms of temporal cumulant functions,
for and
. Recall that in (78), the
function is a more compact way of writing the temporal cumulant,
Now we need to represent each time-varying cumulant in terms of the cyclic cumulants. We take to be the cumulant for the
th signal when that signal takes on catalog label
. Therefore the cycle frequencies for
depend on
. However, the most interesting and difficult case corresponds to cycle frequencies being dependent on
only, which is similar to our philosophy in the single-signal case. Recall there we deemphasized the situation where each catalog entry depends on the numerical values of the cycle frequencies–so you could detect the cycle frequencies, then simply look up which catalog entry corresponds to those particular numerical values.
Using the Fourier-series decomposition of the time-varying cumulant,
We reformulate the problem using the notation as follows
where ,
.
If, as before, we agree to avoid the “second-order stationary” statistic, that is, we don’t include in our sum, we obtain the next variation on the cochannel problem formulation
where and
.
Because we’ve assumed the noise is stationary and Gaussian, the exclusion of the “second-order stationary” cycle frequency of zero means that no cyclic cumulants for
appear in the problem formulation.
Now we assume that all nonzero cycle frequencies are unique to one signal, and we continue to avoid the second-order cycle frequency of zero. This leads to the problem formulation
where ,
, and
.
The case in which some signals share some or all of their cycle frequencies is treated another time.
Using the spelled-out expression for the function,
and naively assuming that we can estimate the functions with variance independent of
and
, we formulate the next problem variant as
Because the cumulant can grow rapidly with increasing , we propose the nonlinearly transformed version of (84) where each
th-order cyclic cumulant is raised to the power
,
A final helpful modification is to replace the cyclic cumulants with the reduced-dimension cyclic-cumulants,
As before, we will derive the order-reduced and the delay-reduced classifiers. Unlike before, however, we do not assume we have a prior estimate of , only of
, the total combined power of the several involved cochannel signals. This we can do with automatic spectral segmentation and simple power-signal measurements. On the other hand, due to the disjoint nature of the cyclic cumulants (we have imposed by assumption), we can obtain hypothesis-dependent estimates of the individual-signal power levels
. This in turn means we can compare the prior estimate of
with the sum of the hypothesis-dependent power levels, producing a goodness-of-fit relative to power for any particular multiple-signal hypothesis.
Multiple-Signal Order-Reduced Classifier
Restricting the maximum cumulant order to two and computing the likelihoods for the problem variant (87) leads to the multiple-signal ORC,
Â
subject to
which is called the sum-of-powers (SOP) constraint. The SOP constraint says to pick the catalog indices for the elements of such that the sum of the power levels implied by the catalog selections and measured features is close to the measurable power of the non-noise input-signal component.
The multiple-signal order-reduced classifier will fail when some of the catalog entries (the functions, which are the cyclic autocorrelation functions) are identical. This can happen, for instance, for square-constellation digital QAM signals such as QPSK, 16QAM, 64QAM, etc. Therefore we will also need the multiple-signal version of the delay-reduced classifier.
Multiple-Signal Delay-Reduced Classifier
Here we restrict the maximum cumulant order to and the cumulant delay vector to the origin,
. The hypotheses are
subject to the SOP constraint,
If I’ve done my job well here, you should be able to write down the expression for the multiple-signal DRC decision-index-vector estimate. I’ll leave you to it!
Other Extensions
The extension of these ideas and results to complex-valued signals is straightforward. The notation gets even more complicated because we have to consider all relevant conjugation configurations–how many factors are conjugated in the second-, fourth-, and sixth-order cumulants used by the delay-reduced classifier? Symmetry results are useful there.
The cases where two or more cochannel signals share (1) some of their cycle frequencies or (2) all of their cycle frequencies appear in practical settings and are good candidates for generalizing the results. Get to it! Because I’m tired of this post and you are probably tired of it too.
Blind Versus Non-Blind Modulation Recognition
In practice, we often do not know any of the involved signals’ cycle frequencies or modulation types: we are blind to these values. To apply the order-reduced and delay-reduced classifiers, you need to know the cycle frequencies so you can compute the relevant cyclic cumulants from the available data record. Therefore you must find a way to blindly estimate the cycle frequencies. I assert, with the benefit of substantial practical experience implementing these classifiers and applying them to millions of simulated and captured signals, that this is possible.
Closing Remarks
So that’s it. This long post is meant to provide a detailed behind-the-scenes look at the admittedy coarse sketch of results shown in My Papers [28].
Looking back at [28], published in 2000, I find that I did not number the equations. I am not happy with my younger self. But since I can’t easily refer to some of the equations in [28] here, it gives me an opportunity to include a figure, finally, in this post.
Figure 1 shows the order-reduced and delay-reduced classifier expressions as I original published them in [28]. There I’ve reexpressed this post’s (48) in the frequency domain so that the ORC is clearly a spectral-correlation-matching algorithm. I figured the spectral correlation function was likely more familiar to more readers than the cyclic autocorrelation or its cousin the second-order cyclic temporal cumulant.

Have I achieved my goal of showing that complex CSP-based algorithms may appear to be conjured from nothing by some sorcery aided by a dark lore, but are actually often founded on rather dry mathematical facts and logical principled decision-making approaches such as decision theory?
Only you can be the judge of that.