98 results on '"Albert H. Nuttall"'
Search Results
2. Multidimensional probability density function approximations for detection, classification, and model order selection.
- Author
-
Steven M. Kay, Albert H. Nuttall, and Paul M. Baggenstoss
- Published
- 2001
- Full Text
- View/download PDF
3. Bio-Inspired Approach to Quantify Nonlinearities in Time-Series Measurements Using the Nuttall-Wiener-Volterra (NWV) Method
- Author
-
Albert H. Nuttall, Richard A. Katz, Robert M. Koch, and Derke R. Hughes
- Subjects
symbols.namesake ,Signal processing ,Nonlinear system ,Kernel (image processing) ,Dynamical systems theory ,Series (mathematics) ,Computer science ,Gaussian ,symbols ,Algorithm ,Finite element method ,Curse of dimensionality - Abstract
This research offers an additional approach to the increased interest in information theoretic techniques utilized in the Theory of Communications, Electrical Engineering and Signal Processing disciplines for extracting nonlinear behavior in dynamical systems. This new approach was, in part, motivated by a diligent effort to create a man-made system that mimics the sound generation of a cicada. This insect has tremendous sound production capacity for its size. For the Okanagana and Magicicada species studied in this research, these cicadae ranged in size from five to six centimeters and produce sounds that are heard several hundred meters away. The evolution of this new signal processing algorithm from this bio-inspired research is explained in this article. This investigation initially examined the cicada hypothesized nonlinear system, by employing a number of numerical techniques in which to identify nonlinearity in a measurement times series. One such technique, the Nuttall modified-Volterra approach would serve as the validation and verification process for confirming that the inherent artificiality introduced by converting the sound production system of the biologic system to a man-made device did not corrupt the inherent dynamics of the cicada mating call. The technical advantage gained from quantification of the expansion kernels using the Nuttall approach, is the creation of more characterization clues by extending beyond the linear kernel response. This unique method is based on an extension of earlier developments of Vito Volterra and Norbert Wiener. The new Nuttall-Wiener-Volterra (NWV) method identifies the existence of nonlinearity in a measurement time series and determines the power distribution of individual nonlinear components. Moreover, the NWV method, unlike other methods that are likely less computationally efficient due to the Curse of Dimensionality (COD), significantly reduces the computational workload, thereby making characterizations of nonlinear systems with memory at higher orders possible. The nonlinear system kernel responses reveal identification and characterization of linear and nonlinear dynamics contained within the system under investigation. Thus, the nonlinear kernel responses computed for the cicada exposed a critical development for the NWV technique, namely that in order to obtain meaningful NWV kernel responses (i.e., to have physically and mathematically sound computational results), there are restrictive requirements for the system input excitation to be (a) band-limited, (b) white Gaussian and (c) zero mean. By studying the anatomical structures in the cicada sound production system and developing the wave propagation and finite element (FE) models this effort also then attempted an approach to confirm the accuracy of these models by employing the NWV nonlinear (and linear) analysis method.
- Published
- 2019
4. Characterizing bandlimited nonlinear (and linear) systems with memory reducing the curse of dimensionality in new Volterra expansion technique
- Author
-
Richard A. Katz, Robert M. Koch, Albert H. Nuttall, and Derke R. Hughes
- Subjects
Bandlimiting ,Noise ,Nonlinear system ,Computer science ,Kernel (statistics) ,Linear system ,Kernel density estimation ,Applied mathematics ,Curse of dimensionality ,Exponential function - Abstract
This research has developed a mathematical model for characterizing nonlinear systems utilizing the earlier methods of Vito Volterra (1860-1940)1 and later by Norbert Wiener (1894-1964)2. More recently, Albert Nuttall, working with coauthors, has made significant improvements over the earlier methods. These enhancements include kernel estimation using a least-square approach for obtaining a best fit to the measured system response. These techniques, among others, include: maximally-sparse sampling of the kernels (for first-, second- and third-order), combatting ill-conditioning on its own terms, realizing an exponential decrease of the growth of the number of kernel coefficients, capturing frequency content beyond input excitation (transmit) band, and estimating the effects of noise on the kernel responses. Extensions of this theory are relevant to problems in acoustics.
- Published
- 2018
5. Novel procedure for characterizing nonlinear systems with memory: 2017 update
- Author
-
Richard A. Katz, Robert M. Koch, Derke R. Hughes, and Albert H. Nuttall
- Subjects
Nonlinear system ,Signal processing ,Theoretical computer science ,Exponential growth ,Computer science ,Kernel (statistics) ,Waveform ,Least squares ,Algorithm ,Prime (order theory) ,Curse of dimensionality - Abstract
The present article discusses novel improvements in nonlinear signal processing made by the prime algorithm developer, Dr. Albert H. Nuttall and co-authors, a consortium of research scientists from the Naval Undersea Warfare Center Division, Newport, RI. The algorithm, called the Nuttall-Wiener-Volterra or 'NWV' algorithm is named for its principal contributors [1], [2],[ 3] . The NWV algorithm significantly reduces the computational workload for characterizing nonlinear systems with memory. Following this formulation, two measurement waveforms are required in order to characterize a specified nonlinear system under consideration: (1) an excitation input waveform, x(t) (the transmitted signal); and, (2) a response output waveform, z(t) (the received signal). Given these two measurement waveforms for a given propagation channel, a 'kernel' or 'channel response', h= [h 0 ,h 1 ,h 2 ,h 3 ] between the two measurement points, is computed via a least squares approach that optimizes modeled kernel values by performing a best fit between measured response z(t) and a modeled response y(t). New techniques significantly diminish the exponential growth of the number of computed kernel coefficients at second and third order and alleviate the Curse of Dimensionality (COD) in order to realize practical nonlinear solutions of scientific and engineering interest.
- Published
- 2017
6. Effects of random shading, phasing errors and element failures on the beampatterns of line and planar arrays.
- Author
-
Azizul H. Quazi and Albert H. Nuttall
- Published
- 1979
- Full Text
- View/download PDF
7. Bandlimited computerized improvements in characterization of nonlinear systems with memory
- Author
-
Albert H. Nuttall, Derke R. Hughes, Richard A. Katz, and Robert M. Koch
- Subjects
Signal processing ,Nonlinear system ,Exponential growth ,Computer science ,Speech recognition ,Kernel (statistics) ,Waveform ,Least squares ,Algorithm ,Prime (order theory) ,Convolution - Abstract
The present article discusses some inroads in nonlinear signal processing made by the prime algorithm developer, Dr. Albert H. Nuttall and co-authors, a consortium of research scientists from the Naval Undersea Warfare Center Division, Newport, RI. The algorithm, called the Nuttall-Wiener-Volterra 'NWV' algorithm is named for its principal contributors [1], [2],[ 3] over many years of developmental research. The NWV algorithm significantly reduces the computational workload for characterizing nonlinear systems with memory. Following this formulation, two measurement waveforms on the system are required in order to characterize a specified nonlinear system under consideration: (1) an excitation input waveform, x(t) (the transmitted signal); and, (2) a response output waveform, z(t) (the received signal). Given these two measurement waveforms for a given propagation channel, a 'kernel' or 'channel response', h= [h 0 ,h 1 ,h 2 ,h 3 ] between the two measurement points, is computed via a least squares approach that optimizes modeled kernel values by performing a best fit between measured response z(t) and a modeled response y(t). New techniques significantly diminish the exponential growth of the number of computed kernel coefficients at second and third order in order to combat and reasonably alleviate the curse of dimensionality.
- Published
- 2016
8. Nonlinear acoustics in cicada mating calls enhance sound propagation
- Author
-
Derke R. Hughes, Richard A. Katz, Albert H. Nuttall, and G. Clifford Carter
- Subjects
Male ,Sound Spectrography ,Acoustics and Ultrasonics ,Sound transmission class ,Computer science ,Acoustics ,Population ,Models, Biological ,Sonar ,Signal ,Hemiptera ,Motion ,Sexual Behavior, Animal ,Nonlinear acoustics ,Arts and Humanities (miscellaneous) ,Animals ,Quantitative Biology::Populations and Evolution ,education ,Decorrelation ,education.field_of_study ,Signal Processing, Computer-Assisted ,Acoustic wave ,Sound ,Nonlinear Dynamics ,Female ,Vocalization, Animal ,Acoustic resonance - Abstract
An analysis of cicada mating calls, measured in field experiments, indicates that the very high levels of acoustic energy radiated by this relatively small insect are mainly attributed to the nonlinear characteristics of the signal. The cicada emits one of the loudest sounds in all of the insect population with a sound production system occupying a physical space typically less than 3 cc. The sounds made by tymbals are amplified by the hollow abdomen, functioning as a tuned resonator, but models of the signal based solely on linear techniques do not fully account for a sound radiation capability that is so disproportionate to the insect's size. The nonlinear behavior of the cicada signal is demonstrated by combining the mutual information and surrogate data techniques; the results obtained indicate decorrelation when the phase-randomized and non-phase-randomized data separate. The Volterra expansion technique is used to fit the nonlinearity in the insect's call. The second-order Volterra estimate provides further evidence that the cicada mating calls are dominated by nonlinear characteristics and also suggests that the medium contributes to the cicada's efficient sound propagation. Application of the same principles has the potential to improve radiated sound levels for sonar applications.
- Published
- 2009
9. Characterization of nonlinear systems with memory; combatting the curse of dimensionality
- Author
-
Richard A. Katz, Derke R. Hughes, Albert H. Nuttall, and Robert M. Koch
- Subjects
Physics ,Turbulence ,Wave propagation ,Planetary boundary layer ,business.industry ,K-epsilon turbulence model ,Turbulence modeling ,Mechanics ,Atmospheric model ,Boundary layer ,Optics ,Time domain ,business ,Physics::Atmospheric and Oceanic Physics - Abstract
This study investigates laser beam propagation through an atmospheric boundary layer near the ocean surface. Objectives of this research are to ascertain feasibility limits for achieving maximum energy efficiency at extended ranges in the face of atmospheric and other distortions as the laser beam penetrates through transitional (anisotropic) and turbulent (isotropic) boundary layer regimes. Various aspects of turbulence modeling of laser beam propagation near the ocean surface are discussed including: Kolmogorov’s model of atmospheric turbulence, parameterized structure functions (e.g., velocity and temperature gradients, gradients in refractive index) and other important factors affecting near surface propagation such as humidity, aerosols, and wave slap. Various preliminary modeled propagation results are shown, and a new methodology is proposed for improving existing model estimates with new time domain measurement procedures.
- Published
- 2015
10. Novel procedure for characterizing nonlinear systems with memory and combating the curse of dimensionality
- Author
-
Albert H. Nuttall, Richard A. Katz, Robert M. Koch, and Derke R. Hughes
- Subjects
Mathematical optimization ,Nonlinear system ,Kernel (statistics) ,Kernel density estimation ,Design matrix ,Applied mathematics ,Sampling (statistics) ,Uncorrelated ,Exponential function ,Mathematics ,Curse of dimensionality - Abstract
A well-known mathematical model for characterizing nonlinear systems was originally proposed by Vito Volterra (1860-1940) and later developed by Norbert Wiener (1894-1964). More recently, Albert Nuttall, working with coauthors, has made substantial improvements to Wiener’s approach, in which kernel estimates are modeled directly rather than computed from Wiener functionals. Other enhancements made include kernel estimation using a least-square approach for obtaining a best fit to the measured system response, and procedural methods to obtain uncorrelated column-wise basis vectors in the design matrix. These techniques, among others, include: maximally-sparse sampling of the kernels (for first-, second- and third-order), combatting ill-conditioning on its own terms, and realizing an exponential decrease of the growth of the number of kernel coefficients.
- Published
- 2015
11. Highly directional acoustic receivers
- Author
-
Victor M. Evora, Benjamin A. Cray, and Albert H. Nuttall
- Subjects
Acoustics and Ultrasonics ,Acoustics ,Acoustic source localization ,Acoustic wave ,Directivity ,law.invention ,Noise ,Arts and Humanities (miscellaneous) ,law ,Acoustic wave equation ,Cartesian coordinate system ,Particle velocity ,Sound pressure ,Mathematics - Abstract
The theoretical directivity of a single combined acoustic receiver, a device that can measure many quantities of an acoustic field at a collocated point, is presented here. The formulation is developed using a Taylor series expansion of acoustic pressure about the origin of a Cartesian coordinate system. For example, the quantities measured by a second-order combined receiver, denoted a dyadic sensor, are acoustic pressure, the three orthogonal components of acoustic particle velocity, and the nine spatial gradients of the velocity vector. The power series expansion, which can be of any order, is cast into an expression that defines the directivity of a single receiving element. It is shown that a single highly directional dyadic sensor can have a directivity index of up to 9.5 dB. However, there is a price to pay with highly directive sensors; these sensors can be significantly more sensitive to nonacoustic noise sources.
- Published
- 2003
12. Error probabilities for equicorrelated m -ary signals under phase-coherent and phase-incoherent reception.
- Author
-
Albert H. Nuttall
- Published
- 1962
- Full Text
- View/download PDF
13. Minimum rms bandwidth of M time-limited signals with specified code or correlation matrix.
- Author
-
Albert H. Nuttall
- Published
- 1968
- Full Text
- View/download PDF
14. Minimum Gabor bandwidth of M orthogonal signals.
- Author
-
Albert H. Nuttall and Frank Amoroso
- Published
- 1965
- Full Text
- View/download PDF
15. Minimum bandwidth of M signals with specified code or correlation matrix.
- Author
-
Albert H. Nuttall and William B. Floyd
- Published
- 1969
- Full Text
- View/download PDF
16. Directivity factors for linear arrays of velocity sensors
- Author
-
Benjamin A. Cray and Albert H. Nuttall
- Subjects
Physics ,Beamforming ,Acoustics and Ultrasonics ,business.industry ,Acoustics ,Acoustic source localization ,Pressure sensor ,Directivity ,Optics ,Arts and Humanities (miscellaneous) ,Sensor array ,Computer Science::Networking and Internet Architecture ,Particle velocity ,business ,Omnidirectional antenna ,Sound pressure - Abstract
Some of the features unique to beamforming a linear array of acoustic velocity sensors, which are not present with scalar-sensing elements (such as conventional pressure sensors), are described in this paper. Four types of sensors are considered here: a uniaxial motion sensor, which measures acoustic particle velocity along a single axis; a biaxial motion sensor measuring velocity in two orthogonal directions; a triaxial motion sensor that measures all three orthogonal components of the velocity vector; and a sensor, denoted as an acoustic vector sensor, that measures acoustic pressure as well as the complete velocity vector. Comparisons are made of the directivity index for each type of sensor and for linear arrays of sensors. It is shown that uniaxial velocity sensors can have a maximum directivity factor three times greater than an omnidirectional pressure sensor, a gain in directivity index of 4.8 dB. Not surprisingly, this directivity gain is highly dependent on signal arrival direction. Indeed, a un...
- Published
- 2001
17. Characterizing nonlinear systems with memory while combating and reducing the curse of dimensionality using new volterra expansion technique
- Author
-
Robert M. Koch, Derke R. Hughes, Richard A. Katz, and Albert H. Nuttall
- Subjects
Nonlinear system ,Third order ,Acoustics and Ultrasonics ,Arts and Humanities (miscellaneous) ,Kernel (statistics) ,Order (ring theory) ,Waveform ,Algorithm ,Signal ,Least squares ,Mathematics ,Curse of dimensionality - Abstract
A generalized model for characterizing nonlinear systems was originally proposed by Italian mathematician and physicist Vito Volterra (1860-1940). A further development by American mathematician and MIT Professor Norbert Wiener (1894-1964) was published in 1958. After direct involvement with Norbert Wiener publication, Albert H. Nuttall has recently made new inroads along with his coauthors in applying the Wiener-Volterra model. A general description of a nonlinear system to the third order is termed the Nuttall-Wiener-Volterra model (NWV) after its co-founders. In this formulation, two measurement waveforms on the system are required in order to characterize a specified nonlinear system under consideration: an excitation input, x(t) (the transmitted signal) and a response output, z(t) (the received signal). Given these two measurement waveforms for a given system, a kernel response, h= [h0,h1,h2,h3] between the two measurement points, is computed via a least squares approach that optimizes modeled kernel...
- Published
- 2016
18. Adaptive beamforming at very low frequencies in spatially coherent, cluttered noise environments with low signal-to-noise ratio and finite-averaging times
- Author
-
Albert H. Nuttall and James H. Wilson
- Subjects
Physics ,Beamforming ,Noise ,Signal-to-noise ratio ,Acoustics and Ultrasonics ,Arts and Humanities (miscellaneous) ,Covariance matrix ,Acoustics ,Very low frequency ,Interference (wave propagation) ,Sonar signal processing ,Adaptive beamformer ,Computer Science::Information Theory - Abstract
Realistic simulations with spatially coherent noise have been run in order to compare the performance of adaptive beamforming (ABF), inverse beamforming (IBF), and conventional beamforming (CBF) for the case of finite-averaging times, where the actual spatial coherence of the acoustic field, or covariance matrix, is not known a priori, but must be estimated. These estimation errors cause large errors in the ABF estimate of the directionality of the acoustic field, partly because ABF is a highly nonlinear algorithm. In addition, it is shown that ABF is fundamentally limited in its suppression capability at very low frequency (VLF), based on the sidelobe level of the conventional beampattern in the direction of the noise interferer [G. L. Mohnkern, "Effects of Errors and Limitations on Interference Suppression," NOSC Technical Document 1478, Naval Ocean Systems Center (1989)]. The simulations include a low-level plane wave signal of interest, a stronger noise plane wave interferer, and spatially random background noise. Both IBF and ABF performed significantly better than CBF, and IBF's performance was slightly better than ABF's performance. The performances of IBF and the ABF algorithm, the minimum variance distortionless response (MVDR) [A. H. Nuttall and D. W. Hyde, "Unified Approach to Optimum and Suboptimum Processing for Arrays," USL Report Number 992, Naval Underwater Systems Center, New London, CT (22 April 1969)] were recently compared independently [J. S. D. Solomon, A. J. Knight, and M. V. Greening, "Sonar Array Signal Processing for Sparse Linear Arrays," Defense Science and Technology Organization (DSTO) Technical Report (June 1999)] using measured data, with the result that IBF outperformed MVDR. This result is significant because MVDR requires orders of magnitude more processing power than IBF or CBF.
- Published
- 2000
19. Free-Wave Dispersion Curves of a Multi-Supported String
- Author
-
Benjamin A. Cray, Albert H. Nuttall, and Andrew J. Hull
- Subjects
Physics ,Classical mechanics ,General Engineering ,String (physics) - Abstract
Free-wave propagation of an infinite, tensioned string, supported along its length by repeating segments of multiple spring-mass connections, is examined. The segments can consist of an arbitrary number of different support sets and be of any overall length. Periodicity is intrinsic, since the segments repeat; the goal, though, is to examine what effect variations within the segments have on dispersion. The formulation reveals an unexpected amount of complexity for such a simply posed system. Each support set has independent mass, stiffness, and viscous damping, and the sets are allowed to be offset from one another. A free-wave dispersion formula is derived for two sets of supports (Q = 2) and compared to the well-known ideally periodic expression (Q = 1). A means to obtain general dispersion formulas, for any Q, is discussed. It is shown that the systems’ dispersion curves are primarily governed by the material properties of the string and by the location of the supports.
- Published
- 2011
20. Estimation of the acoustic field directionality by use of planar and volumetric arrays via the Fourier series method and the Fourier integral method
- Author
-
James H. Wilson and Albert H. Nuttall
- Subjects
Beamforming ,Physics ,Acoustics and Ultrasonics ,business.industry ,Discrete-time Fourier transform ,Acoustics ,Fast Fourier transform ,symbols.namesake ,Optics ,Fourier transform ,Arts and Humanities (miscellaneous) ,Sensor array ,Fourier analysis ,Discrete Fourier series ,symbols ,business ,Fourier series - Abstract
The possibility of estimating the directionality of a stationary homogeneous noise field, directly from the element outputs of a line array, is investigated and found to be feasible for large arrays without encountering ill conditioning. This technique, called inverse beamforming for historical reasons, is applicable to line and planar as well as volumetric arrays, and requires no more than two‐dimensional fast Fourier transforms (FFTs) for its realization. Derivations and results are presented both for a Fourier series method and a Fourier integral method.
- Published
- 1991
21. Stability Analysis of a Tensioned String With Periodic Supports
- Author
-
Benjamin A. Cray, Andrew J. Hull, and Albert H. Nuttall
- Subjects
Forcing (recursion theory) ,Plane (geometry) ,Mathematical analysis ,Plane wave ,C++ string handling ,Pole–zero plot ,Wavenumber ,Geometry ,String resonance ,Transfer function ,Mathematics - Abstract
This report analyzes the zero-pole locations of an infinite length of tensioned string that has attached periodic supports. The dynamic response of the system is derived for distributed wave number forcing and discrete point forcing acting on the string. These wave number-frequency transfer functions are then written in zero-pole format by a mathematical transformation of their infinite series. Once this is accomplished, the locations of the system's poles and zeros become apparent, and they can be plotted in the wave number frequency plane. It is shown that there are specific regions where an infinite number of poles can exist and specific regions where poles cannot exist. For the system with wave number forcing, the system zeros correspond very closely to the system poles except in the area of the fundamental unsupported string resonance. For the system with point forcing, the zeros can exist in the entire wave number frequency plane except at the fundamental resonance. A numerical example is included, and the different zones of the system are demonstrated.
- Published
- 2007
22. Noise suppression using the coherent onion peeler
- Author
-
James H. Wilson, Robert A. Prater, and Albert H. Nuttall
- Subjects
Beamforming ,Physics ,Signal processing ,Models, Statistical ,Acoustics and Ultrasonics ,Fourier Analysis ,Noise reduction ,Acoustics ,Fast Fourier transform ,Adaptive filter ,Noise ,Signal-to-noise ratio ,Arts and Humanities (miscellaneous) ,Humans ,Underwater acoustics - Abstract
An innovative noise suppression algorithm, called the coherent onion peeler (COP) (patent detained) is derived by minimizing the error in the coherent subtraction of the data from a single plane wave model. The COP solution "collapses" for all beamforming algorithms to the same solution at the complex hydrophone FFT level. Thus, any beamformer can be applied to the residual FFTs after the COP has been applied. The COP is applied to the strongest interferer first and the residual FFTs represent the acoustic field with this interferer coherently "peeled back" like the outer skin of an onion. This procedure can be repeated any number of times to coherently suppress the noise from all interferers present. A new nonadaptive beamformer is developed that "blends" together the best beam pattern properties of conventional beamforming (CBF) near array design frequency and the generalized fourier integral method (GFIM) at very low frequencies (VLF). In between these frequency extremes, the GFIM-CBF Blend (patent pending) (G-C Blend) is a frequency-dependent weighted average of both individual beamformers. COP and G-C Blend are applied to the broadband noise emitted by the tow ship, which severely degrades the performance of the towed array; COP reduced this broadband noise by over 19 dB in a single pass.
- Published
- 2007
23. Second-Order Statistics of Spectral and Correlation Estimates Obtained by Means of Weighted Overlapped FFT Processing
- Author
-
Albert H. Nuttall
- Subjects
Correlation ,symbols.namesake ,Signal processing ,Stationary process ,Gaussian ,Order statistic ,Fast Fourier transform ,Statistics ,symbols ,Function (mathematics) ,Algorithm ,Weighting ,Mathematics - Abstract
Closed-form relations have been obtained for the covariances of the spectral estimates, as well as the correlation estimates, that result from weighted overlapped FFT processing of a stationary process with Gaussian characteristics. In particular, estimates that result from time-displaced overlapped data segments and different frequency bins have been considered. The effects of wraparound in the time-delay domain of the correlation estimates have also been incorporated. The fundamental parameters of the study are the weighting segment length K, the amount of lag L, and the FFT size N, as well as the input data correlation function C(k) and the particular weighting sequence w(k).
- Published
- 2005
24. Evaluation of the Generalized QM Function for Complex Arguments
- Author
-
Albert H. Nuttall
- Subjects
Loss of significance ,Arithmetic underflow ,Matched filter ,Calculus ,Method of steepest descent ,Applied mathematics ,Probability density function ,Function (mathematics) ,Remainder ,Methods of contour integration ,Mathematics - Abstract
Several possibilities for computing the generalized Q(sub M) (a, b) function for complex arguments a, b are presented and evaluated. Each approach has some limitations, such as loss of significance or complicated steepest paths of descent in an integral evaluation. However, a procedure is derived that will retain significance for all values of the parameters a, b, while avoiding underflow or overflow, and the procedures has been automated. The need for this function arises when the joint probability density function of the M- 1 largest squared envelopes of a matched filter output, plus the sum of the remainder, is considered. In particular, a Bromwich contour integral repeatedly utilizes this function in its evaluation.
- Published
- 2005
25. Saddlepoint Approximations for the Combined Probability and Joint Probability Density Function of Selected Order Statistics and the Sum of the Remainder
- Author
-
Albert H. Nuttall
- Subjects
Joint probability distribution ,Mathematical analysis ,Sum of normally distributed random variables ,Probability distribution ,Illustration of the central limit theorem ,Moment-generating function ,Marginal distribution ,Convolution of probability distributions ,Random variable ,Mathematics - Abstract
A set of N independent random variables ?Xn! with arbitrary probability density functions (pn(X)! are ordered into a new set of dependent random variables, each with a different probability density function. From this new set, the M - I largest random variables are selected. Then, the sum of the remaining N + I - M random variables is computed, giving a total of M dependent random variables. Several statistics have been computed for these M random variables, including their joint probability density function and a quantity called the "combined probability and joint probability density function" of particular selections. Most of the results can be expressed in terms of a single Bromwich contour integral in the moment-generating domain. A saddlepoint approximation and first-order correction term are derived for this contour integral and then applied to several typical examples. Actual numerical calculation of these saddlepoint approximations requires evaluation of several functions that have high-order removable singularities, thereby requiring power series expansions near these removable singularities. Expansions with 13 to 14 decimal-digit accuracy have been derived and programmed for this purpose.
- Published
- 2004
26. Joint Probability Density Function of Selected Order Statistics and the Sum of the Remainder as Applied to Arbitrary Independent Random Variables
- Author
-
Albert H. Nuttall
- Subjects
Joint probability distribution ,Mathematical analysis ,Sum of normally distributed random variables ,Illustration of the central limit theorem ,Conditional probability distribution ,Marginal distribution ,Moment-generating function ,Convolution of probability distributions ,Random variable ,Mathematics - Abstract
A set of N independent random variables (Xn! with arbitrary probability density functions ?pn(x)! are ordered into a new set of dependent random variables, each with a different probability density function. From this latter set, the M-1 largest random variables are selected. Then, the sum of the remaining N + 1 - M random variables is computed, giving a total of M dependent random variables. Several statistics are computed for these M random variables, including their joint probability density function, a quantity called the "combined probability and joint probability density function" of particular selections, and their distribution. Most of the results can be expressed as a single Bromwich contour integral in the moment-generating domain. This integral is most easily numerically evaluated by locating (approximately) the real saddlepoint of the integrand and passing the contour through that point. Very high accuracy in the joint probability density function evaluations is available by using numerical integration on this latter contour, instead of a saddlepoint approximation.
- Published
- 2003
27. Combined Linear and Nonlinear Modeling of Data
- Author
-
Albert H. Nuttall
- Subjects
Hessian matrix ,Nonlinear system ,Hessian equation ,Mathematical optimization ,symbols.namesake ,Sesquilinear form ,Linear system ,symbols ,Linearity ,Applied mathematics ,Partial derivative ,Mathematics ,Curse of dimensionality - Abstract
A method is presented for reducing the dimensionality of the search space when some of the unknown parameters appear linearly in the model fit. After elimination of the linear parameters, the gradient vector and the Hessian matrix of the resultant Hermitian form are derived so that an efficient minimization procedure can be developed in multiple dimensions. A 'destabilizing' term is identified in the Hessian matrix and can be dropped from the calculations if desired. This approach is expected to be more reliable; it also does not require any second-order partial derivatives, leading to fewer computations for finding the minimum in the multidimensional search space.
- Published
- 2003
28. Locating an Appropriate Saddlepoint for M-Dimensional Probability Integrals
- Author
-
Albert H. Nuttall
- Subjects
Hessian matrix ,symbols.namesake ,Laplace transform ,Numerical analysis ,Joint moment ,Mathematical analysis ,Generating function ,symbols ,Two-sided Laplace transform ,Inverse Laplace transform ,Probability density function ,Mathematics - Abstract
The evaluation of the joint probability density function from the joint moment generating function involves an M-dimensional inverse laplace transform. The analytic and numerical difficulty of performing this task for large values of M prompts consideration of an approximate technique such as the saddlepoint method. Advantage can be taken of the fact that the joint probability density function is real and positive, to show that the dominant saddlepoint in the original region of analyticity of the joint moment generating function is on the real axes. Furthermore, inside this region of analyticity, the integrand of the inverse Laplace transform has a positive-definite Hessian matrix on these real axes, indicating a single minimum for the saddlepoint location, when it exists. These properties serve to reduce the numerical effort required to locate the dominant M-dimensional saddlepoint. Examples of some statistical problems where this issue is of importance are included.
- Published
- 2002
29. Model-Based Array Processing
- Author
-
Albert H. Nuttall and Andrew J. Knight
- Subjects
Beamforming ,Engineering ,Amplitude ,Optics ,business.industry ,Linear arrays ,Plane wave ,Array processing ,business ,Sonar ,Algorithm ,Total error ,Coding (social sciences) - Abstract
This report discusses an array processing technique that allows optimal source amplitudes and arrival angles to be determined from the data received on arbitrary arrays. Used with either a one- or two-planewave fit to arbitrarily spaced linear arrays, the method shows superior performance to conventional beamforming when more than one source is present within the angular resolution of the array. With such situations becoming more and more likely as operating frequencies are driven to lower values, in an effort to increase detection ranges, this new approach can be used to coherently subtract strong arrivals from received data, allowing the detection of additional weak arrivals in close angular proximity. In the case where a planewave arrives at an arbitrary two-dimensional array from a moving source, a similar technique yields optimal values of the source amplitudes of the planewave, as well as the starting and ending positions of the moving source. The new processing thus performs the functions of a combined beamformer and tracker in such a way that the total error over the observation interval is minimized.
- Published
- 2002
30. Joint Probability Density Function of Selected Order Statistics and the Sum of the Remaining Random Variables
- Author
-
Albert H. Nuttall
- Subjects
Combinatorics ,Multivariate random variable ,Cumulative distribution function ,Sum of normally distributed random variables ,Random element ,Applied mathematics ,Illustration of the central limit theorem ,Marginal distribution ,Moment-generating function ,Random variable ,Mathematics - Abstract
A set of N independent, identically distributed random variables ?X(sub n)), with common probability density function p(x), are ordered into a new set of dependent random variables ?X'(sub n)), each with a different probability density function. From this latter set, the n1-th largest random variable through the n(sub M-1)-th largest random variable are selected. Then, the sum of the remaining N+1-M random variables is computed, giving a total of M dependent random variables. The joint probability density function of these M random variables is derived in a form involving a single Bromwich contour integral in the moment-generating function domain. The integral is most easily numerically evaluated by locating (approximately) the real saddlepoint of the integrand and passing the contour through this point. Very high accuracy in the probability density function evaluation is available by using numerical integration instead of a saddlepoint approximation.
- Published
- 2002
31. Joint Distributions for Two Useful Classes of Statistics, With Applications to Classification and Hypothesis Testing
- Author
-
Albert H. Nuttall and Paul M. Baggenstoss
- Subjects
Discrete wavelet transform ,symbols.namesake ,Joint probability distribution ,Gaussian ,Autocorrelation ,Statistics ,Order statistic ,symbols ,Random variable ,Gaussian process ,Discrete Fourier transform ,Mathematics - Abstract
In this paper, we analyze the statistics of two general classes of statistics. The first class is "M quadratic and linear forms of correlated Gaussian random variables". Examples include both cyclic and non-cyclic autocorrelation function (ACF) estimates of a correlated Gaussian process or the magnitude-squared of the output samples of a filtered Gaussian process. The second class consists of a subset of order statistics together with a remainder term. An example is the largest M - 1 bins of a discrete Fourier transform (DFT) or discrete wavelet transform (DWT), together with the sum of the remaining energies, forming an M-dimensional statistic. Both classes of statistics are useful in classification and detection of signals. In this paper, we solve for the joint probability density functions (PDFs) of both classes. Using the PDF projection method, these results can be used to transform the feature PDFs into the corresponding high-dimensional PDFs of the raw input data.
- Published
- 2002
32. Saddlepoint Approximations for Various Statistics of Dependent, Non-Gaussian Random Variables: Applications to the Maximum Variate and the Range Variate
- Author
-
Albert H. Nuttall
- Subjects
Uniform distribution (continuous) ,Random variate ,Joint probability distribution ,Cumulative distribution function ,Statistics ,Order statistic ,Marginal distribution ,Moment-generating function ,Random variable ,Mathematics - Abstract
The determination of the statistics of a set of random variables (RVs) is frequently achieved by assuming the RVs to be joint Gaussian or to be statistically independent of each other. Although this assumption greatly simplifies the analysis, it can lead to very misleading probability measures, especially on the tails of the distributions, where the exact details of the particular RVs can be important This report presents a new method for deriving saddlepoint approximations (SPAS) for a number of very useful statistics of a general set of M dependent RVs, including the joint moments, the joint cumulative distribution function (CDF), the joint exceedance distribution function (EDF), and the joint probability density function (PDF). In particular, application to the maximum RV of a set of M dependent non-Gaussian RVs will be thoroughly investigated for two different examples. Also, the statistics of the range variate (maximum - minimum) are determined for the same two examples. The calculation of these M-dimensional statistics sometimes requires that multiple M-dimensional SPs be determined in order to evaluate an EDF or PDF at a single point in probability space. Also, the storage requirements and/or execution times can rapidly grow unmanageable as the number of dimensions, M, increases. Finally, care must be taken to ensure that the SP is located in the correct region of M-dimensional space; this allowed region of analyticity varies with the particular statistic under investigation.
- Published
- 2001
33. Detection Performance of Or-ing Device with Pre- and Post-Averaging: Part III - Deterministic Signal
- Author
-
Albert H. Nuttall
- Subjects
Operating point ,symbols.namesake ,Signal processing ,Signal-to-noise ratio ,Receiver operating characteristic ,Gaussian noise ,Computer science ,Statistics ,symbols ,Range (statistics) ,False alarm ,Signal ,Algorithm - Abstract
The detection performance of an or-ing device with pre-averaging and post-averaging has been determined in the form of numerous receiver operating characteristics covering a wide range of input deflections (signal-to-noise ratios). Numerical evaluation of the false alarm probability P(sub f) and detection probability P(sub d) has been conducted for the case of a deterministic signal in the presence of additive Gaussian noise for a wide range of values of K, the amount of pre-averaging before or-ing; N, the number of channels or-ed; and M, the amount of post-averaging after or-ing. A MATLAB program that can be used to extend these results to parameter values outside the range studied here is also provided. The tradeoffs associated with switching from post-averaging to pre-averaging, or vice versa, have been thoroughly investigated and tabulated for a standard operating point (P(sub f) = 1 E-3, P(sub d) = 0.5) and for a high-quality operating point (P(sub f) = 1 E-6, P(sub d) = 0.9). The losses associated with performing too little pre-averaging can be severe, especially for large numbers, N, of or-ed channels.
- Published
- 2000
34. Detection Performance of Or-ing Device with Pre- and Post-Averaging: Part II- Phase-Incoherent Signal
- Author
-
Albert H. Nuttall
- Subjects
Signal processing ,symbols.namesake ,Operating point ,Signal-to-noise ratio ,Receiver operating characteristic ,Gaussian noise ,Computer science ,Statistics ,Range (statistics) ,symbols ,Probability density function ,Algorithm ,Random variable - Abstract
The detection performance of an or-ing device with pre-averaging and post-averaging has been determined in the form of numerous receiver operating characteristics covering a wide range of input signal-to-noise ratios. Numerical evaluation of the false alarm probability P(sub f) and detection probability P(sub d) has been conducted for the case of a phase-incoherent signal in the presence of additive Gaussian noise for a wide range of values of K, the amount of pre-averaging before or-ing; N, the number of channels or-ed; and M, the amount of post-averaging after or-ing. A MATLAB program that can be used to extend these results to parameter values outside the range studied here is also listed. The tradeoffs associated with switching from post-averaging to pre-averaging, or vice-versa, have been thoroughly investigated and tabulated for a standard operating point (P(sub f) = 1E-3, P(sub d) = 0.5) and for a high-quality operating point (P(sub f) = 1E-6, P(sub d) = 0.9). The losses associated with doing too little pre-averaging can be severe, especially for large numbers, N, of or-ed channels.
- Published
- 1999
35. Detection Performance of Or-ing Device with Pre- and Post-Averaging: Part I - Random Signal
- Author
-
Albert H. Nuttall
- Subjects
Operating point ,symbols.namesake ,Signal processing ,Signal-to-noise ratio ,Receiver operating characteristic ,Gaussian noise ,Computer science ,Statistics ,Range (statistics) ,symbols ,Probability density function ,Random variable ,Algorithm - Abstract
The detection performance of an or-ing device with pre-averaging and post-averaging has been determined in the form of numerous receiver operating characteristics covering a wide range of input signal-to-noise ratios. Numerical evaluation of the false alarm probability P(sub f) and detection probability P(sub d) has been conducted for the case of a random Gaussian signal in the presence of additive Gaussian noise, for a wide range of values of K, the amount of pre-averaging before or-ing; N, the number of channels or-ed; and M, the amount of post-averaging after or-ing. Also, a MATLAB program is listed that can be used to extend these results to parameter values outside the range studied here. The tradeoffs associated with switching from post-averaging to pre-averaging, or vice-versa, have been thoroughly investigated and tabulated for a standard operating point P(sub f) = 1 E-3, P(sub d) = 0.5, and for a high-quality operating point P(sub f) = 1 E-6, P(sub d) = 0.9. The losses associated with doing too little pre-averaging can be severe, especially for large numbers, N, of or-ed channels.
- Published
- 1999
36. Methods to Extract Information from Noisy Data
- Author
-
Albert H. Nuttall
- Subjects
Structure (mathematical logic) ,Signal processing ,Computer science ,Code (cryptography) ,Detection theory ,False alarm ,Data mining ,computer.software_genre ,Noisy data ,computer - Abstract
The long-term goal of this project is to detect weak random signals that have little or no known structure. Furthermore, this is intended to be accomplished in near-optimum fashion with practical realistic processor forms. The major scientific objective of this investigation is to maximize the processor s signal detection probability while maintaining a specified (low) false alarm probability. Furthermore, the losses of practical processors are to be compared with the fundamental detection limits possible in the noisy environment of interest. This work is supported by ONR Biological Oceanography (Code 322BC).
- Published
- 1997
37. Evaluation of Small Tail Probabilities Directly from the Characteristic Function
- Author
-
Albert H. Nuttall
- Subjects
Mathematical optimization ,symbols.namesake ,Fourier transform ,Q-function ,Characteristic function (probability theory) ,Discrete-time Fourier transform ,symbols ,Probability density function ,Statistical physics ,Moment-generating function ,Random variable ,Rectangular function ,Mathematics - Abstract
An efficient, fast, and accurate Fourier transform technique for obtaining small tail probabilities for both the probability density function and the exceedance distribution function, directly from the characteristic function, is derived and demonstrated numerically for several examples. The method is especially useful when analytic or asymptotic expressions for the probabilities are unavailable or unknown. By choosing the shift parameter r close to the highest singularity of the characteristic function in the complex plane, very small values of the tail probabilities of the density function and exceedance distribution function can be realized. The cost in this approach is that the sampling increment must then be taken small, in order to avoid aliasing. Finer sampling necessitates more computer time and effort, but it does not require more storage; rather, prealiasing can be advantageously employed to keep the fast Fourier transform size at reasonable values. The fast Fourier transform size has no effect upon the errors caused by aliasing and truncation; rather, the size merely controls the spacing at which the probability density function and exceedance distribution function outputs are calculated. Tail probabilities in the E-50 range are readily available with a computer limited to 15 significant decimal digits.
- Published
- 1997
38. Detection Capability of Linear-and-Power Processor for Random Burst Signals of Unknown Location
- Author
-
Albert H Nuttall
- Subjects
Signal processing ,Noise (signal processing) ,Real-time computing ,Range (statistics) ,Detection theory ,Interval (mathematics) ,Algorithm ,Signal ,Bin ,Power (physics) ,Mathematics - Abstract
A random signal (if present) is located somewhere in a time interval characterized by a total of N search bins, along with uniform noise. The signal is burst-like and occupies a contiguous set of M bins, but the location of the M bins occupied by the signal is unknown. Also, the average signal level S in an occupied bin is arbitrary and unknown. The optimum (likelihood ratio) processor for this scenario is derived and simulated to determine its receiver operating characteristics. Practical approximations to this likelihood ratio processor lead to a class of suboptimum processors, called the linear-and-power (LAP) processors, that have a control parameter mu that can be varied for best signal detection capability. Simulations of various LAP processors reveal that near-optimum performance can be achieved by letting the control parameter mu tend to infinity; the resultant processor, called the Maximum processor, compares the maximum of all possible partial contiguous linear sums of the observations with a fixed threshold. For search size N = 1024, the loss in detectability of the Maximum processor relative to the unrealizable likelihood ratio processor is less than 0.1 dB over the complete range of values of M, the signal burst size.
- Published
- 1997
39. Approximations to Directivity for Linear, Planar, and Volumetric Apertures and Arrays
- Author
-
Benjamin A. Cray and Albert H. Nuttall
- Published
- 1997
40. Performance of Power-Law Processor with Normalization for Random Signals of Unknown Structure
- Author
-
Albert H. Nuttall
- Subjects
Normalization (statistics) ,Background noise ,Noise spectral density ,Statistics ,Probability density function ,False alarm ,White noise ,Noise floor ,Algorithm ,Bin ,Mathematics - Abstract
A signal (if present) is located somewhere in a band of frequencies characterized by a total of N search bins, along with uniform noise of unknown level per bin, N. The signal occupies an arbitrary set of N of these bins, where not only is the extent N unknown, but, in addition, the locations of the particular N bins occupied by the signal (if present) are unknown. Also, the average signal level in an occupied bin, S, is arbitrary and unknown. In order to realize a specified false alarm probability, the power-law processor has been normalized by division with an estimate of the noise level, either from a noise only reference or from the measured data itself. Various combinations of normalizer forms have been investigated quantitatively through their receiver operating characteristics. It has been found that if the number of bins, M, occupied by the signal is small relative to the search size N, the additional signal-to-noise ratio required by the normalizer, in order to maintain the standard operating point, is not significant. However, if M is of the order of N/4 or larger, the degradations begin to become substantial. A partial remedy for the inherent losses caused by an unknown noise level is the use of a noise-only data reference, if available. However, eventually, as M increases and tends to N, the detection situation becomes progressively more difficult, finally becoming impossible. This is not a limit of the normalized power-law processor, but, rather, of the fact that detection of a white signal in white noise of unknown level is a theoretical impossibility.
- Published
- 1997
41. Near-Optimum Detection Performance of Power-Law Processors for Random Signals of Unknown Locations, Structure, Extent, and Arbitrary Strengths
- Author
-
Albert H. Nuttall
- Subjects
Signal processing ,Noise (signal processing) ,Bounding overwatch ,Electronic engineering ,False alarm ,Power law ,Signal ,Algorithm ,Bin ,Power (physics) ,Mathematics - Abstract
A signal (if present) is located somewhere in a band of frequencies characterized by a total of N search bins with uniform noise normalized to unit power. The signal occupies an arbitrary set of M of these bins, where not only is extent M unknown, but in addition, the locations of the particular M occupied bins are unknown. Also, the average signal strengths per bin, ?S sub m!for 1
- Published
- 1996
42. Detection performance of power-law processors for random signals of unknown location, structure, extent, and strength
- Author
-
Albert H. Nuttall
- Subjects
Signal processing ,Signal-to-noise ratio ,Noise (signal processing) ,Electronic engineering ,Range (statistics) ,Probability density function ,Detection theory ,False alarm ,Power law ,Algorithm ,Mathematics - Abstract
A signal (if present) is located somewhere in a band of frequencies characterized by a total of N search bins. The signal occupies an arbitrary set of M_ of these bins, where not only is M_ unknown, but also, the locations of the particular M_ occupied bins are unknown. Also, the signal strength is unknown. A class of processors, called the power‐law processors, is investigated, in which the available data is raised to the ν‐th power prior to summation over all data values. The receiver operating characteristics have been determined for values of power ν=1, 2, 2.5, 3, ∞ for a wide range of values of M_. These results allow for accurate extraction of required signal‐to‐noise ratios to achieve a specified level of performance, as measured by the false alarm and detection probabilities, Pf and Pd. One of the most surprising and useful results of this study is the discovery that the power‐law processor with ν=2.4 performs near the absolute optimum, even without any knowledge of the number of occupied bins M_ or the signal‐to‐noise ratio.
- Published
- 1996
43. Some integrals involving the QM function (Corresp.).
- Author
-
Albert H. Nuttall
- Published
- 1975
- Full Text
- View/download PDF
44. Efficient evaluation of polynomials and exponentials of polynomials for equispaced arguments.
- Author
-
Albert H. Nuttall
- Published
- 1987
- Full Text
- View/download PDF
45. Exact Detection Performance of Normalizer With Multiple-Pulse Frequency- Shift-Keyed Signals in a Partially-Correlated Fading Medium With Generalized Noncentral Chi-Squared Statistics
- Author
-
Albert H. Nuttall
- Subjects
Signal processing ,Characteristic function (probability theory) ,Matched filter ,Ambient noise level ,Statistics ,Fading ,False alarm ,Series expansion ,Centralizer and normalizer ,Mathematics - Abstract
The detection and false alarm probabilities, for a normalizer operating in a partially-correlated fading medium with an additive unknown noise level, are derived exactly in the form of series expansions which can be quickly and accurately computed. This new work is an extension of (1), where the characteristic function of the decision variable, for a system operating in a known background noise level, was derived exactly and evaluated for a variety of cases. These new results also replace the approximate analysis of the same normalizer system, that was conducted in (2), with an exact analysis here.
- Published
- 1993
46. Broadband Detection and Classification of Underwater Sources
- Author
-
Azizul H. Quazi and Albert H. Nuttall
- Subjects
Engineering ,Narrowband ,Exploit ,business.industry ,Acoustics ,Broadband ,Ambient noise level ,Electronic engineering ,Underwater ,business ,Sonar ,Signal - Abstract
The radiated signals from sources are of great importance for passive sonar, which is designed to exploit peculiarities of this form of signal and distinguish it from ambient noise, in which it is normally observed. The radiated signals usually consist of both narrowband and broadband components. In this paper, we describe techniques that exploit the broadband signals for detection and possible classification of the underwater sources.
- Published
- 1993
47. On the envelopes of zonal filter outputs of memoryless distortions of narrow-band processes (Corresp.).
- Author
-
Albert H. Nuttall
- Published
- 1965
- Full Text
- View/download PDF
48. High-order covariance functions for complex Gaussian processes (Corresp.).
- Author
-
Albert H. Nuttall
- Published
- 1962
- Full Text
- View/download PDF
49. Comparison of two kernels for the modified Wigner distribution function
- Author
-
Albert H. Nuttall and Chintana Griffin
- Subjects
Mathematical optimization ,Computer science ,Wigner semicircle distribution ,Filter (signal processing) ,Kernel (linear algebra) ,symbols.namesake ,Fourier transform ,Distribution function ,Variable kernel density estimation ,Kernel embedding of distributions ,Kernel (statistics) ,Gaussian function ,symbols ,Wigner distribution function ,Gabor–Wigner transform ,Algorithm - Abstract
We compare the modified Wigner distribution functions obtained via the Choi-Williams kernel and its rotation, as well as by the tilted Gaussian kernel. Based on several commonly used examples, we demonstrate that the modified Wigner distribution obtained via the Gaussian kernel can minimize the artifacts more effectively and has the capability of selectively filtering out undesired components.© (1991) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.
- Published
- 1991
50. Spectra and Covariances for 'Classical' Nonlinear Signal Processing Problems Involving Class A Non-Gaussian Noise
- Author
-
David Middleton and Albert H Nuttall
- Subjects
Noise measurement ,Stochastic resonance ,Noise (signal processing) ,MathematicsofComputing_NUMERICALANALYSIS ,White noise ,Multiplicative noise ,symbols.namesake ,Additive white Gaussian noise ,Gaussian noise ,Electronic engineering ,symbols ,Value noise ,Statistical physics ,Mathematics - Abstract
Because of the critical role of non-Gaussian noise processes in modern signal processing, which usually involves nonlinear operations, it is important to examine the effects of the latter on such noise and the extension to added signal inputs. Here, only non-Gaussian (specifically Class A) noise inputs, with an additive Gaussian component, are considered. The 'classical' problems of zero-memory nonlinear (ZMNL) devices serve to illustrate the approach and to provide a variety of useful output statistical quantities, e.g., mean or dc values, mean intensities, covariances, and their associated spectra. Here, Gaussian and non-Gaussian noise fields are introduced, and their respective temporal and spatial outputs are described and numerically evaluated for representative parameters of the noise and the ZMNL devices.
- Published
- 1991
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.