wavelet scattering -凯发k8网页登录

wavelet scattering

a wavelet scattering network enables you to derive, with minimal configuration, low-variance features from real-valued time series and image data for use in machine learning and deep learning applications. the features are insensitive to translations of the input on an invariance scale that you define and are continuous with respect to deformations. in the 2-d case, features are also insensitive to rotations. the scattering network uses predefined wavelet and scaling filters.

mallat, with bruna and andén, pioneered the creation of a mathematical framework for studying convolutional neural architectures [2][3][4][5]. andén and lostanlen developed efficient algorithms for wavelet scattering of 1-d signals [4] [6]. oyallon developed efficient algorithms for 2-d scattering [7]. andén, lostanlen, and oyallon are major contributors to the scatnet [10] and kymatio [11] software for computing scattering transforms.

mallat and others characterized three properties that deep learning architectures possess for extracting useful features from data:

multiscale contractions
linearization of hierarchical symmetries
sparse representations

the wavelet scattering network exhibits all these properties. wavelet transforms linearize small deformations such as dilations by separating the variations across different scales. for many natural signals, the wavelet transform also provides a sparse representation. by combining wavelet transforms with other features of the scattering network described below, the scattering transform produces data representations that minimize differences within a class while preserving discriminability across classes. an important distinction between the scattering transform and deep learning networks is that the filters are defined a priori as opposed to being learned. because the scattering transform is not required to learn the filter responses, you can often use scattering successfully in situations where there is a shortage of training data.

wavelet scattering transform

a wavelet scattering transform processes data in stages. the output of one stage becomes input for the next stage. each stage consists of three operations.

the zeroth-order scattering coefficients are computed by simple averaging of the input. here is a tree view of the algorithm:

the ${ψ_{j, k}}$ are wavelets, $ϕ_{j}$ is the scaling function, and $f$ is the input data. in the case of image data, for each $ψ_{j, k}$ , there are a number of user-specified rotations of the wavelet. a sequence of edges from the root to a node is referred to as a path. the tree nodes are the scalogram coefficients. the scattering coefficients are the scalogram coefficients convolved with the scaling function $ϕ_{j}$ . the set of scattering coefficients are the low-variance features derived from the data. convolution with the scaling function is lowpass filtering and information is lost. however, the information is recovered when computing the coefficients in the next stage.

to extract features from the data, first use waveletscattering (for time series) or (for image data) to create and configure the network. parameters you set include the size of invariance scale, the number of filter banks, and the number of wavelets per octave in each filter bank. in you can also set the number of rotations per wavelet. to derive features from time series, use the waveletscattering object functions or . to derive features from image data, use the waveletscattering2 object functions or .

the scattering transform generates features in an iterative fashion. first, you convolve the data with the scaling function, $f * ϕ_{j}$ to obtain s[0], the zeroth-order scattering coefficients. next, proceed as follows:

take the wavelet transform of the input data with each wavelet filter in the first filter bank.
take the modulus of each of the filtered outputs. the nodes are the scalogram, u[1].
average each of the moduli with the scaling filter. the results are the first-order scattering coefficients, s[1].

repeat the process at every node.

the scatteringtransform function returns the scattering and scalogram coefficients. the featurematrix function returns the scattering features. both outputs can be made easily consumable by learning algorithms, as demonstrated in or .

invariance scale

the scaling filter plays a crucial role in the wavelet scattering network. when you create a wavelet scattering network, you specify the invariance scale. the network is invariant to translations up to the invariance scale. the support of the scaling function determines the size of the invariant in time or space.

time invariance

for time series data, the invariance scale is a duration. the time support of the scaling function does not exceed the size of the invariant. this plot shows the support of the scaling function in a network with an invariance scale of two seconds and a sampling frequency of 100 hz. also shown are the real and imaginary parts of the coarsest-scale wavelet from the first filter bank. observe the time supports of the functions do not exceed two seconds.

the invariance scale also affects the spacings of the center frequencies of the wavelets in the filter banks. in a filter bank created by , the bandpass center frequencies are logarithmically spaced and the bandwidths of the wavelets decrease with center frequency.

in a scattering network, however, the time support of a wavelet cannot exceed the invariance scale. this property is illustrated in the coarsest-scale wavelet plot. frequencies lower than the invariant scale are linearly spaced with scale held constant so that the size of the invariant is not exceeded. the next plot shows the center frequencies of the wavelets in the first filter bank in the scattering network. the center frequencies are plotted on linear and logarithmic scales. note the logarithmic spacing of the higher center frequencies and the linear spacing of the lower center frequencies.

image invariance

for image data, the invariance scale specifies the n-by-n spatial support, in pixels, of the scaling filter. for example, by default the function creates a wavelet image scattering network for the image size 128-by-128 and an invariance scale of 64. the following surface plot shows the scaling function used in the network. the intersecting red lines form a 64-by-64 square.

quality factors and filter banks

when creating a wavelet scattering network, in addition to the invariance scale, you also set the quality factors for the scattering filter banks. the quality factor for each filter bank is the number of wavelet filters per octave. the wavelet transform discretizes the scales using the specified number of wavelet filters.

this plot shows the wavelet filters in the network created by waveletscattering. the invariance scale is one second and sampling frequency is 200 hz. the first filter bank has the default quality value of 8, and the second filter bank has the default quality factor of 1.

for image data, large quality factors are not necessary. large values also result in significant computational overhead. by default creates a network with two filter banks each with a quality factor of 1. this plot shows the wavelet center frequencies for a wavelet image scattering network with two filter banks. the first filter bank has a quality factor of 2, and the second filter bank has a quality factor of 1. the number of rotations per filter bank is 6.

in practice

with the proper choice of wavelets, the scattering transform is nonexpansive. energy dissipates as you iterate through the network. as the order m increases, the energy of the m^th-order scalogram coefficients and scattering coefficients rapidly converges to 0 [3]. energy dissipation has a practical benefit. you can limit the number of wavelet filter banks in the network with a minimal loss of signal energy. published results show that the energy of the third-order scattering coefficients can fall below one percent. for most applications, a network with two wavelet filter banks is sufficient.

consider the tree view of the wavelet time scattering network. suppose that there are m wavelets in the first filter bank, and n wavelets in the second filter bank. the number of wavelet filters in each filter bank do not have to be large before a naive implementation becomes unfeasible. efficient implementations take advantage of the lowpass nature of the modulus function and critically downsample the scattering and scalogram coefficients. these strategies were pioneered by andén, mallat, lostanlen, and oyallon [4] [6] [7] in order to make scattering transforms computationally practical while maintaining their ability to produce low-variance data representations for learning. by default, waveletscattering and create networks that critically downsample the coefficients.

references

[1] lecun, y., b. boser, j. s. denker, d. henderson, r. e. howard, w. hubbard, and l. d. jackel. "handwritten digit recognition with a back-propagation network." in advances in neural information processing systems (nips 1989) (d. touretzky, ed.). 396–404. denver, co: morgan kaufmann, vol 2, 1990.

[2] mallat, s. "group invariant scattering." communications in pure and applied mathematics. vol. 65, number 10, 2012, pp. 1331–1398.

[3] bruna, j., and s. mallat. "invariant scattering convolution networks." ieee transactions on pattern analysis and machine intelligence. vol. 35, number 8, 2013, pp. 1872–1886.

[4] andén, j., and s. mallat. "deep scattering spectrum." ieee transactions on signal processing. vol. 62, number 16, 2014, pp. 4114–4128.

[5] mallat, s. "understanding deep convolutional networks." philosophical transactions of the royal society a. volume 374: 20150203, 2016, pp. 1–16. dx.doi.org/10.1098/rsta.2015.0203.

[6] lostanlen, v. scattering.m — a matlab toolbox for wavelet scattering. https://github.com/lostanlen/scattering.m.

[7] oyallon, edouard. webpage of edouard oyallon. https://edouardoyallon.github.io/.

[8] sifre, l., and s. mallat. "rigid-motion scattering for texture classification". arxiv preprint. 2014, pp. 1–19. https://arxiv.org/abs/1403.1687.

[9] sifre, l., and s. mallat. "rotation, scaling and deformation invariant scattering for texture discrimination." 2013 ieee conference on computer vision and pattern recognition. 2013, pp 1233–1240.

[10] scatnet. https://www.di.ens.fr/data/software/scatnet/.

[11] kymatio. https://www.kymat.io/.

wavelet scattering -凯发k8网页登录