Fourier series: Difference between revisions

Source: Wikipedia, the free encyclopedia.
Content deleted Content added
Tags: Mobile edit Mobile web edit Advanced mobile edit
a bit of reorganization, discussed on Talk page
Line 2: Line 2:
{{Fourier transforms}}
{{Fourier transforms}}
In [[mathematics]], a '''Fourier series''' ({{IPAc-en|ˈ|f|ʊr|i|eɪ|,_|-|i|ər}}<ref>{{Dictionary.com|Fourier}}</ref>) is a [[periodic function]] composed of harmonically related [[Sine wave|sinusoids]], combined by a weighted summation. With appropriate weights, one cycle (or ''period'') of the summation can be made to approximate an arbitrary function in that interval (or the entire function if it too is periodic). As such, the summation is a synthesis of another function. The [[discrete-time Fourier transform]] is an example of Fourier [[Series (mathematics)|series]]. The process of deriving weights that describe a given function is a form of [[Fourier analysis]]. For functions on unbounded intervals, the analysis and synthesis analogies are [[Fourier transform]] and inverse transform.
In [[mathematics]], a '''Fourier series''' ({{IPAc-en|ˈ|f|ʊr|i|eɪ|,_|-|i|ər}}<ref>{{Dictionary.com|Fourier}}</ref>) is a [[periodic function]] composed of harmonically related [[Sine wave|sinusoids]], combined by a weighted summation. With appropriate weights, one cycle (or ''period'') of the summation can be made to approximate an arbitrary function in that interval (or the entire function if it too is periodic). As such, the summation is a synthesis of another function. The [[discrete-time Fourier transform]] is an example of Fourier [[Series (mathematics)|series]]. The process of deriving weights that describe a given function is a form of [[Fourier analysis]]. For functions on unbounded intervals, the analysis and synthesis analogies are [[Fourier transform]] and inverse transform.

Since Fourier's time, many different approaches to defining and understanding the concept of Fourier series have been discovered, all of which are consistent with one another, but each of which emphasizes different aspects of the topic. Some of the more powerful and elegant approaches are based on mathematical ideas and tools that were not available at the time Fourier completed his original work. Fourier originally defined the Fourier series for real-valued functions of real arguments, and using the sine and cosine functions as the [[basis (linear algebra)|basis set]] for the decomposition. Many other [[List of Fourier-related transforms|Fourier-related transforms]] have since been defined, extending the initial idea to other applications. This general area of inquiry is now sometimes called [[harmonic analysis]]. A Fourier series, however, can be used only for periodic functions, or for functions on a bounded (compact) interval.


[[File:Fourier series and transform.gif|frame|right|Function <math>s(x)</math> (in red) is a sum of six sine functions of different amplitudes and harmonically related frequencies. Their summation is called a Fourier series. The Fourier transform, <math>S(f)</math> (in blue), which depicts amplitude vs frequency, reveals the 6 frequencies (''at odd harmonics'') and their amplitudes (''1/odd number'').]]
[[File:Fourier series and transform.gif|frame|right|Function <math>s(x)</math> (in red) is a sum of six sine functions of different amplitudes and harmonically related frequencies. Their summation is called a Fourier series. The Fourier transform, <math>S(f)</math> (in blue), which depicts amplitude vs frequency, reveals the 6 frequencies (''at odd harmonics'') and their amplitudes (''1/odd number'').]]


{{Gallery|width=150 | height=150 |lines=2 |align=right
==History{{anchor|Historical development}}==
{{See also|Fourier analysis#History}}
|File:Fourier Series.svg|
The first four partial sums of the Fourier series for a [[square wave]]

|File:SquareWaveFourierArrows%2Crotated.gif
The Fourier series is named in honor of [[Jean-Baptiste Joseph Fourier]] (1768–1830), who made important contributions to the study of [[trigonometric series]], after preliminary investigations by [[Leonhard Euler]], [[Jean le Rond d'Alembert]], and [[Daniel Bernoulli]].{{efn-ua|
}}
These three did some [[wave equation#Notes|important early work on the wave equation]], especially D'Alembert. Euler's work in this area was mostly [[Euler–Bernoulli beam theory|comtemporaneous/ in collaboration with Bernoulli]], although the latter made some independent contributions to the theory of waves and vibrations. (See {{harvnb|Fetter|Walecka|2003|pp=209–210}}).
}} Fourier introduced the series for the purpose of solving the [[heat equation]] in a metal plate, publishing his initial results in his 1807 ''[[Mémoire sur la propagation de la chaleur dans les corps solides]]'' (''Treatise on the propagation of heat in solid bodies''), and publishing his ''Théorie analytique de la chaleur'' (''Analytical theory of heat'') in 1822. The ''Mémoire'' introduced Fourier analysis, specifically Fourier series. Through Fourier's research the fact was established that an arbitrary (at first, continuous <ref name="Stillwell2013">{{cite book|last=Stillwell|first=John |author-link=John Stillwell|editor-first=C. L. |editor-last=Ten|title=Routledge History of Philosophy |chapter-url=https://books.google.com/books?id=91AqBgAAQBAJ&pg=PA204|volume=Volume VII: The Nineteenth Century|year=2013|publisher=Routledge|isbn=978-1-134-92880-4|chapter=Logic and the philosophy of mathematics in the nineteenth century|page=204}}</ref> and later generalized to any [[piecewise]]-smooth<ref name=iit.edu />) function can be represented by a trigonometric series. The first announcement of this great discovery was made by Fourier in 1807, before the [[Académie française|French Academy]].<ref name="Cajori1893">{{cite book|last=Cajori|first=Florian |author-link=Florian Cajori|title=A History of Mathematics|url=https://archive.org/details/ahistorymathema00cajogoog|year=1893|publisher=Macmillan|page=[https://archive.org/details/ahistorymathema00cajogoog/page/n254 283]}}</ref> Early ideas of decomposing a periodic function into the sum of simple oscillating functions date back to the 3rd century BC, when ancient astronomers proposed an empiric model of planetary motions, based on [[Deferent and epicycle|deferents and epicycles]].

The [[heat equation]] is a [[partial differential equation]]. Prior to Fourier's work, no solution to the heat equation was known in the general case, although particular solutions were known if the heat source behaved in a simple way, in particular, if the heat source was a [[sine]] or [[cosine]] wave. These simple solutions are now sometimes called [[Eigenvalue, eigenvector and eigenspace|eigensolutions]]. Fourier's idea was to model a complicated heat source as a superposition (or [[linear combination]]) of simple sine and cosine waves, and to write the [[superposition principle|solution as a superposition]] of the corresponding [[eigenfunction|eigensolutions]]. This superposition or linear combination is called the Fourier series.

From a modern point of view, Fourier's results are somewhat informal, due to the lack of a precise notion of [[function (mathematics)|function]] and [[integral]] in the early nineteenth century. Later, [[Peter Gustav Lejeune Dirichlet]]<ref>{{cite journal |last=Lejeune-Dirichlet |first=Peter Gustav |author-link=Peter Gustav Lejeune Dirichlet |title=Sur la convergence des séries trigonométriques qui servent à représenter une fonction arbitraire entre des limites données |language=fr |trans-title=On the convergence of trigonometric series which serve to represent an arbitrary function between two given limits |journal=[[Journal für die reine und angewandte Mathematik]] |volume=4 |year=1829 |pages=157–169 |arxiv= 0806.1294 |url=https://archive.org/details/arxiv-0806.1294}}</ref> and [[Bernhard Riemann]]<ref>{{cite web|url = http://www.maths.tcd.ie/pub/HistMath/People/Riemann/Trig/| title=Ueber die Darstellbarkeit einer Function durch eine trigonometrische Reihe |language=de|work=[[Habilitationsschrift]], [[Göttingen]]; 1854. Abhandlungen der [[Göttingen Academy of Sciences|Königlichen Gesellschaft der Wissenschaften zu Göttingen]], vol. 13, 1867. Published posthumously for Riemann by [[Richard Dedekind]]|trans-title=About the representability of a function by a trigonometric series|access-date= 19 May 2008 | archive-url= https://web.archive.org/web/20080520085248/http://www.maths.tcd.ie/pub/HistMath/People/Riemann/Trig/ | archive-date= 20 May 2008| url-status= live}}</ref><ref>{{citation|first1=D. |last1=Mascre|first2= Bernhard|last2= Riemann|chapter= Posthumous Thesis on the Representation of Functions by Trigonometric Series |date=1867|url=https://books.google.com/books?id=UdGBy8iLpocC|title=Landmark Writings in Western Mathematics 1640–1940|editor-first= Ivor |editor-last=Grattan-Guinness|page= 49|publisher= Elsevier|isbn=9780080457444|publication-date=2005}}</ref><ref>{{cite book|url=https://books.google.com/books?id=uP8SF4jf7GEC|title= Theory of Complex Functions: Readings in Mathematics|first= Reinhold |last=Remmert|page= 29|publisher= Springer|date= 1991|isbn= 9780387971957}}</ref> expressed Fourier's results with greater precision and formality.

Although the original motivation was to solve the heat equation, it later became obvious that the same techniques could be applied to a wide array of mathematical and physical problems, and especially those involving linear differential equations with constant coefficients, for which the eigensolutions are [[Sine wave|sinusoid]]s. The Fourier series has many such applications in [[electrical engineering]], [[oscillation|vibration]] analysis, [[acoustics]], [[optics]], [[signal processing]], [[image processing]], [[quantum mechanics]], [[econometrics]],<ref>{{cite book |first1=Marc |last1=Nerlove |first2=David M. |last2=Grether |first3=Jose L. |last3=Carvalho |year=1995 |title=Analysis of Economic Time Series. Economic Theory, Econometrics, and Mathematical Economics |publisher=Elsevier |isbn=0-12-515751-7 |url-access=registration |url=https://archive.org/details/analysisofeconom0000nerl }}</ref> [[Membrane theory of shells|shell theory]],<ref>[[Wilhelm Flügge]], ''Stresses in Shells'' (1973) 2nd edition. {{isbn|978-3-642-88291-3}}. Originally published in German as ''Statik und Dynamik der Schalen'' (1937).</ref> etc.


==Definition==
==Definition==
Line 31: Line 26:
|background colour=#F5FFFA}}
|background colour=#F5FFFA}}


* In general, integer <math>N</math> is theoretically infinite. Even so, the series might not converge or exactly equate to <math>s(x)</math> at all values of <math>x</math> (such as a single-point discontinuity) in the analysis interval. For the "well-behaved" functions typical of physical processes, equality is customarily assumed.
*In general, integer <math>N</math> is theoretically infinite. Even so, the series might not converge or exactly equate to <math>s(x)</math> at all values of <math>x</math> (such as a single-point discontinuity) in the analysis interval. For the "well-behaved" functions typical of physical processes, equality is customarily assumed.
* Integer <math>n,</math> used as an index, is also the number of cycles of the <math>n</math>-th harmonic in interval <math>P.</math> Therefore, the length of a cycle, in the units of <math>x,</math> is <math>P/n.</math> The corresponding harmonic frequency is <math>n/P,</math> so the <math>n</math>-th harmonic is <math>\cos\left(2\pi x \tfrac{n}{P}\right).</math> Some texts define <math>P = 2\pi</math> to simplify the argument of the sinusoid functions at the expense of generality.
*Integer <math>n,</math> used as an index, is also the number of cycles of the <math>n</math>-th harmonic in interval <math>P.</math> Therefore, the length of a cycle, in the units of <math>x,</math> is <math>P/n.</math> The corresponding harmonic frequency is <math>n/P,</math> so the <math>n</math>-th harmonic is <math>\cos\left(2\pi x \tfrac{n}{P}\right).</math> Some texts define <math>P = 2\pi</math> to simplify the argument of the sinusoid functions at the expense of generality.


[[Image:Fourier series illustration.svg|thumb|right|300px|The sum of the sinusoidal components of a Fourier series is a periodic function, whether or not the original function, ''s''(''x''), is periodic.]]
[[Image:Fourier series illustration.svg|thumb|right|300px|The sum of the sinusoidal components of a Fourier series is a periodic function, whether or not the original function, ''s''(''x''), is periodic.]]
Line 96: Line 91:
|background colour=#F5FFFA}}
|background colour=#F5FFFA}}


This is the customary form for generalizing to complex-valued <math>s(x)</math> (next section).
This is the customary form for generalizing to {{slink||Complex-valued functions}}.

===Example===
[[File:sawtooth pi.svg|thumb|right|400px|Plot of the [[sawtooth wave]], a periodic continuation of the linear function <math>s(x)=x/\pi</math> on the interval <math>(-\pi,\pi]</math>]]

[[File:Periodic identity function.gif|thumb|right|400px|Animated plot of the first five successive partial Fourier series]]

Consider a sawtooth function:
:<math>s(x) = \frac{x}{\pi}, \quad \mathrm{for } -\pi < x < \pi,</math>
:<math>s(x + 2\pi k) = s(x), \quad \mathrm{for } -\pi < x < \pi \text{ and } k \in \mathbb{Z}.</math>
In this case, the Fourier coefficients are given by
:<math>\begin{align}
a_n & = \frac{1}{\pi}\int_{-\pi}^{\pi}s(x) \cos(nx)\,dx = 0, \quad n \ge 0. \\[4pt]
b_n & = \frac{1}{\pi}\int_{-\pi}^{\pi}s(x) \sin(nx)\, dx\\[4pt]
&= -\frac{2}{\pi n}\cos(n\pi) + \frac{2}{\pi^2 n^2}\sin(n\pi)\\[4pt]
&= \frac{2\,(-1)^{n+1}}{\pi n}, \quad n \ge 1.\end{align}</math>
It can be shown that Fourier series converges to <math>s(x)</math> at every point <math>x</math> where <math>s</math> is differentiable, and therefore:
{{NumBlk|:
|<math>\begin{align}
s(x) &= \frac{a_0}{2} + \sum_{n=1}^\infty \left[a_n\cos\left(nx\right)+b_n\sin\left(nx\right)\right] \\[4pt]
&=\frac{2}{\pi}\sum_{n=1}^\infty \frac{(-1)^{n+1}}{n} \sin(nx), \quad \mathrm{for} \quad x - \pi \notin 2 \pi \mathbb{Z}.
\end{align}</math>
|{{EquationRef|Eq.5}}}}
When <math>x=\pi</math>, the Fourier series converges to 0, which is the half-sum of the left- and right-limit of ''s'' at <math>x=\pi</math>. This is a particular instance of the [[Convergence of Fourier series#Convergence at a given point|Dirichlet theorem]] for Fourier series.

This example leads to a solution to the [[Basel problem]].

=== Convergence ===
{{main|Convergence of Fourier series}}
In [[engineering]] applications, the Fourier series is generally presumed to converge almost everywhere (the exceptions being at discrete discontinuities) since the functions encountered in engineering are better-behaved than the functions that mathematicians can provide as counter-examples to this presumption. In particular, if <math>s</math> is continuous and the derivative of <math>s(x)</math> (which may not exist everywhere) is square integrable, then the Fourier series of <math>s</math> converges absolutely and uniformly to <math>s(x)</math>.<ref>{{cite book|last=Tolstov|first=Georgi P.|url=https://books.google.com/books?id=XqqNDQeLfAkC&q=fourier-series+converges+continuous-function&pg=PA82|title=Fourier Series|publisher=Courier-Dover|year=1976|isbn=0-486-63317-9}}</ref> If a function is [[Square-integrable function|square-integrable]] on the interval <math>[x_0,x_0+P]</math>, then the Fourier series [[Carleson's theorem|converges to the function at almost every point]]. Convergence of Fourier series also depends on the finite number of maxima and minima in a function which is popularly known as one of the [[Dirichlet conditions|Dirichlet's condition for Fourier series]]. See [[Convergence of Fourier series]]. It is possible to define Fourier coefficients for more general functions or distributions, in such cases convergence in norm or [[Weak convergence (Hilbert space)|weak convergence]] is usually of interest.

<gallery widths="256" heights="256">

Fourier_series_square_wave_circles_animation.gif|link={{filepath:Fourier_series_square_wave_circle_animation.svg}}|Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a square wave improves as the number of terms increases [{{filepath:Fourier_series_square_wave_circle_animation.svg}} (animation)]

Fourier_series_sawtooth_wave_circles_animation.gif|link={{filepath:Fourier_series_sawtooth_wave_circles_animation.svg}}|Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a sawtooth wave improves as the number of terms increases [{{filepath:Fourier_series_sawtooth_wave_circles_animation.svg}} (animation)]

Example_of_Fourier_Convergence.gif |Example of convergence to a somewhat arbitrary function. Note the development of the "ringing" (Gibbs phenomenon) at the transitions to/from the vertical sections.

</gallery>

=== Complex-valued functions ===
=== Complex-valued functions ===
If <math>s(x)</math> is a complex-valued function of a real variable <math>x,</math> both components (real and imaginary part) are real-valued functions that can be represented by a Fourier series. The two sets of coefficients and the partial sum are given by''':'''
If <math>s(x)</math> is a complex-valued function of a real variable <math>x,</math> both components (real and imaginary part) are real-valued functions that can be represented by a Fourier series. The two sets of coefficients and the partial sum are given by''':'''
Line 113: Line 148:
|equation = {{NumBlk||<math>
|equation = {{NumBlk||<math>
s_{_N}(x) = \sum_{n=-N}^N c_n \cdot e^{ i \tfrac{2\pi }{P}nx}.
s_{_N}(x) = \sum_{n=-N}^N c_n \cdot e^{ i \tfrac{2\pi }{P}nx}.
</math>|{{EquationRef|Eq.5}}}}
</math>|{{EquationRef|Eq.6}}}}
|cellpadding= 6
|cellpadding= 6
|border
|border
Line 153: Line 188:
}}
}}


==History{{anchor|Historical development}}==
{{Gallery|width=150 | height=150 |lines=2 |align=right
|File:Fourier Series.svg|
{{See also|Fourier analysis#History}}
The first four partial sums of the Fourier series for a [[square wave]]
|File:SquareWaveFourierArrows%2Crotated.gif
}}


The Fourier series is named in honor of [[Jean-Baptiste Joseph Fourier]] (1768–1830), who made important contributions to the study of [[trigonometric series]], after preliminary investigations by [[Leonhard Euler]], [[Jean le Rond d'Alembert]], and [[Daniel Bernoulli]].{{efn-ua|
==Convergence==
These three did some [[wave equation#Notes|important early work on the wave equation]], especially D'Alembert. Euler's work in this area was mostly [[Euler–Bernoulli beam theory|comtemporaneous/ in collaboration with Bernoulli]], although the latter made some independent contributions to the theory of waves and vibrations. (See {{harvnb|Fetter|Walecka|2003|pp=209–210}}).
{{main|Convergence of Fourier series}}
}} Fourier introduced the series for the purpose of solving the [[heat equation]] in a metal plate, publishing his initial results in his 1807 ''[[Mémoire sur la propagation de la chaleur dans les corps solides]]'' (''Treatise on the propagation of heat in solid bodies''), and publishing his ''Théorie analytique de la chaleur'' (''Analytical theory of heat'') in 1822. The ''Mémoire'' introduced Fourier analysis, specifically Fourier series. Through Fourier's research the fact was established that an arbitrary (at first, continuous <ref name="Stillwell2013">{{cite book|last=Stillwell|first=John|title=Routledge History of Philosophy|publisher=Routledge|year=2013|isbn=978-1-134-92880-4|editor-last=Ten|editor-first=C. L.|volume=Volume VII: The Nineteenth Century|page=204|chapter=Logic and the philosophy of mathematics in the nineteenth century|author-link=John Stillwell|chapter-url=https://books.google.com/books?id=91AqBgAAQBAJ&pg=PA204}}</ref> and later generalized to any [[piecewise]]-smooth<ref name="iit.edu" />) function can be represented by a trigonometric series. The first announcement of this great discovery was made by Fourier in 1807, before the [[Académie française|French Academy]].<ref name="Cajori1893">{{cite book|last=Cajori|first=Florian|url=https://archive.org/details/ahistorymathema00cajogoog|title=A History of Mathematics|publisher=Macmillan|year=1893|page=[https://archive.org/details/ahistorymathema00cajogoog/page/n254 283]|author-link=Florian Cajori}}</ref> Early ideas of decomposing a periodic function into the sum of simple oscillating functions date back to the 3rd century BC, when ancient astronomers proposed an empiric model of planetary motions, based on [[Deferent and epicycle|deferents and epicycles]].
In [[engineering]] applications, the Fourier series is generally presumed to converge almost everywhere (the exceptions being at discrete discontinuities) since the functions encountered in engineering are better-behaved than the functions that mathematicians can provide as counter-examples to this presumption. In particular, if <math>s</math> is continuous and the derivative of <math>s(x)</math> (which may not exist everywhere) is square integrable, then the Fourier series of <math>s</math> converges absolutely and uniformly to <math>s(x)</math>.<ref>{{cite book |title=Fourier Series |first=Georgi P. |last=Tolstov |publisher=Courier-Dover |year=1976 |isbn=0-486-63317-9 |url=https://books.google.com/books?id=XqqNDQeLfAkC&q=fourier-series+converges+continuous-function&pg=PA82}}</ref> If a function is [[Square-integrable function|square-integrable]] on the interval <math>[x_0,x_0+P]</math>, then the Fourier series [[Carleson's theorem|converges to the function at almost every point]]. Convergence of Fourier series also depends on the finite number of maxima and minima in a function which is popularly known as one of the [[Dirichlet conditions|Dirichlet's condition for Fourier series]]. See [[Convergence of Fourier series]]. It is possible to define Fourier coefficients for more general functions or distributions, in such cases convergence in norm or [[Weak convergence (Hilbert space)|weak convergence]] is usually of interest.


The [[heat equation]] is a [[partial differential equation]]. Prior to Fourier's work, no solution to the heat equation was known in the general case, although particular solutions were known if the heat source behaved in a simple way, in particular, if the heat source was a [[sine]] or [[cosine]] wave. These simple solutions are now sometimes called [[Eigenvalue, eigenvector and eigenspace|eigensolutions]]. Fourier's idea was to model a complicated heat source as a superposition (or [[linear combination]]) of simple sine and cosine waves, and to write the [[superposition principle|solution as a superposition]] of the corresponding [[eigenfunction|eigensolutions]]. This superposition or linear combination is called the Fourier series.
<gallery widths="256" heights="256">


From a modern point of view, Fourier's results are somewhat informal, due to the lack of a precise notion of [[function (mathematics)|function]] and [[integral]] in the early nineteenth century. Later, [[Peter Gustav Lejeune Dirichlet]]<ref>{{cite journal|last=Lejeune-Dirichlet|first=Peter Gustav|author-link=Peter Gustav Lejeune Dirichlet|year=1829|title=Sur la convergence des séries trigonométriques qui servent à représenter une fonction arbitraire entre des limites données|trans-title=On the convergence of trigonometric series which serve to represent an arbitrary function between two given limits|url=https://archive.org/details/arxiv-0806.1294|journal=[[Journal für die reine und angewandte Mathematik]]|language=fr|volume=4|pages=157–169|arxiv=0806.1294}}</ref> and [[Bernhard Riemann]]<ref>{{cite web|title=Ueber die Darstellbarkeit einer Function durch eine trigonometrische Reihe|trans-title=About the representability of a function by a trigonometric series|url=http://www.maths.tcd.ie/pub/HistMath/People/Riemann/Trig/|url-status=live|archive-url=https://web.archive.org/web/20080520085248/http://www.maths.tcd.ie/pub/HistMath/People/Riemann/Trig/|archive-date=20 May 2008|access-date=19 May 2008|work=[[Habilitationsschrift]], [[Göttingen]]; 1854. Abhandlungen der [[Göttingen Academy of Sciences|Königlichen Gesellschaft der Wissenschaften zu Göttingen]], vol. 13, 1867. Published posthumously for Riemann by [[Richard Dedekind]]|language=de}}</ref><ref>{{citation|last1=Mascre|first1=D.|title=Landmark Writings in Western Mathematics 1640–1940|date=1867|url=https://books.google.com/books?id=UdGBy8iLpocC|page=49|publication-date=2005|editor-last=Grattan-Guinness|editor-first=Ivor|chapter=Posthumous Thesis on the Representation of Functions by Trigonometric Series|publisher=Elsevier|isbn=9780080457444|last2=Riemann|first2=Bernhard}}</ref><ref>{{cite book|last=Remmert|first=Reinhold|url=https://books.google.com/books?id=uP8SF4jf7GEC|title=Theory of Complex Functions: Readings in Mathematics|date=1991|publisher=Springer|isbn=9780387971957|page=29}}</ref> expressed Fourier's results with greater precision and formality.
Fourier_series_square_wave_circles_animation.gif|link={{filepath:Fourier_series_square_wave_circle_animation.svg}}|Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a square wave improves as the number of terms increases [{{filepath:Fourier_series_square_wave_circle_animation.svg}} (animation)]


Although the original motivation was to solve the heat equation, it later became obvious that the same techniques could be applied to a wide array of mathematical and physical problems, and especially those involving linear differential equations with constant coefficients, for which the eigensolutions are [[Sine wave|sinusoid]]s. The Fourier series has many such applications in [[electrical engineering]], [[oscillation|vibration]] analysis, [[acoustics]], [[optics]], [[signal processing]], [[image processing]], [[quantum mechanics]], [[econometrics]],<ref>{{cite book|last1=Nerlove|first1=Marc|url=https://archive.org/details/analysisofeconom0000nerl|title=Analysis of Economic Time Series. Economic Theory, Econometrics, and Mathematical Economics|last2=Grether|first2=David M.|last3=Carvalho|first3=Jose L.|publisher=Elsevier|year=1995|isbn=0-12-515751-7|url-access=registration}}</ref> [[Membrane theory of shells|shell theory]],<ref>[[Wilhelm Flügge]], ''Stresses in Shells'' (1973) 2nd edition. {{isbn|978-3-642-88291-3}}. Originally published in German as ''Statik und Dynamik der Schalen'' (1937).</ref> etc.
Fourier_series_sawtooth_wave_circles_animation.gif|link={{filepath:Fourier_series_sawtooth_wave_circles_animation.svg}}|Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a sawtooth wave improves as the number of terms increases [{{filepath:Fourier_series_sawtooth_wave_circles_animation.svg}} (animation)]


=== Beginnings ===
Example_of_Fourier_Convergence.gif |Example of convergence to a somewhat arbitrary function. Note the development of the "ringing" (Gibbs phenomenon) at the transitions to/from the vertical sections.
Joseph Fourier wrote:{{dubious|reason=Did Fourier really write this in English?|date=February 2020}}

</gallery>
An interactive animation can be seen [http://bl.ocks.org/jinroh/7524988 here.]

==Examples==
===Example 1: a simple Fourier series===
[[File:sawtooth pi.svg|thumb|right|400px|Plot of the [[sawtooth wave]], a periodic continuation of the linear function <math>s(x)=x/\pi</math> on the interval <math>(-\pi,\pi]</math>]]
[[File:Periodic identity function.gif|thumb|right|400px|Animated plot of the first five successive partial Fourier series]]
We now use the formula above to give a Fourier series expansion of a very simple function. Consider a sawtooth wave
:<math>s(x) = \frac{x}{\pi}, \quad \mathrm{for } -\pi < x < \pi,</math>
:<math>s(x + 2\pi k) = s(x), \quad \mathrm{for } -\pi < x < \pi \text{ and } k \in \mathbb{Z}.</math>
In this case, the Fourier coefficients are given by
:<math>\begin{align}
a_n & = \frac{1}{\pi}\int_{-\pi}^{\pi}s(x) \cos(nx)\,dx = 0, \quad n \ge 0. \\[4pt]
b_n & = \frac{1}{\pi}\int_{-\pi}^{\pi}s(x) \sin(nx)\, dx\\[4pt]
&= -\frac{2}{\pi n}\cos(n\pi) + \frac{2}{\pi^2 n^2}\sin(n\pi)\\[4pt]
&= \frac{2\,(-1)^{n+1}}{\pi n}, \quad n \ge 1.\end{align}</math>
It can be proven that Fourier series converges to <math>s(x)</math> at every point <math>x</math> where <math>s</math> is differentiable, and therefore:
{{NumBlk|:
|<math>\begin{align}
s(x) &= \frac{a_0}{2} + \sum_{n=1}^\infty \left[a_n\cos\left(nx\right)+b_n\sin\left(nx\right)\right] \\[4pt]
&=\frac{2}{\pi}\sum_{n=1}^\infty \frac{(-1)^{n+1}}{n} \sin(nx), \quad \mathrm{for} \quad x - \pi \notin 2 \pi \mathbb{Z}.
\end{align}</math>
|{{EquationRef|Eq.7}}}}
When <math>x=\pi</math>, the Fourier series converges to 0, which is the half-sum of the left- and right-limit of ''s'' at <math>x=\pi</math>. This is a particular instance of the [[Convergence of Fourier series#Convergence at a given point|Dirichlet theorem]] for Fourier series.


This example leads us to a solution to the [[Basel problem]].

===Example 2: Fourier's motivation===
[[File:Fourier heat in a plate.png|thumb|right|Heat distribution in a metal plate, using Fourier's method]]
The Fourier series expansion of our function in Example 1 looks more complicated than the simple formula <math>s(x)=x/ \pi</math>, so it is not immediately apparent why one would need the Fourier series. While there are many applications, Fourier's motivation was in solving the [[heat equation]]. For example, consider a metal plate in the shape of a square whose sides measure <math>\pi</math> meters, with coordinates <math>(x,y) \in [0,\pi] \times [0,\pi]</math>. If there is no heat source within the plate, and if three of the four sides are held at 0 degrees Celsius, while the fourth side, given by <math>y=\pi</math>, is maintained at the temperature gradient <math>T(x,\pi)=x</math> degrees Celsius, for <math>x</math> in <math>(0,\pi)</math>, then one can show that the stationary heat distribution (or the heat distribution after a long period of time has elapsed) is given by
: <math>T(x,y) = 2\sum_{n=1}^\infty \frac{(-1)^{n+1}}{n} \sin(nx) {\sinh(ny) \over \sinh(n\pi)}.</math>
Here, sinh is the [[hyperbolic sine]] function. This solution of the heat equation is obtained by multiplying each term of &nbsp;{{EquationNote|Eq.7}} by <math>\sinh(ny)/\sinh(n\pi)</math>. While our example function <math>s(x)</math> seems to have a needlessly complicated Fourier series, the heat distribution <math>T(x,y)</math> is nontrivial. The function <math>T</math> cannot be written as a [[closed-form expression]]. This method of solving the heat problem was made possible by Fourier's work.

===Example 3: complex Fourier series animation===
[[File:two arm complex Fourier series drawing e.webm|thumb|right|complex Fourier series converging to drawing of the letter 'e']]

An example of the ability of the complex Fourier series to draw any two dimensional closed figure is shown in the adjacent animation of the complex Fourier series converging to a drawing in the complex plane of the letter 'e' (for exponential). The animation alternates between fast rotations to take less time and slow rotations to show more detail. The terms of the complex Fourier series are shown in two rotating arms: one arm is an aggregate of all the complex Fourier series terms that rotate in the positive direction (counter clockwise, according to the right hand rule), the other arm is an aggregate of all the complex Fourier series terms that rotate in the negative direction. The constant term that does not rotate at all is evenly split between the two arms. The animation's small circle represents the midpoint between the extent of the two arms, which is also the midpoint between the origin and the complex Fourier series approximation which is the '+' symbol in the animation. (The GNU Octave source code for generating this animation is here.<ref name="cfs_example_src_code">{{cite web |last1=Sepesi |first1=G |title=The Geometry of Exponential Growth |url=https://towardsdatascience.com/the-geometry-of-exponential-growth-429e7135588b |publisher=Towards Data Science |pages=section 5, GNU Octave source code |date=2021}}</ref> Note that the animation uses the variable 't' to parameterize the drawing in the complex plane, equivalent to the use of the parameter 'x' in this article's subsection on complex valued functions.)

===Other applications===
Another application of this Fourier series is to solve the [[Basel problem]] by using [[Parseval's theorem]]. The example generalizes and one may compute [[Riemann zeta function|ζ]](2''n''), for any positive integer&nbsp;''n''.

==Beginnings==
Joseph Fourier wrote:{{dubious|reason=Did Fourier really write this in English?|date=February 2020}}
{{quote|<math>\varphi(y)=a_0\cos\frac{\pi y}{2}+a_1\cos 3\frac{\pi y}{2}+a_2\cos5\frac{\pi y}{2}+\cdots.</math>
{{quote|<math>\varphi(y)=a_0\cos\frac{\pi y}{2}+a_1\cos 3\frac{\pi y}{2}+a_2\cos5\frac{\pi y}{2}+\cdots.</math>


Line 235: Line 225:
When Fourier submitted a later competition essay in 1811, the committee (which included [[Joseph Louis Lagrange|Lagrange]], [[Laplace]], [[Étienne-Louis Malus|Malus]] and [[Adrien-Marie Legendre|Legendre]], among others) concluded: ''...the manner in which the author arrives at these equations is not exempt of difficulties and...his analysis to integrate them still leaves something to be desired on the score of generality and even [[Mathematical rigour|rigour]]''.{{citation needed|date=November 2012}}
When Fourier submitted a later competition essay in 1811, the committee (which included [[Joseph Louis Lagrange|Lagrange]], [[Laplace]], [[Étienne-Louis Malus|Malus]] and [[Adrien-Marie Legendre|Legendre]], among others) concluded: ''...the manner in which the author arrives at these equations is not exempt of difficulties and...his analysis to integrate them still leaves something to be desired on the score of generality and even [[Mathematical rigour|rigour]]''.{{citation needed|date=November 2012}}


===Fourier's motivation===
===Birth of harmonic analysis===
[[File:Fourier heat in a plate.png|thumb|right|Heat distribution in a metal plate, using Fourier's method]]
Since Fourier's time, many different approaches to defining and understanding the concept of Fourier series have been discovered, all of which are consistent with one another, but each of which emphasizes different aspects of the topic. Some of the more powerful and elegant approaches are based on mathematical ideas and tools that were not available at the time Fourier completed his original work. Fourier originally defined the Fourier series for real-valued functions of real arguments, and using the sine and cosine functions as the [[basis (linear algebra)|basis set]] for the decomposition.
The Fourier series expansion of the sawtooth function (above) looks more complicated than the simple formula <math>s(x)=x/ \pi</math>, so it is not immediately apparent why one would need the Fourier series. While there are many applications, Fourier's motivation was in solving the [[heat equation]]. For example, consider a metal plate in the shape of a square whose sides measure <math>\pi</math> meters, with coordinates <math>(x,y) \in [0,\pi] \times [0,\pi]</math>. If there is no heat source within the plate, and if three of the four sides are held at 0 degrees Celsius, while the fourth side, given by <math>y=\pi</math>, is maintained at the temperature gradient <math>T(x,\pi)=x</math> degrees Celsius, for <math>x</math> in <math>(0,\pi)</math>, then one can show that the stationary heat distribution (or the heat distribution after a long period of time has elapsed) is given by
: <math>T(x,y) = 2\sum_{n=1}^\infty \frac{(-1)^{n+1}}{n} \sin(nx) {\sinh(ny) \over \sinh(n\pi)}.</math>
Here, sinh is the [[hyperbolic sine]] function. This solution of the heat equation is obtained by multiplying each term of &nbsp;{{EquationNote|Eq.5}} by <math>\sinh(ny)/\sinh(n\pi)</math>. While our example function <math>s(x)</math> seems to have a needlessly complicated Fourier series, the heat distribution <math>T(x,y)</math> is nontrivial. The function <math>T</math> cannot be written as a [[closed-form expression]]. This method of solving the heat problem was made possible by Fourier's work.


===Complex Fourier series animation===
Many other [[List of Fourier-related transforms|Fourier-related transforms]] have since been defined, extending the initial idea to other applications. This general area of inquiry is now sometimes called [[harmonic analysis]]. A Fourier series, however, can be used only for periodic functions, or for functions on a bounded (compact) interval.
[[File:two arm complex Fourier series drawing e.webm|thumb|right|complex Fourier series converging to drawing of the letter 'e']]


An example of the ability of the complex Fourier series to draw any two dimensional closed figure is shown in the adjacent animation of the complex Fourier series converging to a drawing in the complex plane of the letter 'e' (for exponential). The animation alternates between fast rotations to take less time and slow rotations to show more detail. The terms of the complex Fourier series are shown in two rotating arms: one arm is an aggregate of all the complex Fourier series terms that rotate in the positive direction (counter clockwise, according to the right hand rule), the other arm is an aggregate of all the complex Fourier series terms that rotate in the negative direction. The constant term that does not rotate at all is evenly split between the two arms. The animation's small circle represents the midpoint between the extent of the two arms, which is also the midpoint between the origin and the complex Fourier series approximation which is the '+' symbol in the animation. (The GNU Octave source code for generating this animation is here.<ref name="cfs_example_src_code">{{cite web |last1=Sepesi |first1=G |title=The Geometry of Exponential Growth |url=https://towardsdatascience.com/the-geometry-of-exponential-growth-429e7135588b |publisher=Towards Data Science |pages=section 5, GNU Octave source code |date=2021}}</ref> Note that the animation uses the variable 't' to parameterize the drawing in the complex plane, equivalent to the use of the parameter 'x' in this article's subsection on complex valued functions.)
==Extensions==


===Other applications===
=== Fourier series on a square ===
Another application of this Fourier series is to solve the [[Basel problem]] by using [[Parseval's theorem]]. The example generalizes and one may compute [[Riemann zeta function|ζ]](2''n''), for any positive integer&nbsp;''n''.
We can also define the Fourier series for functions of two variables <math>x</math> and <math>y</math> in the square <math>[-\pi,\pi]\times[-\pi,\pi]</math>:


== Table of common Fourier series ==
: <math>
Some common pairs of periodic functions and their Fourier Series coefficients are shown in the table below. The following notation applies:
\begin{align}
f(x,y) & = \sum_{j,k \in \Z} c_{j,k}e^{ijx}e^{iky},\\[5pt]
c_{j,k} & = \frac{1}{4 \pi^2} \int_{-\pi}^\pi \int_{-\pi}^\pi f(x,y) e^{-ijx}e^{-iky}\, dx \, dy.
\end{align}
</math>


*<math>f(x)</math> designates a periodic function defined on <math>0 < x \le P </math>.
Aside from being useful for solving partial differential equations such as the heat equation, one notable application of Fourier series on the square is in [[image compression]]. In particular, the [[jpeg]] image compression standard uses the two-dimensional [[discrete cosine transform]], which is a [[Fourier-related transform]] using only the cosine basis functions.{{cn|date=January 2021}}
*<math>a_0, a_n, b_n</math> designate the Fourier Series coefficients (sine-cosine form) of the periodic function <math>f</math> as defined in {{EquationNote|Eq.2}}.

For two-dimensional arrays with a staggered appearance, half of the Fourier series coefficients disappear, due to additional symmetry.<ref>[https://www.youtube.com/watch?v=V7l9Im9zneg Vanishing of Half the Fourier Coefficients in Staggered Arrays]</ref>

=== <span class="anchor" id="Multidimensional"></span> Fourier series of Bravais-lattice-periodic-function ===
<!--Linked from Reciprocal Lattice to anchor Multidimensional-->
A three-dimensional [[Bravais lattice]] is defined as the set of vectors of the form:
:<math>\mathbf{R} = n_1\mathbf{a}_1 + n_2\mathbf{a}_2 + n_3\mathbf{a}_3</math>
where <math>n_i</math> are integers and <math>\mathbf{a}_i</math> are three linearly independent vectors. Assuming we have some function, <math>f(\mathbf{r})</math>, such that it obeys the condition of periodicity for any Bravais lattice vector <math>\mathbf{R}</math>, <math>f(\mathbf{r}) = f(\mathbf{R}+\mathbf{r})</math>, we could make a Fourier series of it. This kind of function can be, for example, the effective potential that one electron "feels" inside a periodic crystal. It is useful to make the Fourier series of the potential when applying [[Bloch's Theorem|Bloch's theorem]]. First, we may write any arbitrary position vector <math>\mathbf{r}</math> in the coordinate-system of the lattice:

: <math>\mathbf{r} = x_1\frac{\mathbf{a}_{1}}{a_1}+ x_2\frac{\mathbf{a}_{2}}{a_2}+ x_3\frac{\mathbf{a}_{3}}{a_3},</math>

where <math>a_i \triangleq |\mathbf{a}_i|,</math> meaning that <math>a_i</math> is defined to be the magnitude of <math>\mathbf{a}_i</math>, so <math>\hat{\mathbf{a}_{i}} = \frac {\mathbf{a}_{i}}{a_i}</math> is the unit vector directed along <math>\mathbf{a}_i</math>.

Thus we can define a new function,

: <math>g(x_1,x_2,x_3) \triangleq f(\mathbf{r}) = f \left (x_1\frac{\mathbf{a}_{1}}{a_1}+x_2\frac{\mathbf{a}_{2}}{a_2}+x_3\frac{\mathbf{a}_{3}}{a_3} \right ).</math>

This new function, <math>g(x_1,x_2,x_3)</math>, is now a function of three-variables, each of which has periodicity <math>a_1</math>'', <math>a_2</math>'', and <math>a_3</math> respectively:

: <math>g(x_1,x_2,x_3) = g(x_1+a_1,x_2,x_3) = g(x_1,x_2+a_2,x_3) = g(x_1,x_2,x_3+a_3).</math>

This enables us to build up a set of Fourier coefficients, each being indexed by three independent integers <math>m_1,m_2,m_3</math>. In what follows, we use function notation to denote these coefficients, where previously we used subscripts. If we write a series for <math>g</math> on the interval <math>\left [ 0, a_1\right ]</math> for <math>x_1</math>, we can define the following:


{| class="wikitable"
:<math>h^\mathrm{one}(m_1, x_2, x_3) \triangleq \frac{1}{a_1}\int_0^{a_1} g(x_1, x_2, x_3)\cdot e^{-i 2\pi \frac{m_1}{a_1} x_1}\, dx_1</math>
|-

! Time domain <br /> <math>f(x)</math>
And then we can write:
! Plot

! Frequency domain (sine-cosine form) <br /> <math>\begin{align}& a_0 \\ & a_n \quad \text{for } n \ge 1 \\ & b_n \quad \text{for } n \ge 1\end{align}</math>
:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty h^\mathrm{one}(m_1, x_2, x_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1}</math>
! Remarks

! Reference
Further defining:
|-

|<math>f(x)=A \left| \sin\left(\frac{2\pi}{P}x\right)\right| \quad \text{for } 0 \le x < P</math>
:<math>
|[[File:PlotRectifiedSineSignal.svg|251px|center]]
\begin{align}
|<math>\begin{align}
h^\mathrm{two}(m_1, m_2, x_3) & \triangleq \frac{1}{a_2}\int_0^{a_2} h^\mathrm{one}(m_1, x_2, x_3)\cdot e^{-i 2\pi \frac{m_2}{a_2} x_2}\, dx_2 \\[12pt]
a_0 = & \frac{4A}{\pi}\\
& = \frac{1}{a_2}\int_0^{a_2} dx_2 \frac{1}{a_1}\int_0^{a_1} dx_1 g(x_1, x_2, x_3)\cdot e^{-i 2\pi \left(\frac{m_1}{a_1} x_1+\frac{m_2}{a_2} x_2\right)}
a_n = & \begin{cases}
\end{align}
\frac{-4A}{\pi}\frac{1}{n^2-1} & \quad n \text{ even} \\
0 & \quad n \text{ odd}
\end{cases}\\
b_n = & 0\\
\end{align}</math>
|Full-wave rectified sine
|<ref name="Papula">{{cite book|last=Papula|first=Lothar|title=Mathematische Formelsammlung: für Ingenieure und Naturwissenschaftler|publisher=Vieweg+Teubner Verlag|year=2009|isbn=978-3834807571|trans-title=Mathematical Functions for Engineers and Physicists|lang=de}}</ref>{{rp|p. 193}}
|-
|<math>f(x)=\begin{cases}
A \sin\left(\frac{2\pi}{P}x\right) & \quad \text{for } 0 \le x < P/2 \\
0 & \quad \text{for } P/2 \le x < P\\
\end{cases}
</math>
</math>
|[[File:PlotHalfRectifiedSineSignal.svg|251px|center]]

|<math>\begin{align}
We can write <math>g</math> once again as:
a_0 = & \frac{2A}{\pi}\\

a_n = & \begin{cases}
:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty \sum_{m_2=-\infty}^\infty h^\mathrm{two}(m_1, m_2, x_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1} \cdot e^{i 2\pi \frac{m_2}
\frac{-2A}{\pi}\frac{1}{n^2-1} & \quad n \text{ even} \\
{a_2} x_2}</math>
0 & \quad n \text{ odd}

\end{cases}\\
Finally applying the same for the third coordinate, we define:
b_n = & \begin{cases}
: <math>
\frac{A}{2} & \quad n=1 \\
\begin{align}
0 & \quad n > 1
h^\mathrm{three}(m_1, m_2, m_3) & \triangleq \frac{1}{a_3}\int_0^{a_3} h^\mathrm{two}(m_1, m_2, x_3)\cdot e^{-i 2\pi \frac{m_3}{a_3} x_3}\, dx_3 \\[12pt]
\end{cases}\\
& = \frac{1}{a_3}\int_0^{a_3} dx_3 \frac{1}{a_2}\int_0^{a_2} dx_2 \frac{1}{a_1}\int_0^{a_1} dx_1 g(x_1, x_2, x_3)\cdot e^{-i 2\pi \left(\frac{m_1}{a_1} x_1+\frac{m_2}{a_2} x_2 + \frac{m_3}{a_3} x_3\right)}
\end{align}
\end{align}</math>
|Half-wave rectified sine
|<ref name=Papula/>{{rp|p. 193}}
|-
|<math>f(x)=\begin{cases}
A & \quad \text{for } 0 \le x < D \cdot P \\
0 & \quad \text{for } D \cdot P \le x < P\\
\end{cases}
</math>
</math>
|[[File:PlotRectangleSignal.svg|251px|center]]
|<math>\begin{align}
a_0 = & 2AD\\
a_n = & \frac{A}{n \pi} \sin \left( 2 \pi n D \right)\\
b_n = & \frac{2A}{n \pi} \left( \sin \left( \pi n D \right) \right) ^2\\
\end{align}</math>
| <math>0 \le D \le 1</math>
|
|-
|<math>f(x)=\frac{Ax}{P} \quad \text{for } 0 \le x < P</math>
|[[File:PlotSawtooth1Signal.svg|251px|center]]
|<math>\begin{align}
a_0 = & A\\
a_n = & 0\\
b_n = & \frac{-A}{n \pi}\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 192}}
|-
|<math>f(x)=A-\frac{Ax}{P} \quad \text{for } 0 \le x < P</math>
|[[File:PlotSawtooth2Signal.svg|251px|center]]
|<math>\begin{align}
a_0 = & A\\
a_n = & 0\\
b_n = & \frac{A}{n \pi}\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 192}}
|-
|<math>f(x)=\frac{4A}{P^2}\left( x-\frac{P}{2} \right)^2 \quad \text{for } 0 \le x < P</math>
|[[File:PlotParabolaSignal.svg|251px|center]]
|<math>\begin{align}
a_0 = & \frac{2A}{3}\\
a_n = & \frac{4A}{\pi^2 n^2}\\
b_n = & 0\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 193}}
|}


== Table of basic properties ==
We write <math>g</math> as:

:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty \sum_{m_2=-\infty}^\infty \sum_{m_3=-\infty}^\infty h^\mathrm{three}(m_1, m_2, m_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1} \cdot e^{i 2\pi \frac{m_2}{a_2} x_2}\cdot e^{i 2\pi \frac{m_3}{a_3} x_3}</math>

Re-arranging:

:<math>g(x_1, x_2, x_3)=\sum_{m_1, m_2, m_3 \in \Z } h^\mathrm{three}(m_1, m_2, m_3) \cdot e^{i 2\pi \left( \frac{m_1}{a_1} x_1+ \frac{m_2}{a_2} x_2 + \frac{m_3}{a_3} x_3\right)}. </math>

Now, every ''reciprocal'' lattice vector can be written (but does not mean that it is the only way of writing) as <math>\mathbf{G} = m_1\mathbf{g}_1 + m_2\mathbf{g}_2 + m_3\mathbf{g}_3</math>, where <math>m_i</math> are integers and <math>\mathbf{g}_i</math> are reciprocal lattice vectors to satisfy <math>\mathbf{g_i} \cdot \mathbf{a_j}=2\pi\delta_{ij}</math> (<math>\delta_{ij} = 1</math> for <math>i = j</math>, and <math>\delta_{ij} = 0</math> for <math>i \neq j</math>). Then for any arbitrary reciprocal lattice vector <math>\mathbf{G}</math> and arbitrary position vector <math>\mathbf{r}</math> in the original Bravais lattice space, their scalar product is:

:<math>\mathbf{G} \cdot \mathbf{r} = \left ( m_1\mathbf{g}_1 + m_2\mathbf{g}_2 + m_3\mathbf{g}_3 \right ) \cdot \left (x_1\frac{\mathbf{a}_1}{a_1}+ x_2\frac{\mathbf{a}_2}{a_2} +x_3\frac{\mathbf{a}_3}{a_3} \right ) = 2\pi \left( x_1\frac{m_1}{a_1}+x_2\frac{m_2}{a_2}+x_3\frac{m_3}{a_3} \right ).</math>

So it is clear that in our expansion of <math>g(x_1,x_2,x_3) = f(\mathbf{r})</math>, the sum is actually over reciprocal lattice vectors:

:<math>f(\mathbf{r})=\sum_{\mathbf{G}} h(\mathbf{G}) \cdot e^{i \mathbf{G} \cdot \mathbf{r}}, </math>

where

: <math>h(\mathbf{G}) = \frac{1}{a_3} \int_0^{a_3} dx_3 \, \frac{1}{a_2}\int_0^{a_2} dx_2 \, \frac{1}{a_1}\int_0^{a_1} dx_1 \, f\left(x_1\frac{\mathbf{a}_1}{a_1} + x_2\frac{\mathbf{a}_2}{a_2} + x_3\frac{\mathbf{a}_3}{a_3} \right)\cdot e^{-i \mathbf{G} \cdot \mathbf{r}}. </math>

Assuming

:<math>\mathbf{r} = (x,y,z) = x_1\frac{\mathbf{a}_1}{a_1}+x_2\frac{\mathbf{a}_2}{a_2}+x_3\frac{\mathbf{a}_3}{a_3},</math>

we can solve this system of three linear equations for <math>x</math>, <math>y</math>, and <math>z</math> in terms of <math>x_1</math>, <math>x_2</math> and <math>x_3</math> in order to calculate the volume element in the original cartesian coordinate system. Once we have <math>x</math>, <math>y</math>, and <math>z</math> in terms of <math>x_1</math>, <math>x_2</math> and <math>x_3</math>, we can calculate the [[Jacobian matrix and determinant|Jacobian determinant]]:

:<math>\begin{vmatrix}
\dfrac{\partial x_1}{\partial x} & \dfrac{\partial x_1}{\partial y} & \dfrac{\partial x_1}{\partial z} \\[12pt]
\dfrac{\partial x_2}{\partial x} & \dfrac{\partial x_2}{\partial y} & \dfrac{\partial x_2}{\partial z} \\[12pt]
\dfrac{\partial x_3}{\partial x} & \dfrac{\partial x_3}{\partial y} & \dfrac{\partial x_3}{\partial z}
\end{vmatrix}</math>

which after some calculation and applying some non-trivial cross-product identities can be shown to be equal to:

: <math>\frac{a_1 a_2 a_3}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)}</math>

(it may be advantageous for the sake of simplifying calculations, to work in such a cartesian coordinate system, in which it just so happens that <math>\mathbf{a}_1</math> is parallel to the ''x'' axis, <math>\mathbf{a}_2</math> lies in the ''xy''-plane, and <math>\mathbf{a}_3</math> has components of all three axes). The denominator is exactly the volume of the primitive unit cell which is enclosed by the three primitive-vectors <math>\mathbf{a}_1</math>, <math>\mathbf{a}_2</math> and <math>\mathbf{a}_3</math>. In particular, we now know that

:<math>dx_1 \, dx_2 \, dx_3 = \frac{a_1 a_2 a_3}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)} \cdot dx \, dy \, dz. </math>

We can write now <math>h(\mathbf{G})</math> as an integral with the traditional coordinate system over the volume of the primitive cell, instead of with the <math>x_1</math>, <math>x_2</math> and <math>x_3</math> variables:

:<math>h(\mathbf{G}) = \frac{1}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)}\int_{C} d\mathbf{r} f(\mathbf{r})\cdot e^{-i \mathbf{G} \cdot \mathbf{r}} </math>

writing <math>d\mathbf{r}</math> for the volume element <math>dx \, dy \, dz</math>; and where <math>C</math> is the primitive unit cell, thus, <math>\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)</math> is the volume of the primitive unit cell.

=== Hilbert space interpretation ===
{{main|Hilbert space}}
In the language of [[Hilbert space]]s, the set of functions <math>\left\{e_n=e^{inx}: n \in \Z\right\}</math> is an [[orthonormal basis]] for the space <math>L^2([-\pi,\pi])</math> of square-integrable functions on <math>[-\pi,\pi]</math>. This space is actually a Hilbert space with an [[inner product]] given for any two elements <math>f</math> and <math>g</math> by:
:<math>\langle f,\, g \rangle \;\triangleq \; \frac{1}{2\pi}\int_{-\pi}^{\pi} f(x)g^*(x)\,dx,</math> &nbsp; &nbsp; where <math>g^{*}(x)</math> is the complex conjugate of <math>g(x).</math>
The basic Fourier series result for Hilbert spaces can be written as
:<math>f=\sum_{n=-\infty}^\infty \langle f,e_n \rangle \, e_n.</math>
[[File:Fourier series integral identities.gif|thumb|400px|right|Sines and cosines form an orthonormal set, as illustrated above. The integral of sine, cosine and their product is zero (green and red areas are equal, and cancel out) when <math>m</math>, <math>n</math> or the functions are different, and π only if <math>m</math> and <math>n</math> are equal, and the function used is the same.]]
This corresponds exactly to the complex exponential formulation given above. The version with sines and cosines is also justified with the Hilbert space interpretation. Indeed, the sines and cosines form an [[orthonormal set|orthogonal set]]:
:<math>\int_{-\pi}^{\pi} \cos(mx)\, \cos(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \cos((n-m)x)+\cos((n+m)x)\, dx = \pi \delta_{mn}, \quad m, n \ge 1, </math>
:<math>\int_{-\pi}^{\pi} \sin(mx)\, \sin(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \cos((n-m)x)-\cos((n+m)x)\, dx = \pi \delta_{mn}, \quad m, n \ge 1</math>
(where ''δ''<sub>''mn''</sub> is the [[Kronecker delta]]), and
:<math>\int_{-\pi}^{\pi} \cos(mx)\, \sin(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \sin((n+m)x)+\sin((n-m)x)\, dx = 0;\,</math>
furthermore, the sines and cosines are orthogonal to the constant function <math>1</math>. An ''orthonormal basis'' for <math>L^2([-\pi,\pi])</math> consisting of real functions is formed by the functions <math>1</math> and <math>\sqrt{2} \cos (nx)</math>, <math>\sqrt{2} \sin (nx)</math> with ''n''&nbsp;= 1,&nbsp;2,&nbsp;…. The density of their span is a consequence of the [[Stone–Weierstrass theorem]], but follows also from the properties of classical kernels like the [[Fejér kernel]].

== Properties ==

===Table of basic properties===
This table shows some mathematical operations in the time domain and the corresponding effect in the Fourier series coefficients. Notation:
This table shows some mathematical operations in the time domain and the corresponding effect in the Fourier series coefficients. Notation:
* [[complex conjugate|Complex conjugation]] is denoted by an asterisk.
* [[complex conjugate|Complex conjugation]] is denoted by an asterisk.
*<math>f(x),g(x)</math> designate <math>P</math>-periodic functions '''or''' functions defined only for <math>x \in [0,P] </math>.
*<math>f(x),g(x)</math> designate <math>P</math>-periodic functions '''or''' functions defined only for <math>x \in [0,P] </math>.
* <math>F[n], G[n]</math> designate the Fourier series coefficients (exponential form) of <math>f</math> and <math>g</math> as defined in equation {{EquationNote|Eq.5}}.
* <math>F[n], G[n]</math> designate the Fourier series coefficients (exponential form) of <math>f</math> and <math>g</math> as defined in equation {{EquationNote|Eq.6}}.


{| class="wikitable"
{| class="wikitable"
Line 389: Line 354:
| <math>f(-x)</math>
| <math>f(-x)</math>
| <math>F[-n]</math>
| <math>F[-n]</math>
|
|
| <ref name=Shmaliy/>{{rp|p. 610}}
| <ref name="Shmaliy" />{{rp|p. 610}}
|-
|-
| Time conjugation
| Time conjugation
| <math>f^*(x)</math>
| <math>f^*(x)</math>
| <math>F^*[-n]</math>
| <math>F^*[-n]</math>
|
|
| <ref name=Shmaliy/>{{rp|p. 610}}
| <ref name="Shmaliy" />{{rp|p. 610}}
|-
|-
| Time reversal & conjugation
| Time reversal & conjugation
Line 438: Line 403:
| <math>F[n-n_0] \!</math>
| <math>F[n-n_0] \!</math>
| <math>n_0 \in \mathbb{Z}</math>
| <math>n_0 \in \mathbb{Z}</math>
| <ref name=Shmaliy/>{{rp|p. 610}}
| <ref name="Shmaliy" />{{rp|p. 610}}
|}
|}


=== Symmetry properties ===
== Other properties ==


=== Symmetry ===
When the real and imaginary parts of a complex function are decomposed into their [[Even and odd functions#Even–odd decomposition|even and odd parts]], there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform:<ref name="ProakisManolakis1996">{{cite book|last1=Proakis|first1=John G. |last2=Manolakis|first2=Dimitris G.|author2-link= Dimitris Manolakis |title=Digital Signal Processing: Principles, Algorithms, and Applications|url=https://archive.org/details/digitalsignalpro00proa|url-access=registration|year=1996|publisher=Prentice Hall|isbn=978-0-13-373762-2|edition=3rd|page=[https://archive.org/details/digitalsignalpro00proa/page/291 291]}}</ref>
When the real and imaginary parts of a complex function are decomposed into their [[Even and odd functions#Even–odd decomposition|even and odd parts]], there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform:<ref name="ProakisManolakis1996">{{cite book|last1=Proakis|first1=John G. |last2=Manolakis|first2=Dimitris G.|author2-link= Dimitris Manolakis |title=Digital Signal Processing: Principles, Algorithms, and Applications|url=https://archive.org/details/digitalsignalpro00proa|url-access=registration|year=1996|publisher=Prentice Hall|isbn=978-0-13-373762-2|edition=3rd|page=[https://archive.org/details/digitalsignalpro00proa/page/291 291]}}</ref>


: <math>
:<math>
\begin{array}{rccccccccc}
\begin{array}{rccccccccc}
\text{Time domain} & f & = & f_{_{\text{RE}}} & + & f_{_{\text{RO}}} & + & i f_{_{\text{IE}}} & + &\underbrace{i\ f_{_{\text{IO}}}} \\
\text{Time domain} & f & = & f_{_{\text{RE}}} & + & f_{_{\text{RO}}} & + & i f_{_{\text{IE}}} & + &\underbrace{i\ f_{_{\text{IO}}}} \\
Line 470: Line 436:
=== Convolution theorems ===
=== Convolution theorems ===
{{main|Convolution theorem#Periodic convolution (Fourier series coefficients)}}
{{main|Convolution theorem#Periodic convolution (Fourier series coefficients)}}

Given <math>P</math>-periodic functions, <math>f_{_P}</math> and <math>g_{_P}</math> with Fourier series coefficients <math>F[n]</math> and <math>G[n],</math> <math>n \in \mathbb{Z},</math>
Given <math>P</math>-periodic functions, <math>f_{_P}</math> and <math>g_{_P}</math> with Fourier series coefficients <math>F[n]</math> and <math>G[n],</math> <math>n \in \mathbb{Z},</math>


Line 490: Line 457:


[[File:F orbital.png|thumb|right|The [[atomic orbital]]s of [[chemistry]] are partially described by [[spherical harmonic]]s, which can be used to produce Fourier series on the [[sphere]].]]
[[File:F orbital.png|thumb|right|The [[atomic orbital]]s of [[chemistry]] are partially described by [[spherical harmonic]]s, which can be used to produce Fourier series on the [[sphere]].]]

=== Riemannian manifolds ===
=== Riemannian manifolds ===
{{main|Laplace operator|Riemannian manifold}}
{{main|Laplace operator|Riemannian manifold}}
Line 502: Line 470:
This generalizes the Fourier transform to <math>L^1(G)</math> or <math>L^2(G)</math>, where <math>G</math> is an LCA group. If <math>G</math> is compact, one also obtains a Fourier series, which converges similarly to the <math>[-\pi,\pi]</math> case, but if <math>G</math> is noncompact, one obtains instead a [[Fourier integral]]. This generalization yields the usual [[Fourier transform]] when the underlying locally compact Abelian group is <math>\mathbb{R}</math>.
This generalizes the Fourier transform to <math>L^1(G)</math> or <math>L^2(G)</math>, where <math>G</math> is an LCA group. If <math>G</math> is compact, one also obtains a Fourier series, which converges similarly to the <math>[-\pi,\pi]</math> case, but if <math>G</math> is noncompact, one obtains instead a [[Fourier integral]]. This generalization yields the usual [[Fourier transform]] when the underlying locally compact Abelian group is <math>\mathbb{R}</math>.


== Extensions ==
== Table of common Fourier series ==
=== Fourier series on a square ===
Some common pairs of periodic functions and their Fourier Series coefficients are shown in the table below. The following notation applies:
We can also define the Fourier series for functions of two variables <math>x</math> and <math>y</math> in the square <math>[-\pi,\pi]\times[-\pi,\pi]</math>:


:<math>
*<math>f(x)</math> designates a periodic function defined on <math>0 < x \le P </math>.
\begin{align}
*<math>a_0, a_n, b_n</math> designate the Fourier Series coefficients (sine-cosine form) of the periodic function <math>f</math> as defined in {{EquationNote|Eq.1}}.
f(x,y) & = \sum_{j,k \in \Z} c_{j,k}e^{ijx}e^{iky},\\[5pt]
c_{j,k} & = \frac{1}{4 \pi^2} \int_{-\pi}^\pi \int_{-\pi}^\pi f(x,y) e^{-ijx}e^{-iky}\, dx \, dy.
\end{align}
</math>


Aside from being useful for solving partial differential equations such as the heat equation, one notable application of Fourier series on the square is in [[image compression]]. In particular, the [[jpeg]] image compression standard uses the two-dimensional [[discrete cosine transform]], which is a [[Fourier-related transform]] using only the cosine basis functions.{{cn|date=January 2021}}
{| class="wikitable"

|-
For two-dimensional arrays with a staggered appearance, half of the Fourier series coefficients disappear, due to additional symmetry.<ref>[https://www.youtube.com/watch?v=V7l9Im9zneg Vanishing of Half the Fourier Coefficients in Staggered Arrays]</ref>
! Time domain <br /> <math>f(x)</math>

! Plot
=== Fourier series of Bravais-lattice-periodic-function ===
! Frequency domain (sine-cosine form) <br /> <math>\begin{align}& a_0 \\ & a_n \quad \text{for } n \ge 1 \\ & b_n \quad \text{for } n \ge 1\end{align}</math>
<!--Linked from Reciprocal Lattice to anchor Multidimensional-->
! Remarks
A three-dimensional [[Bravais lattice]] is defined as the set of vectors of the form:
! Reference
:<math>\mathbf{R} = n_1\mathbf{a}_1 + n_2\mathbf{a}_2 + n_3\mathbf{a}_3</math>
|-
where <math>n_i</math> are integers and <math>\mathbf{a}_i</math> are three linearly independent vectors. Assuming we have some function, <math>f(\mathbf{r})</math>, such that it obeys the condition of periodicity for any Bravais lattice vector <math>\mathbf{R}</math>, <math>f(\mathbf{r}) = f(\mathbf{R}+\mathbf{r})</math>, we could make a Fourier series of it. This kind of function can be, for example, the effective potential that one electron "feels" inside a periodic crystal. It is useful to make the Fourier series of the potential when applying [[Bloch's Theorem|Bloch's theorem]]. First, we may write any arbitrary position vector <math>\mathbf{r}</math> in the coordinate-system of the lattice:
|<math>f(x)=A \left| \sin\left(\frac{2\pi}{P}x\right)\right| \quad \text{for } 0 \le x < P</math>

|[[File:PlotRectifiedSineSignal.svg|251px|center]]
:<math>\mathbf{r} = x_1\frac{\mathbf{a}_{1}}{a_1}+ x_2\frac{\mathbf{a}_{2}}{a_2}+ x_3\frac{\mathbf{a}_{3}}{a_3},</math>
|<math>\begin{align}

a_0 = & \frac{4A}{\pi}\\
where <math>a_i \triangleq |\mathbf{a}_i|,</math> meaning that <math>a_i</math> is defined to be the magnitude of <math>\mathbf{a}_i</math>, so <math>\hat{\mathbf{a}_{i}} = \frac {\mathbf{a}_{i}}{a_i}</math> is the unit vector directed along <math>\mathbf{a}_i</math>.
a_n = & \begin{cases}

\frac{-4A}{\pi}\frac{1}{n^2-1} & \quad n \text{ even} \\
Thus we can define a new function,
0 & \quad n \text{ odd}

\end{cases}\\
:<math>g(x_1,x_2,x_3) \triangleq f(\mathbf{r}) = f \left (x_1\frac{\mathbf{a}_{1}}{a_1}+x_2\frac{\mathbf{a}_{2}}{a_2}+x_3\frac{\mathbf{a}_{3}}{a_3} \right ).</math>
b_n = & 0\\

\end{align}</math>
This new function, <math>g(x_1,x_2,x_3)</math>, is now a function of three-variables, each of which has periodicity <math>a_1</math>'', <math>a_2</math>'', and <math>a_3</math> respectively:
|Full-wave rectified sine

|<ref name="Papula">{{cite book | last=Papula|first= Lothar| title=Mathematische Formelsammlung: für Ingenieure und Naturwissenschaftler| publisher=Vieweg+Teubner Verlag | year=2009 | isbn=978-3834807571|lang=de|trans-title=Mathematical Functions for Engineers and Physicists }}</ref>{{rp|p. 193}}
:<math>g(x_1,x_2,x_3) = g(x_1+a_1,x_2,x_3) = g(x_1,x_2+a_2,x_3) = g(x_1,x_2,x_3+a_3).</math>
|-

|<math>f(x)=\begin{cases}
This enables us to build up a set of Fourier coefficients, each being indexed by three independent integers <math>m_1,m_2,m_3</math>. In what follows, we use function notation to denote these coefficients, where previously we used subscripts. If we write a series for <math>g</math> on the interval <math>\left [ 0, a_1\right ]</math> for <math>x_1</math>, we can define the following:
A \sin\left(\frac{2\pi}{P}x\right) & \quad \text{for } 0 \le x < P/2 \\

0 & \quad \text{for } P/2 \le x < P\\
:<math>h^\mathrm{one}(m_1, x_2, x_3) \triangleq \frac{1}{a_1}\int_0^{a_1} g(x_1, x_2, x_3)\cdot e^{-i 2\pi \frac{m_1}{a_1} x_1}\, dx_1</math>
\end{cases}

And then we can write:

:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty h^\mathrm{one}(m_1, x_2, x_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1}</math>

Further defining:

:<math>
\begin{align}
h^\mathrm{two}(m_1, m_2, x_3) & \triangleq \frac{1}{a_2}\int_0^{a_2} h^\mathrm{one}(m_1, x_2, x_3)\cdot e^{-i 2\pi \frac{m_2}{a_2} x_2}\, dx_2 \\[12pt]
& = \frac{1}{a_2}\int_0^{a_2} dx_2 \frac{1}{a_1}\int_0^{a_1} dx_1 g(x_1, x_2, x_3)\cdot e^{-i 2\pi \left(\frac{m_1}{a_1} x_1+\frac{m_2}{a_2} x_2\right)}
\end{align}
</math>
</math>

|[[File:PlotHalfRectifiedSineSignal.svg|251px|center]]
We can write <math>g</math> once again as:
|<math>\begin{align}

a_0 = & \frac{2A}{\pi}\\
:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty \sum_{m_2=-\infty}^\infty h^\mathrm{two}(m_1, m_2, x_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1} \cdot e^{i 2\pi \frac{m_2}
a_n = & \begin{cases}
{a_2} x_2}</math>
\frac{-2A}{\pi}\frac{1}{n^2-1} & \quad n \text{ even} \\

0 & \quad n \text{ odd}
Finally applying the same for the third coordinate, we define:
\end{cases}\\
:<math>
b_n = & \begin{cases}
\begin{align}
\frac{A}{2} & \quad n=1 \\
h^\mathrm{three}(m_1, m_2, m_3) & \triangleq \frac{1}{a_3}\int_0^{a_3} h^\mathrm{two}(m_1, m_2, x_3)\cdot e^{-i 2\pi \frac{m_3}{a_3} x_3}\, dx_3 \\[12pt]
0 & \quad n > 1
& = \frac{1}{a_3}\int_0^{a_3} dx_3 \frac{1}{a_2}\int_0^{a_2} dx_2 \frac{1}{a_1}\int_0^{a_1} dx_1 g(x_1, x_2, x_3)\cdot e^{-i 2\pi \left(\frac{m_1}{a_1} x_1+\frac{m_2}{a_2} x_2 + \frac{m_3}{a_3} x_3\right)}
\end{cases}\\
\end{align}</math>
\end{align}
|Half-wave rectified sine
|<ref name=Papula/>{{rp|p. 193}}
|-
|<math>f(x)=\begin{cases}
A & \quad \text{for } 0 \le x < D \cdot P \\
0 & \quad \text{for } D \cdot P \le x < P\\
\end{cases}
</math>
</math>
|[[File:PlotRectangleSignal.svg|251px|center]]
|<math>\begin{align}
a_0 = & 2AD\\
a_n = & \frac{A}{n \pi} \sin \left( 2 \pi n D \right)\\
b_n = & \frac{2A}{n \pi} \left( \sin \left( \pi n D \right) \right) ^2\\
\end{align}</math>
| <math>0 \le D \le 1</math>
|
|-
|<math>f(x)=\frac{Ax}{P} \quad \text{for } 0 \le x < P</math>
|[[File:PlotSawtooth1Signal.svg|251px|center]]
|<math>\begin{align}
a_0 = & A\\
a_n = & 0\\
b_n = & \frac{-A}{n \pi}\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 192}}
|-
|<math>f(x)=A-\frac{Ax}{P} \quad \text{for } 0 \le x < P</math>
|[[File:PlotSawtooth2Signal.svg|251px|center]]
|<math>\begin{align}
a_0 = & A\\
a_n = & 0\\
b_n = & \frac{A}{n \pi}\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 192}}
|-
|<math>f(x)=\frac{4A}{P^2}\left( x-\frac{P}{2} \right)^2 \quad \text{for } 0 \le x < P</math>
|[[File:PlotParabolaSignal.svg|251px|center]]
|<math>\begin{align}
a_0 = & \frac{2A}{3}\\
a_n = & \frac{4A}{\pi^2 n^2}\\
b_n = & 0\\
\end{align}</math>
|
|<ref name=Papula/>{{rp|p. 193}}
|}


We write <math>g</math> as:
==Approximation and convergence of Fourier series==

:<math>g(x_1, x_2, x_3)=\sum_{m_1=-\infty}^\infty \sum_{m_2=-\infty}^\infty \sum_{m_3=-\infty}^\infty h^\mathrm{three}(m_1, m_2, m_3) \cdot e^{i 2\pi \frac{m_1}{a_1} x_1} \cdot e^{i 2\pi \frac{m_2}{a_2} x_2}\cdot e^{i 2\pi \frac{m_3}{a_3} x_3}</math>

Re-arranging:

:<math>g(x_1, x_2, x_3)=\sum_{m_1, m_2, m_3 \in \Z } h^\mathrm{three}(m_1, m_2, m_3) \cdot e^{i 2\pi \left( \frac{m_1}{a_1} x_1+ \frac{m_2}{a_2} x_2 + \frac{m_3}{a_3} x_3\right)}. </math>

Now, every ''reciprocal'' lattice vector can be written (but does not mean that it is the only way of writing) as <math>\mathbf{G} = m_1\mathbf{g}_1 + m_2\mathbf{g}_2 + m_3\mathbf{g}_3</math>, where <math>m_i</math> are integers and <math>\mathbf{g}_i</math> are reciprocal lattice vectors to satisfy <math>\mathbf{g_i} \cdot \mathbf{a_j}=2\pi\delta_{ij}</math> (<math>\delta_{ij} = 1</math> for <math>i = j</math>, and <math>\delta_{ij} = 0</math> for <math>i \neq j</math>). Then for any arbitrary reciprocal lattice vector <math>\mathbf{G}</math> and arbitrary position vector <math>\mathbf{r}</math> in the original Bravais lattice space, their scalar product is:

:<math>\mathbf{G} \cdot \mathbf{r} = \left ( m_1\mathbf{g}_1 + m_2\mathbf{g}_2 + m_3\mathbf{g}_3 \right ) \cdot \left (x_1\frac{\mathbf{a}_1}{a_1}+ x_2\frac{\mathbf{a}_2}{a_2} +x_3\frac{\mathbf{a}_3}{a_3} \right ) = 2\pi \left( x_1\frac{m_1}{a_1}+x_2\frac{m_2}{a_2}+x_3\frac{m_3}{a_3} \right ).</math>

So it is clear that in our expansion of <math>g(x_1,x_2,x_3) = f(\mathbf{r})</math>, the sum is actually over reciprocal lattice vectors:

:<math>f(\mathbf{r})=\sum_{\mathbf{G}} h(\mathbf{G}) \cdot e^{i \mathbf{G} \cdot \mathbf{r}}, </math>

where

:<math>h(\mathbf{G}) = \frac{1}{a_3} \int_0^{a_3} dx_3 \, \frac{1}{a_2}\int_0^{a_2} dx_2 \, \frac{1}{a_1}\int_0^{a_1} dx_1 \, f\left(x_1\frac{\mathbf{a}_1}{a_1} + x_2\frac{\mathbf{a}_2}{a_2} + x_3\frac{\mathbf{a}_3}{a_3} \right)\cdot e^{-i \mathbf{G} \cdot \mathbf{r}}. </math>

Assuming

:<math>\mathbf{r} = (x,y,z) = x_1\frac{\mathbf{a}_1}{a_1}+x_2\frac{\mathbf{a}_2}{a_2}+x_3\frac{\mathbf{a}_3}{a_3},</math>

we can solve this system of three linear equations for <math>x</math>, <math>y</math>, and <math>z</math> in terms of <math>x_1</math>, <math>x_2</math> and <math>x_3</math> in order to calculate the volume element in the original cartesian coordinate system. Once we have <math>x</math>, <math>y</math>, and <math>z</math> in terms of <math>x_1</math>, <math>x_2</math> and <math>x_3</math>, we can calculate the [[Jacobian matrix and determinant|Jacobian determinant]]:

:<math>\begin{vmatrix}
\dfrac{\partial x_1}{\partial x} & \dfrac{\partial x_1}{\partial y} & \dfrac{\partial x_1}{\partial z} \\[12pt]
\dfrac{\partial x_2}{\partial x} & \dfrac{\partial x_2}{\partial y} & \dfrac{\partial x_2}{\partial z} \\[12pt]
\dfrac{\partial x_3}{\partial x} & \dfrac{\partial x_3}{\partial y} & \dfrac{\partial x_3}{\partial z}
\end{vmatrix}</math>

which after some calculation and applying some non-trivial cross-product identities can be shown to be equal to:

:<math>\frac{a_1 a_2 a_3}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)}</math>

(it may be advantageous for the sake of simplifying calculations, to work in such a cartesian coordinate system, in which it just so happens that <math>\mathbf{a}_1</math> is parallel to the ''x'' axis, <math>\mathbf{a}_2</math> lies in the ''xy''-plane, and <math>\mathbf{a}_3</math> has components of all three axes). The denominator is exactly the volume of the primitive unit cell which is enclosed by the three primitive-vectors <math>\mathbf{a}_1</math>, <math>\mathbf{a}_2</math> and <math>\mathbf{a}_3</math>. In particular, we now know that

:<math>dx_1 \, dx_2 \, dx_3 = \frac{a_1 a_2 a_3}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)} \cdot dx \, dy \, dz. </math>

We can write now <math>h(\mathbf{G})</math> as an integral with the traditional coordinate system over the volume of the primitive cell, instead of with the <math>x_1</math>, <math>x_2</math> and <math>x_3</math> variables:

:<math>h(\mathbf{G}) = \frac{1}{\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)}\int_{C} d\mathbf{r} f(\mathbf{r})\cdot e^{-i \mathbf{G} \cdot \mathbf{r}} </math>

writing <math>d\mathbf{r}</math> for the volume element <math>dx \, dy \, dz</math>; and where <math>C</math> is the primitive unit cell, thus, <math>\mathbf{a}_1\cdot(\mathbf{a}_2 \times \mathbf{a}_3)</math> is the volume of the primitive unit cell.

=== Hilbert space interpretation ===
{{main|Hilbert space}}

In the language of [[Hilbert space]]s, the set of functions <math>\left\{e_n=e^{inx}: n \in \Z\right\}</math> is an [[orthonormal basis]] for the space <math>L^2([-\pi,\pi])</math> of square-integrable functions on <math>[-\pi,\pi]</math>. This space is actually a Hilbert space with an [[inner product]] given for any two elements <math>f</math> and <math>g</math> by:
:<math>\langle f,\, g \rangle \;\triangleq \; \frac{1}{2\pi}\int_{-\pi}^{\pi} f(x)g^*(x)\,dx,</math> &nbsp; &nbsp; where <math>g^{*}(x)</math> is the complex conjugate of <math>g(x).</math>
The basic Fourier series result for Hilbert spaces can be written as
:<math>f=\sum_{n=-\infty}^\infty \langle f,e_n \rangle \, e_n.</math>
[[File:Fourier series integral identities.gif|thumb|400px|right|Sines and cosines form an orthonormal set, as illustrated above. The integral of sine, cosine and their product is zero (green and red areas are equal, and cancel out) when <math>m</math>, <math>n</math> or the functions are different, and π only if <math>m</math> and <math>n</math> are equal, and the function used is the same.]]
This corresponds exactly to the complex exponential formulation given above. The version with sines and cosines is also justified with the Hilbert space interpretation. Indeed, the sines and cosines form an [[orthonormal set|orthogonal set]]:
:<math>\int_{-\pi}^{\pi} \cos(mx)\, \cos(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \cos((n-m)x)+\cos((n+m)x)\, dx = \pi \delta_{mn}, \quad m, n \ge 1, </math>
:<math>\int_{-\pi}^{\pi} \sin(mx)\, \sin(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \cos((n-m)x)-\cos((n+m)x)\, dx = \pi \delta_{mn}, \quad m, n \ge 1</math>
(where ''δ''<sub>''mn''</sub> is the [[Kronecker delta]]), and
:<math>\int_{-\pi}^{\pi} \cos(mx)\, \sin(nx)\, dx = \frac{1}{2}\int_{-\pi}^{\pi} \sin((n+m)x)+\sin((n-m)x)\, dx = 0;\,</math>
furthermore, the sines and cosines are orthogonal to the constant function <math>1</math>. An ''orthonormal basis'' for <math>L^2([-\pi,\pi])</math> consisting of real functions is formed by the functions <math>1</math> and <math>\sqrt{2} \cos (nx)</math>, <math>\sqrt{2} \sin (nx)</math> with ''n''&nbsp;= 1,&nbsp;2,&nbsp;…. The density of their span is a consequence of the [[Stone–Weierstrass theorem]], but follows also from the properties of classical kernels like the [[Fejér kernel]].

== Approximation and convergence of Fourier series ==
{{main|Convergence of Fourier series}}
{{main|Convergence of Fourier series}}


Recalling {{EquationNote|Eq.5}},
Recalling {{EquationNote|Eq.6}}:


:<math>s_{_N}(x) = \sum_{n=-N}^N S[n]\ e^{i\tfrac{2\pi}{P}nx},</math>
:<math>s_{_N}(x) = \sum_{n=-N}^N S[n]\ e^{i\tfrac{2\pi}{P}nx},</math>
Line 613: Line 613:
:<math>\| g \|_2 = \sqrt{{1 \over P} \int_P |g(x)|^2 \, dx}.</math>
:<math>\| g \|_2 = \sqrt{{1 \over P} \int_P |g(x)|^2 \, dx}.</math>
</blockquote>
</blockquote>

===Convergence ===
===Convergence ===
{{See also|Gibbs phenomenon}}
{{See also|Gibbs phenomenon}}
Line 692: Line 693:


<ref name=iit.edu>{{Cite web |title=Fourier Series and Boundary Value Problems|last=Fasshauer |first=Greg |work=Math 461 Course Notes, Ch 3 |publisher=Department of Applied Mathematics, Illinois Institute of Technology |date=2015 |access-date=6 November 2020 |url= http://www.math.iit.edu/~fass/Notes461_Ch3Print.pdf }}</ref>
<ref name=iit.edu>{{Cite web |title=Fourier Series and Boundary Value Problems|last=Fasshauer |first=Greg |work=Math 461 Course Notes, Ch 3 |publisher=Department of Applied Mathematics, Illinois Institute of Technology |date=2015 |access-date=6 November 2020 |url= http://www.math.iit.edu/~fass/Notes461_Ch3Print.pdf }}</ref>


}}
}}


===Further reading===
===Further reading===
{{refbegin|2|indent=yes}}
{{refbegin|2|indent=yes}}
* {{cite book |author1 =William E. Boyce |author2 =Richard C. DiPrima |title=Elementary Differential Equations and Boundary Value Problems |edition=8th |publisher=John Wiley & Sons, Inc. |location=New Jersey |year=2005 |isbn=0-471-43338-1}}
*{{cite book |author1 =William E. Boyce |author2 =Richard C. DiPrima |title=Elementary Differential Equations and Boundary Value Problems |edition=8th |publisher=John Wiley & Sons, Inc. |location=New Jersey |year=2005 |isbn=0-471-43338-1}}
* {{cite book | author = Joseph Fourier, translated by Alexander Freeman | title = The Analytical Theory of Heat | publisher = Dover Publications | year = 2003 | isbn = 0-486-49531-0 }} 2003 unabridged republication of the 1878 English translation by Alexander Freeman of Fourier's work ''Théorie Analytique de la Chaleur'', originally published in 1822.
*{{cite book | author = Joseph Fourier, translated by Alexander Freeman | title = The Analytical Theory of Heat | publisher = Dover Publications | year = 2003 | isbn = 0-486-49531-0 }} 2003 unabridged republication of the 1878 English translation by Alexander Freeman of Fourier's work ''Théorie Analytique de la Chaleur'', originally published in 1822.
* {{cite journal |author=Enrique A. Gonzalez-Velasco |title=Connections in Mathematical Analysis: The Case of Fourier Series |journal=American Mathematical Monthly |volume=99 |year=1992 |pages=427–441 |issue=5 |doi=10.2307/2325087|jstor=2325087 }}
*{{cite journal |author=Enrique A. Gonzalez-Velasco |title=Connections in Mathematical Analysis: The Case of Fourier Series |journal=American Mathematical Monthly |volume=99 |year=1992 |pages=427–441 |issue=5 |doi=10.2307/2325087|jstor=2325087 }}
*{{cite book|last1=Fetter|first1=Alexander L. |last2=Walecka|first2=John Dirk |title=Theoretical Mechanics of Particles and Continua|url=https://books.google.com/books?id=olMpStYOlnoC&pg=PA209|date= 2003|publisher=Courier |isbn=978-0-486-43261-8}}
*{{cite book|last1=Fetter|first1=Alexander L. |last2=Walecka|first2=John Dirk |title=Theoretical Mechanics of Particles and Continua|url=https://books.google.com/books?id=olMpStYOlnoC&pg=PA209|date= 2003|publisher=Courier |isbn=978-0-486-43261-8}}
* {{Cite book| last=Katznelson| first= Yitzhak| title=An introduction to harmonic analysis| edition = Second corrected | publisher = Dover Publications, Inc | year=1976 | location=New York | isbn=0-486-63331-4}}
*{{Cite book| last=Katznelson| first= Yitzhak| title=An introduction to harmonic analysis| edition = Second corrected | publisher = Dover Publications, Inc | year=1976 | location=New York | isbn=0-486-63331-4}}
* [[Felix Klein]], ''Development of mathematics in the 19th century''. Mathsci Press Brookline, Mass, 1979. Translated by M. Ackerman from ''Vorlesungen über die Entwicklung der Mathematik im 19 Jahrhundert'', Springer, Berlin, 1928.
*[[Felix Klein]], ''Development of mathematics in the 19th century''. Mathsci Press Brookline, Mass, 1979. Translated by M. Ackerman from ''Vorlesungen über die Entwicklung der Mathematik im 19 Jahrhundert'', Springer, Berlin, 1928.
* {{cite book |author=Walter Rudin |author-link=Walter Rudin |title=Principles of mathematical analysis |url=https://archive.org/details/principlesofmath00rudi |url-access=registration |edition=3rd |publisher=McGraw-Hill, Inc. |location=New York |year=1976 |isbn=0-07-054235-X}}
*{{cite book |author=Walter Rudin |author-link=Walter Rudin |title=Principles of mathematical analysis |url=https://archive.org/details/principlesofmath00rudi |url-access=registration |edition=3rd |publisher=McGraw-Hill, Inc. |location=New York |year=1976 |isbn=0-07-054235-X}}
* {{cite book | author=A. Zygmund | author-link=Antoni Zygmund | title= Trigonometric Series | title-link = Trigonometric Series | edition=third | publisher = Cambridge University Press | location=Cambridge | year=2002 | isbn=0-521-89053-5}} The first edition was published in 1935.
*{{cite book | author=A. Zygmund | author-link=Antoni Zygmund | title= Trigonometric Series | title-link = Trigonometric Series | edition=third | publisher = Cambridge University Press | location=Cambridge | year=2002 | isbn=0-521-89053-5}} The first edition was published in 1935.
{{refend}}
{{refend}}


Line 711: Line 710:
*{{springer|title=Fourier series|id=p/f041090}}
*{{springer|title=Fourier series|id=p/f041090}}
*{{Cite EB1911 |wstitle=Fourier's Series |volume=10 |pages=753–758 |first=Ernest |last=Hobson |short=1 |authorlink=E. W. Hobson}}
*{{Cite EB1911 |wstitle=Fourier's Series |volume=10 |pages=753–758 |first=Ernest |last=Hobson |short=1 |authorlink=E. W. Hobson}}
* {{MathWorld | urlname= FourierSeries | title= Fourier Series}}
*{{MathWorld | urlname= FourierSeries | title= Fourier Series}}
* {{webarchive |url=https://web.archive.org/web/20011205152434/http://www.shsu.edu/~icc_cmf/bio/fourier.html |date=December 5, 2001 |title=Joseph Fourier – A site on Fourier's life which was used for the historical section of this article }}
*{{webarchive |url=https://web.archive.org/web/20011205152434/http://www.shsu.edu/~icc_cmf/bio/fourier.html |date=December 5, 2001 |title=Joseph Fourier – A site on Fourier's life which was used for the historical section of this article }}


{{PlanetMath attribution|id=4718|title=example of Fourier series}}
{{PlanetMath attribution|id=4718|title=example of Fourier series}}

Revision as of 16:21, 29 October 2021

In mathematics, a Fourier series (/ˈfʊri, -iər/[1]) is a periodic function composed of harmonically related sinusoids, combined by a weighted summation. With appropriate weights, one cycle (or period) of the summation can be made to approximate an arbitrary function in that interval (or the entire function if it too is periodic). As such, the summation is a synthesis of another function. The discrete-time Fourier transform is an example of Fourier series. The process of deriving weights that describe a given function is a form of Fourier analysis. For functions on unbounded intervals, the analysis and synthesis analogies are Fourier transform and inverse transform.

Since Fourier's time, many different approaches to defining and understanding the concept of Fourier series have been discovered, all of which are consistent with one another, but each of which emphasizes different aspects of the topic. Some of the more powerful and elegant approaches are based on mathematical ideas and tools that were not available at the time Fourier completed his original work. Fourier originally defined the Fourier series for real-valued functions of real arguments, and using the sine and cosine functions as the basis set for the decomposition. Many other Fourier-related transforms have since been defined, extending the initial idea to other applications. This general area of inquiry is now sometimes called harmonic analysis. A Fourier series, however, can be used only for periodic functions, or for functions on a bounded (compact) interval.

Function (in red) is a sum of six sine functions of different amplitudes and harmonically related frequencies. Their summation is called a Fourier series. The Fourier transform, (in blue), which depicts amplitude vs frequency, reveals the 6 frequencies (at odd harmonics) and their amplitudes (1/odd number).

Definition

Consider a real-valued function, that is integrable on an interval of length which will be the period of the Fourier series. The correlation function:is essentially a matched filter, with template Its peak value is a relative measure of the presence of frequency in function The analysis process determines, for certain key frequencies, the maximum correlation and the corresponding phase offset, The synthesis process (the actual Fourier series), in terms of parameters to be determined by analysis, is:

Fourier series, amplitude-phase form
(Eq.1)
  • In general, integer is theoretically infinite. Even so, the series might not converge or exactly equate to at all values of (such as a single-point discontinuity) in the analysis interval. For the "well-behaved" functions typical of physical processes, equality is customarily assumed.
  • Integer used as an index, is also the number of cycles of the -th harmonic in interval Therefore, the length of a cycle, in the units of is The corresponding harmonic frequency is so the -th harmonic is Some texts define to simplify the argument of the sinusoid functions at the expense of generality.
The sum of the sinusoidal components of a Fourier series is a periodic function, whether or not the original function, s(x), is periodic.
If is a function contained in an interval of length (and zero elsewhere), the upper-right quadrant is an example of what its Fourier series coefficients () might look like when plotted against their corresponding harmonic frequencies. The upper-left quadrant is the corresponding Fourier transform of The Fourier series summation (not shown) synthesizes a periodic summation of whereas the inverse Fourier transform (not shown) synthesizes only

Rather than computationally intensive cross-correlation, Fourier analysis customarily exploits a trigonometric identity:

where parameters and replace and and can be found by evaluating the cross-correlation at only two values of phase:[2]

Fourier coefficients
(Eq.2)

Then: and (see Atan2) or more directly:

Fourier series, sine-cosine form
(Eq.3)

And note that and can be reduced to    and  

Another applicable identity is Euler's formula. Here, complex conjugation is denoted by an asterisk:

Therefore, with definitions:

the final result is:

Fourier series, exponential form
(Eq.4)

This is the customary form for generalizing to § Complex-valued functions.

Example

Plot of the sawtooth wave, a periodic continuation of the linear function on the interval
Animated plot of the first five successive partial Fourier series

Consider a sawtooth function:

In this case, the Fourier coefficients are given by

It can be shown that Fourier series converges to at every point where is differentiable, and therefore:

(Eq.5)

When , the Fourier series converges to 0, which is the half-sum of the left- and right-limit of s at . This is a particular instance of the Dirichlet theorem for Fourier series.

This example leads to a solution to the Basel problem.

Convergence

In engineering applications, the Fourier series is generally presumed to converge almost everywhere (the exceptions being at discrete discontinuities) since the functions encountered in engineering are better-behaved than the functions that mathematicians can provide as counter-examples to this presumption. In particular, if is continuous and the derivative of (which may not exist everywhere) is square integrable, then the Fourier series of converges absolutely and uniformly to .[3] If a function is square-integrable on the interval , then the Fourier series converges to the function at almost every point. Convergence of Fourier series also depends on the finite number of maxima and minima in a function which is popularly known as one of the Dirichlet's condition for Fourier series. See Convergence of Fourier series. It is possible to define Fourier coefficients for more general functions or distributions, in such cases convergence in norm or weak convergence is usually of interest.

  • Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a square wave improves as the number of terms increases (animation)
    Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a square wave improves as the number of terms increases (animation)
  • Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a sawtooth wave improves as the number of terms increases (animation)
    Four partial sums (Fourier series) of lengths 1, 2, 3, and 4 terms, showing how the approximation to a sawtooth wave improves as the number of terms increases (animation)
  • Example of convergence to a somewhat arbitrary function. Note the development of the "ringing" (Gibbs phenomenon) at the transitions to/from the vertical sections.
    Example of convergence to a somewhat arbitrary function. Note the development of the "ringing" (Gibbs phenomenon) at the transitions to/from the vertical sections.

Complex-valued functions

If is a complex-valued function of a real variable both components (real and imaginary part) are real-valued functions that can be represented by a Fourier series. The two sets of coefficients and the partial sum are given by:

    and    

Defining yields:

(Eq.6)

This is identical to Eq.4 except and are no longer complex conjugates. The formula for is also unchanged:

Other common notations

The notation is inadequate for discussing the Fourier coefficients of several different functions. Therefore, it is customarily replaced by a modified form of the function (, in this case), such as or , and functional notation often replaces subscripting:

In engineering, particularly when the variable represents time, the coefficient sequence is called a frequency domain representation. Square brackets are often used to emphasize that the domain of this function is a discrete set of frequencies.

Another commonly used frequency domain representation uses the Fourier series coefficients to modulate a Dirac comb:

where represents a continuous frequency domain. When variable has units of seconds, has units of hertz. The "teeth" of the comb are spaced at multiples (i.e. harmonics) of , which is called the fundamental frequency.    can be recovered from this representation by an inverse Fourier transform:

The constructed function is therefore commonly referred to as a Fourier transform, even though the Fourier integral of a periodic function is not convergent at the harmonic frequencies.[A]

History

The Fourier series is named in honor of Jean-Baptiste Joseph Fourier (1768–1830), who made important contributions to the study of trigonometric series, after preliminary investigations by Leonhard Euler, Jean le Rond d'Alembert, and Daniel Bernoulli.[B] Fourier introduced the series for the purpose of solving the heat equation in a metal plate, publishing his initial results in his 1807 Mémoire sur la propagation de la chaleur dans les corps solides (Treatise on the propagation of heat in solid bodies), and publishing his Théorie analytique de la chaleur (Analytical theory of heat) in 1822. The Mémoire introduced Fourier analysis, specifically Fourier series. Through Fourier's research the fact was established that an arbitrary (at first, continuous [4] and later generalized to any piecewise-smooth[5]) function can be represented by a trigonometric series. The first announcement of this great discovery was made by Fourier in 1807, before the French Academy.[6] Early ideas of decomposing a periodic function into the sum of simple oscillating functions date back to the 3rd century BC, when ancient astronomers proposed an empiric model of planetary motions, based on deferents and epicycles.

The heat equation is a partial differential equation. Prior to Fourier's work, no solution to the heat equation was known in the general case, although particular solutions were known if the heat source behaved in a simple way, in particular, if the heat source was a sine or cosine wave. These simple solutions are now sometimes called eigensolutions. Fourier's idea was to model a complicated heat source as a superposition (or linear combination) of simple sine and cosine waves, and to write the solution as a superposition of the corresponding eigensolutions. This superposition or linear combination is called the Fourier series.

From a modern point of view, Fourier's results are somewhat informal, due to the lack of a precise notion of function and integral in the early nineteenth century. Later, Peter Gustav Lejeune Dirichlet[7] and Bernhard Riemann[8][9][10] expressed Fourier's results with greater precision and formality.

Although the original motivation was to solve the heat equation, it later became obvious that the same techniques could be applied to a wide array of mathematical and physical problems, and especially those involving linear differential equations with constant coefficients, for which the eigensolutions are sinusoids. The Fourier series has many such applications in electrical engineering, vibration analysis, acoustics, optics, signal processing, image processing, quantum mechanics, econometrics,[11] shell theory,[12] etc.

Beginnings

Joseph Fourier wrote:[dubiousdiscuss]

Multiplying both sides by , and then integrating from to yields:

This immediately gives any coefficient ak of the trigonometrical series for φ(y) for any function which has such an expansion. It works because if φ has such an expansion, then (under suitable convergence assumptions) the integral

can be carried out term-by-term. But all terms involving for jk vanish when integrated from −1 to 1, leaving only the kth term.

In these few lines, which are close to the modern formalism used in Fourier series, Fourier revolutionized both mathematics and physics. Although similar trigonometric series were previously used by Euler, d'Alembert, Daniel Bernoulli and Gauss, Fourier believed that such trigonometric series could represent any arbitrary function. In what sense that is actually true is a somewhat subtle issue and the attempts over many years to clarify this idea have led to important discoveries in the theories of convergence, function spaces, and harmonic analysis.

When Fourier submitted a later competition essay in 1811, the committee (which included Lagrange, Laplace, Malus and Legendre, among others) concluded: ...the manner in which the author arrives at these equations is not exempt of difficulties and...his analysis to integrate them still leaves something to be desired on the score of generality and even rigour.[citation needed]

Fourier's motivation

Heat distribution in a metal plate, using Fourier's method

The Fourier series expansion of the sawtooth function (above) looks more complicated than the simple formula , so it is not immediately apparent why one would need the Fourier series. While there are many applications, Fourier's motivation was in solving the heat equation. For example, consider a metal plate in the shape of a square whose sides measure meters, with coordinates . If there is no heat source within the plate, and if three of the four sides are held at 0 degrees Celsius, while the fourth side, given by , is maintained at the temperature gradient degrees Celsius, for in , then one can show that the stationary heat distribution (or the heat distribution after a long period of time has elapsed) is given by

Here, sinh is the hyperbolic sine function. This solution of the heat equation is obtained by multiplying each term of  Eq.5 by . While our example function seems to have a needlessly complicated Fourier series, the heat distribution is nontrivial. The function cannot be written as a closed-form expression. This method of solving the heat problem was made possible by Fourier's work.

Complex Fourier series animation

complex Fourier series converging to drawing of the letter 'e'

An example of the ability of the complex Fourier series to draw any two dimensional closed figure is shown in the adjacent animation of the complex Fourier series converging to a drawing in the complex plane of the letter 'e' (for exponential). The animation alternates between fast rotations to take less time and slow rotations to show more detail. The terms of the complex Fourier series are shown in two rotating arms: one arm is an aggregate of all the complex Fourier series terms that rotate in the positive direction (counter clockwise, according to the right hand rule), the other arm is an aggregate of all the complex Fourier series terms that rotate in the negative direction. The constant term that does not rotate at all is evenly split between the two arms. The animation's small circle represents the midpoint between the extent of the two arms, which is also the midpoint between the origin and the complex Fourier series approximation which is the '+' symbol in the animation. (The GNU Octave source code for generating this animation is here.[14] Note that the animation uses the variable 't' to parameterize the drawing in the complex plane, equivalent to the use of the parameter 'x' in this article's subsection on complex valued functions.)

Other applications

Another application of this Fourier series is to solve the Basel problem by using Parseval's theorem. The example generalizes and one may compute ζ(2n), for any positive integer n.

Table of common Fourier series

Some common pairs of periodic functions and their Fourier Series coefficients are shown in the table below. The following notation applies:

  • designates a periodic function defined on .
  • designate the Fourier Series coefficients (sine-cosine form) of the periodic function as defined in Eq.2.
Time domain
Plot Frequency domain (sine-cosine form)
Remarks Reference
Full-wave rectified sine [15]: p. 193 
Half-wave rectified sine [15]: p. 193 
[15]: p. 192 
[15]: p. 192 
[15]: p. 193 

Table of basic properties

This table shows some mathematical operations in the time domain and the corresponding effect in the Fourier series coefficients. Notation:

  • Complex conjugation is denoted by an asterisk.
  • designate -periodic functions or functions defined only for .
  • designate the Fourier series coefficients (exponential form) of and as defined in equation Eq.6.
Property Time domain Frequency domain (exponential form) Remarks Reference
Linearity
Time reversal / Frequency reversal [16]: p. 610 
Time conjugation [16]: p. 610 
Time reversal & conjugation
Real part in time
Imaginary part in time
Real part in frequency
Imaginary part in frequency
Shift in time / Modulation in frequency [16]: p. 610 
Shift in frequency / Modulation in time [16]: p. 610 

Other properties

Symmetry

When the real and imaginary parts of a complex function are decomposed into their even and odd parts, there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform:[17]

From this, various relationships are apparent, for example:

  • The transform of a real-valued function (fRE+ fRO) is the even symmetric function FRE+ i FIO. Conversely, an even-symmetric transform implies a real-valued time-domain.
  • The transform of an imaginary-valued function (i fIE+ i fIO) is the odd symmetric function FRO+ i FIE, and the converse is true.
  • The transform of an even-symmetric function (fRE+ i fIO) is the real-valued function FRE+ FRO, and the converse is true.
  • The transform of an odd-symmetric function (fRO+ i fIE) is the imaginary-valued function i FIE+ i FIO, and the converse is true.

Riemann–Lebesgue lemma

If is integrable, , and This result is known as the Riemann–Lebesgue lemma.

Parseval's theorem

If belongs to (an interval of length ) then:

Plancherel's theorem

If are coefficients and then there is a unique function such that for every .

Convolution theorems

Given -periodic functions, and with Fourier series coefficients and

  • The pointwise product: is also -periodic, and its Fourier series coefficients are given by the discrete convolution of the and sequences:
  • The periodic convolution: is also -periodic, with Fourier series coefficients:
  • A doubly infinite sequence in is the sequence of Fourier coefficients of a function in if and only if it is a convolution of two sequences in . See [18]

Derivative property

We say that belongs to if is a 2π-periodic function on which is times differentiable, and its kth derivative is continuous.

  • If , then the Fourier coefficients of the derivative can be expressed in terms of the Fourier coefficients of the function , via the formula .
  • If , then . In particular, since for a fixed we have as , it follows that tends to zero, which means that the Fourier coefficients converge to zero faster than the kth power of n for any .

Compact groups

One of the interesting properties of the Fourier transform which we have mentioned, is that it carries convolutions to pointwise products. If that is the property which we seek to preserve, one can produce Fourier series on any compact group. Typical examples include those classical groups that are compact. This generalizes the Fourier transform to all spaces of the form L2(G), where G is a compact group, in such a way that the Fourier transform carries convolutions to pointwise products. The Fourier series exists and converges in similar ways to the [−π,π] case.

An alternative extension to compact groups is the Peter–Weyl theorem, which proves results about representations of compact groups analogous to those about finite groups.

The atomic orbitals of chemistry are partially described by spherical harmonics, which can be used to produce Fourier series on the sphere.

Riemannian manifolds

If the domain is not a group, then there is no intrinsically defined convolution. However, if is a compact Riemannian manifold, it has a Laplace–Beltrami operator. The Laplace–Beltrami operator is the differential operator that corresponds to Laplace operator for the Riemannian manifold . Then, by analogy, one can consider heat equations on . Since Fourier arrived at his basis by attempting to solve the heat equation, the natural generalization is to use the eigensolutions of the Laplace–Beltrami operator as a basis. This generalizes Fourier series to spaces of the type , where is a Riemannian manifold. The Fourier series converges in ways similar to the case. A typical example is to take to be the sphere with the usual metric, in which case the Fourier basis consists of spherical harmonics.

Locally compact Abelian groups

The generalization to compact groups discussed above does not generalize to noncompact, nonabelian groups. However, there is a straightforward generalization to Locally Compact Abelian (LCA) groups.

This generalizes the Fourier transform to or , where is an LCA group. If is compact, one also obtains a Fourier series, which converges similarly to the case, but if is noncompact, one obtains instead a Fourier integral. This generalization yields the usual Fourier transform when the underlying locally compact Abelian group is .

Extensions

Fourier series on a square

We can also define the Fourier series for functions of two variables and in the square :

Aside from being useful for solving partial differential equations such as the heat equation, one notable application of Fourier series on the square is in image compression. In particular, the jpeg image compression standard uses the two-dimensional discrete cosine transform, which is a Fourier-related transform using only the cosine basis functions.[citation needed]

For two-dimensional arrays with a staggered appearance, half of the Fourier series coefficients disappear, due to additional symmetry.[19]

Fourier series of Bravais-lattice-periodic-function

A three-dimensional Bravais lattice is defined as the set of vectors of the form:

where are integers and are three linearly independent vectors. Assuming we have some function, , such that it obeys the condition of periodicity for any Bravais lattice vector , , we could make a Fourier series of it. This kind of function can be, for example, the effective potential that one electron "feels" inside a periodic crystal. It is useful to make the Fourier series of the potential when applying Bloch's theorem. First, we may write any arbitrary position vector in the coordinate-system of the lattice:

where meaning that is defined to be the magnitude of , so is the unit vector directed along .

Thus we can define a new function,

This new function, , is now a function of three-variables, each of which has periodicity , , and respectively:

This enables us to build up a set of Fourier coefficients, each being indexed by three independent integers . In what follows, we use function notation to denote these coefficients, where previously we used subscripts. If we write a series for on the interval for , we can define the following:

And then we can write:

Further defining:

We can write once again as:

Finally applying the same for the third coordinate, we define:

We write as:

Re-arranging:

Now, every reciprocal lattice vector can be written (but does not mean that it is the only way of writing) as , where are integers and are reciprocal lattice vectors to satisfy ( for , and for ). Then for any arbitrary reciprocal lattice vector and arbitrary position vector in the original Bravais lattice space, their scalar product is:

So it is clear that in our expansion of , the sum is actually over reciprocal lattice vectors:

where

Assuming

we can solve this system of three linear equations for , , and in terms of , and in order to calculate the volume element in the original cartesian coordinate system. Once we have , , and in terms of , and , we can calculate the Jacobian determinant:

which after some calculation and applying some non-trivial cross-product identities can be shown to be equal to:

(it may be advantageous for the sake of simplifying calculations, to work in such a cartesian coordinate system, in which it just so happens that is parallel to the x axis, lies in the xy-plane, and has components of all three axes). The denominator is exactly the volume of the primitive unit cell which is enclosed by the three primitive-vectors , and . In particular, we now know that

We can write now as an integral with the traditional coordinate system over the volume of the primitive cell, instead of with the , and variables:

writing for the volume element ; and where is the primitive unit cell, thus, is the volume of the primitive unit cell.

Hilbert space interpretation

In the language of Hilbert spaces, the set of functions is an orthonormal basis for the space of square-integrable functions on . This space is actually a Hilbert space with an inner product given for any two elements and by:

    where is the complex conjugate of

The basic Fourier series result for Hilbert spaces can be written as

Sines and cosines form an orthonormal set, as illustrated above. The integral of sine, cosine and their product is zero (green and red areas are equal, and cancel out) when , or the functions are different, and π only if and are equal, and the function used is the same.

This corresponds exactly to the complex exponential formulation given above. The version with sines and cosines is also justified with the Hilbert space interpretation. Indeed, the sines and cosines form an orthogonal set:

(where δmn is the Kronecker delta), and

furthermore, the sines and cosines are orthogonal to the constant function . An orthonormal basis for consisting of real functions is formed by the functions and , with n = 1, 2, …. The density of their span is a consequence of the Stone–Weierstrass theorem, but follows also from the properties of classical kernels like the Fejér kernel.

Approximation and convergence of Fourier series

Recalling Eq.6:

it is a trigonometric polynomial of degree , generally:

Least squares property

Parseval's theorem implies that:

Theorem. The trigonometric polynomial is the unique best trigonometric polynomial of degree approximating , in the sense that, for any trigonometric polynomial of degree , we have:

where the Hilbert space norm is defined as:

Convergence

Because of the least squares property, and because of the completeness of the Fourier basis, we obtain an elementary convergence result.

Theorem. If belongs to (an interval of length ), then converges to in , that is,  converges to 0 as .

We have already mentioned that if is continuously differentiable, then    is the nth Fourier coefficient of the derivative . It follows, essentially from the Cauchy–Schwarz inequality, that is absolutely summable. The sum of this series is a continuous function, equal to , since the Fourier series converges in the mean to :

Theorem. If , then converges to uniformly (and hence also pointwise.)

This result can be proven easily if is further assumed to be , since in that case tends to zero as . More generally, the Fourier series is absolutely summable, thus converges uniformly to , provided that satisfies a Hölder condition of order . In the absolutely summable case, the inequality:

  proves uniform convergence.

Many other results concerning the convergence of Fourier series are known, ranging from the moderately simple result that the series converges at if is differentiable at , to Lennart Carleson's much more sophisticated result that the Fourier series of an function actually converges almost everywhere.

These theorems, and informal variations of them that don't specify the convergence conditions, are sometimes referred to generically as "Fourier's theorem" or "the Fourier theorem".[20][21][22][23]

Divergence

Since Fourier series have such good convergence properties, many are often surprised by some of the negative results. For example, the Fourier series of a continuous T-periodic function need not converge pointwise.[citation needed] The uniform boundedness principle yields a simple non-constructive proof of this fact.

In 1922, Andrey Kolmogorov published an article titled Une série de Fourier-Lebesgue divergente presque partout in which he gave an example of a Lebesgue-integrable function whose Fourier series diverges almost everywhere. He later constructed an example of an integrable function whose Fourier series diverges everywhere (Katznelson 1976).

See also

Notes

  1. ^ Since the integral defining the Fourier transform of a periodic function is not convergent, it is necessary to view the periodic function and its transform as distributions. In this sense is a Dirac delta function, which is an example of a distribution.
  2. ^ These three did some important early work on the wave equation, especially D'Alembert. Euler's work in this area was mostly comtemporaneous/ in collaboration with Bernoulli, although the latter made some independent contributions to the theory of waves and vibrations. (See Fetter & Walecka 2003, pp. 209–210).
  3. ^ These words are not strictly Fourier's. Whilst the cited article does list the author as Fourier, a footnote indicates that the article was actually written by Poisson (that it was not written by Fourier is also clear from the consistent use of the third person to refer to him) and that it is, "for reasons of historical interest", presented as though it were Fourier's original memoire.

References

  1. ^ "Fourier". Dictionary.com Unabridged (Online). n.d.
  2. ^ Dorf, Richard C.; Tallarida, Ronald J. (1993). Pocket Book of Electrical Engineering Formulas (1st ed.). Boca Raton,FL: CRC Press. pp. 171–174. ISBN 0849344735.
  3. ^ Tolstov, Georgi P. (1976). Fourier Series. Courier-Dover. ISBN 0-486-63317-9.
  4. ^ Stillwell, John (2013). "Logic and the philosophy of mathematics in the nineteenth century". In Ten, C. L. (ed.). Routledge History of Philosophy. Vol. Volume VII: The Nineteenth Century. Routledge. p. 204. ISBN 978-1-134-92880-4. {{cite book}}: |volume= has extra text (help)
  5. ^ Fasshauer, Greg (2015). "Fourier Series and Boundary Value Problems" (PDF). Math 461 Course Notes, Ch 3. Department of Applied Mathematics, Illinois Institute of Technology. Retrieved 6 November 2020.
  6. ^ Cajori, Florian (1893). A History of Mathematics. Macmillan. p. 283.
  7. ^ Lejeune-Dirichlet, Peter Gustav (1829). "Sur la convergence des séries trigonométriques qui servent à représenter une fonction arbitraire entre des limites données" [On the convergence of trigonometric series which serve to represent an arbitrary function between two given limits]. Journal für die reine und angewandte Mathematik (in French). 4: 157–169. arXiv:0806.1294.
  8. ^ "Ueber die Darstellbarkeit einer Function durch eine trigonometrische Reihe" [About the representability of a function by a trigonometric series]. Habilitationsschrift, Göttingen; 1854. Abhandlungen der Königlichen Gesellschaft der Wissenschaften zu Göttingen, vol. 13, 1867. Published posthumously for Riemann by Richard Dedekind (in German). Archived from the original on 20 May 2008. Retrieved 19 May 2008.
  9. ^ Mascre, D.; Riemann, Bernhard (1867), "Posthumous Thesis on the Representation of Functions by Trigonometric Series", in Grattan-Guinness, Ivor (ed.), Landmark Writings in Western Mathematics 1640–1940, Elsevier (published 2005), p. 49, ISBN 9780080457444
  10. ^ Remmert, Reinhold (1991). Theory of Complex Functions: Readings in Mathematics. Springer. p. 29. ISBN 9780387971957.
  11. ^ Nerlove, Marc; Grether, David M.; Carvalho, Jose L. (1995). Analysis of Economic Time Series. Economic Theory, Econometrics, and Mathematical Economics. Elsevier. ISBN 0-12-515751-7.
  12. ^ Wilhelm Flügge, Stresses in Shells (1973) 2nd edition. ISBN 978-3-642-88291-3. Originally published in German as Statik und Dynamik der Schalen (1937).
  13. ^ Fourier, Jean-Baptiste-Joseph (1888). Gaston Darboux (ed.). Oeuvres de Fourier [The Works of Fourier] (in French). Paris: Gauthier-Villars et Fils. pp. 218–219 – via Gallica.
  14. ^ Sepesi, G (2021). "The Geometry of Exponential Growth". Towards Data Science. pp. section 5, GNU Octave source code.
  15. ^ a b c d e Papula, Lothar (2009). Mathematische Formelsammlung: für Ingenieure und Naturwissenschaftler [Mathematical Functions for Engineers and Physicists] (in German). Vieweg+Teubner Verlag. ISBN 978-3834807571.
  16. ^ a b c d Shmaliy, Y.S. (2007). Continuous-Time Signals. Springer. ISBN 978-1402062711.
  17. ^ Proakis, John G.; Manolakis, Dimitris G. (1996). Digital Signal Processing: Principles, Algorithms, and Applications (3rd ed.). Prentice Hall. p. 291. ISBN 978-0-13-373762-2.
  18. ^ "Characterizations of a linear subspace associated with Fourier series". MathOverflow. 2010-11-19. Retrieved 2014-08-08.
  19. ^ Vanishing of Half the Fourier Coefficients in Staggered Arrays
  20. ^ Siebert, William McC. (1985). Circuits, signals, and systems. MIT Press. p. 402. ISBN 978-0-262-19229-3.
  21. ^ Marton, L.; Marton, Claire (1990). Advances in Electronics and Electron Physics. Academic Press. p. 369. ISBN 978-0-12-014650-5.
  22. ^ Kuzmany, Hans (1998). Solid-state spectroscopy. Springer. p. 14. ISBN 978-3-540-63913-8.
  23. ^ Pribram, Karl H.; Yasue, Kunio; Jibu, Mari (1991). Brain and perception. Lawrence Erlbaum Associates. p. 26. ISBN 978-0-89859-995-4.

Further reading

  • William E. Boyce; Richard C. DiPrima (2005). Elementary Differential Equations and Boundary Value Problems (8th ed.). New Jersey: John Wiley & Sons, Inc. ISBN 0-471-43338-1.
  • Joseph Fourier, translated by Alexander Freeman (2003). The Analytical Theory of Heat. Dover Publications. ISBN 0-486-49531-0. 2003 unabridged republication of the 1878 English translation by Alexander Freeman of Fourier's work Théorie Analytique de la Chaleur, originally published in 1822.
  • Enrique A. Gonzalez-Velasco (1992). "Connections in Mathematical Analysis: The Case of Fourier Series". American Mathematical Monthly. 99 (5): 427–441. doi:10.2307/2325087. JSTOR 2325087.
  • Fetter, Alexander L.; Walecka, John Dirk (2003). Theoretical Mechanics of Particles and Continua. Courier. ISBN 978-0-486-43261-8.
  • Katznelson, Yitzhak (1976). An introduction to harmonic analysis (Second corrected ed.). New York: Dover Publications, Inc. ISBN 0-486-63331-4.
  • Felix Klein, Development of mathematics in the 19th century. Mathsci Press Brookline, Mass, 1979. Translated by M. Ackerman from Vorlesungen über die Entwicklung der Mathematik im 19 Jahrhundert, Springer, Berlin, 1928.
  • Walter Rudin (1976). Principles of mathematical analysis (3rd ed.). New York: McGraw-Hill, Inc. ISBN 0-07-054235-X.
  • A. Zygmund (2002). Trigonometric Series (third ed.). Cambridge: Cambridge University Press. ISBN 0-521-89053-5. The first edition was published in 1935.

External links

This article incorporates material from example of Fourier series on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.