Journal topic
Atmos. Meas. Tech., 12, 6125–6141, 2019
https://doi.org/10.5194/amt-12-6125-2019
Atmos. Meas. Tech., 12, 6125–6141, 2019
https://doi.org/10.5194/amt-12-6125-2019

Research article 25 Nov 2019

Research article | 25 Nov 2019

# Retrieval of atmospheric CH4 vertical information from ground-based FTS near-infrared spectra

Retrieval of atmospheric CH4 vertical information from ground-based FTS near-infrared spectra
Minqiang Zhou1, Bavo Langerock1, Mahesh Kumar Sha1, Nicolas Kumps1, Christian Hermans1, Christof Petri2, Thorsten Warneke2, Huilin Chen3, Jean-Marc Metzger4, Rigel Kivi5, Pauli Heikkinen5, Michel Ramonet6, and Martine De Mazière1 Minqiang Zhou et al.
• 1Royal Belgian Institute for Space Aeronomy (BIRA-IASB), Brussels, Belgium
• 2Institute of Environmental Physics, University of Bremen, Bremen, Germany
• 3Centre for Isotope Research (CIO), Energy and Sustainability Research Institute Groningen (ESRIG), University of Groningen, Groningen, the Netherlands
• 4UMS 3365 – OSU Réunion, Université de La Réunion, Saint-Denis, Réunion, France
• 5Finnish Meteorological Institute, Space and Earth Observation Centre, Sodankylä, Finland
• 6Laboratoire des Sciences du Climat et de l'Environnement (LSCE/IPSL), UMR CEA-CNRS-UVSQ, Gif-sur-Yvette, France

Correspondence: Minqiang Zhou (minqiang.zhou@aeronomie.be)

Abstract

The Total Carbon Column Observing Network (TCCON) column-averaged dry air mole fraction of CH4 (${X}_{{\mathrm{CH}}_{\mathrm{4}}}$) measurements have been widely used to validate satellite observations and to estimate model simulations. The GGG2014 code is the standard TCCON retrieval software used in performing a profile scaling retrieval. In order to obtain several vertical pieces of information in addition to the total column, in this study, the SFIT4 retrieval code is applied to retrieve the CH4 mole fraction vertical profile from the Fourier transform spectrometer (FTS) spectrum at six sites (Ny-Ålesund, Sodankylä, Bialystok, Bremen, Orléans and St Denis) during the time period of 2016–2017. The retrieval strategy of the CH4 profile retrieval from ground-based FTS near-infrared (NIR) spectra using the SFIT4 code (SFIT4NIR) is investigated. The degree of freedom for signal (DOFS) of the SFIT4NIR retrieval is about 2.4, with two distinct pieces of information in the troposphere and in the stratosphere. The averaging kernel and error budget of the SFIT4NIR retrieval are presented. The data accuracy and precision of the SFIT4NIR retrievals, including the total column and two partial columns (in the troposphere and stratosphere), are estimated by TCCON standard retrievals, ground-based in situ measurements, Atmospheric Chemistry Experiment – Fourier Transform Spectrometer (ACE-FTS) satellite observations, TCCON proxy data and AirCore and aircraft measurements. By comparison against TCCON standard retrievals, it is found that the retrieval uncertainty of SFIT4NIR ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is similar to that of TCCON standard retrievals with systematic uncertainty within 0.35 % and random uncertainty of about 0.5 %. The tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from SFIT4NIR retrievals are assessed by comparison with AirCore and aircraft measurements, and there is a 1.0 ± 0.3 % overestimation in the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ and a 4.0 ± 2.0 % underestimation in the SFIT4NIR stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$, which are within the systematic uncertainties of SFIT4NIR-retrieved partial columns in the troposphere and stratosphere respectively.

1 Introduction

The Total Carbon Column Observing Network (TCCON) is an international network established in 2004 using ground-based Fourier transform spectrometer (FTS) spectrometers to record direct solar absorption spectra in the near-infrared (NIR) spectral range and to retrieve from these spectra total columns of atmospheric greenhouse gases, including methane (CH4; ). Currently, there are about 25 TCCON sites around the world with a latitude coverage of 45 S to 80 N. The standard TCCON retrieval code is GGG2014 (developed and maintained at JPL, NASA); it performs a profile scaling retrieval. TCCON provides the dry air total column-averaged mole fraction of CH4 (${X}_{{\mathrm{CH}}_{\mathrm{4}}}$), which has been compared to and indirectly calibrated by the Infrastructure for the Measurement of the Europe Carbon Cycle (IMECC) profiles over the European TCCON stations, the high-performance instrumented airborne platform for environmental research (HIAPER) Pole-to-Pole Observations (HIPPO) profiles over the TCCON stations in North America, East Asia and Oceania and several AirCore profiles over Lamont (USA). A scaling factor of 0.977 ± 0.002 (1σ) is applied to the retrieved ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ values to correct for the systematic bias. As one fixed value of 0.977 is applied to all the TCCON sites, the site-to-site bias is not taken into account. It is assumed that the remaining systematic uncertainty of the TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ products is within 0.2 %. The random uncertainty of the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieval is about 0.5 % . TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ observations have relatively larger footprints compared to surface in situ measurements, and thus could provide flux information on a regional scale . TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ measurements are widely used to validate the satellite observations, e.g. the Scanning Imaging Absorption Spectrometer for Atmospheric Chartography (SCIAMACHY) and the Thermal And Near-infrared Sensor for carbon Observation Fourier-Transform Spectrometer (TANSO-FTS; ). In addition, the TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ observations are also used to evaluate atmosphere chemistry transport model simulations .

The concentration of atmospheric CH4 remained almost constant from about 1995 to 2006. However, after 2007, the CH4 concentration started to increase with an annual growth rate about 0.7 ppb yr−1 . The CH4 in the atmosphere is released from gas and oil, coal, landfills, ruminant animals, rice agriculture, biomass burning, wetlands and lakes. The CH4 in the troposphere is removed mainly by oxidation with hydroxyl radicals (OH), partly by absorption in the soil and party by reacting with chlorine radicals in the marine boundary layer. The CH4 in the stratosphere is removed by oxidation with OH, chlorine atoms and excited oxygen atoms (IPCC2013). The mole fraction of CH4 decreases rapidly with altitude above the tropopause due to a higher photolysis rate in the stratosphere . The separation of the tropospheric and stratospheric CH4 partial columns helps us to better understand the atmospheric CH4 variability and to comprehensively evaluate model simulations . The seasonal variation of CH4 in the troposphere is dominated by its source and sink as well as the horizontal transport, while the seasonal variation of CH4 in the stratosphere is strongly affected by the Brewer–Dobson circulation, vertical transport, intertropical convergence zone movement and stratospheric chemical reactions. A proxy method to derive the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the TCCON retrievals based on the known relationship between CH4 and hydrogen fluoride (HF) or nitrous oxide (N2O) in the stratosphere has been demonstrated by and . The N2O and HF total columns are also available in the TCCON standard products. An alternative CH4 profile retrieval method has been provided by , using dimension reduction and the Markov-chain Monte Carlo statistical estimation.

In this study, the CH4 profile retrieval from ground-based FTS near-infrared spectra using the SFIT4 code (named SFIT4NIR retrievals) is carried out at six sites (Ny-Ålesund, Sodankylä, Bialystok, Bremen, Orléans and St Denis) for measurements performed during the time period of 2016–2017 in the framework of the EU Readiness of ICOS for Necessities of integrated Global Observations (RINGO) project. The full-physics SFIT4 retrieval code is based on the optimal estimation method (Rodgers2000), which is an updated version of SFIT2 and commonly used in the Network for the Detection of Atmospheric Composition Change – the Infrared Working Group (NDACC-IRWG; ). The TCCON sites and the SFIT4NIR retrieval strategy are introduced in the next section. The objective behind this study is to retrieve vertical information of CH4 from TCCON spectra. In Sect. 3 the difference in ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieved using the SFIT4NIR to the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieved from the standard TCCON retrievals is investigated. The tropospheric and the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieved using the SFIT4NIR retrievals are compared with other available data sets, such as ground-based in situ measurements, Atmospheric Chemistry Experiment – Fourier Transform Spectrometer (ACE-FTS) satellite observations and TCCON proxy data. Furthermore, the comparison results from the SFIT4NIR retrievals relative to the AirCore and aircraft profiles are also discussed in this section. Finally, conclusions are drawn in Sect. 4.

2 Data and method

## 2.1 TCCON sites

The locations of the TCCON sites used in this study are listed in Table 1. All sites use a Bruker IFS 125HR instrument to record NIR spectra in the range of 5000–10 000 cm−1 with a spectral resolution of 0.02 cm−1. The TCCON spectra from all sites in the time period of 2016–2017 were transferred to BIRA-IASB. A DC correction is applied to remove the variation of the interferogram caused by the solar intensity variation due to the presence of clouds during measurement . A python code is developed to convert the TCCON spectra from the OPUS format to the SFIT4 readable format.

Table 1The coordinates and the altitudes (m a.s.l.) of the TCCON FTS sites used in this study.

## 2.2 SFIT4NIR retrieval strategy

The SFIT4NIR retrieval strategy is investigated based on the TCCON spectra at St Denis (a humid site) using the SFIT4_v9.4.4 retrieval code. After that, the optimized retrieval strategy is applied for other sites. The key parameters used in the SFIT4NIR retrieval are listed in Table 2. The atmospheric line list (ATM) used in the GGG2014 code (Toon2014) has also been used in the forward model of the SFIT4NIR. Linear polynomial fitting is applied to a time-domain ideal instrument line shape (ILS) and the parameters are retrieved simultaneously. The a priori ILS is set as the ideal ILS. Since the Bruker 125HR spectrometers exhibit excellent ILS stability, the retrieved ILS are very constant and the retrieved maximal variations for modulation efficiency (ME) amplitude are within 2 % at these six sites. A detailed description of the retrieval settings, the averaging kernel and the retrieval uncertainty are presented in Sect. 2.2.1–2.2.5.

Table 2Lists of the most important parameters in the SFIT4NIR retrieval strategy.

### 2.2.1 Retrieval window

Three windows listed in Table 3 are used to retrieve CH4 total column values using the GGG2014 code. All these retrieval windows were tested with SFIT4NIR retrieval. The typical transmittance and residual for the three windows are shown in Fig. 1. The root mean square (RMS) of the residual in Band 1 is largest due to a bad fitting of several strong H2O absorption lines. The RMS of the residual in Band 2 is the lowest and is slightly better than that in Band 3. As an example, the retrieved CH4 total columns using these three bands on 30 July 2016 are shown in Fig. 2. A clearly artificial symmetric variation for Band 1 is seen, which is probably due to a bad fitting of the spectra. The results from Band 2 and 3 are similar. The difference between the retrieved CH4 total columns from Band 2 and 3 are within 0.3 ± 0.1 %. As Band 2 has the best fitting, it is selected as the retrieval window for our SFIT4NIR retrieval.

Table 3The retrieval windows used in the GGG2014 code.

Figure 1The transmittances of the species and solar lines in three bands from a typical spectrum at St Denis, together with the residual (observation–fitting). The transmittance of each component is shifted by 0.02 to better identify different species and the solar lines (sol).

Figure 2The SFIT4-retrieved CH4 total columns using the three bands listed in Table 1 on 30 July 2016 (184 spectra).

### 2.2.2 A priori profile

According to the optimal estimation method (OEM; ), an a priori profile is used to initialize the iteration during a retrieval process. In this study, SFIT4NIR uses the mean of the monthly profiles between 1980 and 2020 from the Whole Atmosphere Community Climate Model (WACCM) version 6 as the a priori profiles for CH4 and CO2, while an H2O a priori profile is derived from the 6-hourly NCEP reanalysis data because of its high variability in the atmosphere.

### 2.2.3 Regularization

The retrieved CH4 profile can be written as

$\begin{array}{}\text{(1)}& & {\mathbit{x}}_{\mathrm{r},{\mathrm{CH}}_{\mathrm{4}}}={\mathbit{x}}_{\mathrm{a},{\mathrm{CH}}_{\mathrm{4}}}+\mathbf{A}\left({\mathbit{x}}_{\mathrm{t},{\mathrm{CH}}_{\mathrm{4}}}-{\mathbit{x}}_{\mathrm{a},{\mathrm{CH}}_{\mathrm{4}}}\right)+\mathbit{\epsilon },\text{(2)}& & \mathbf{A}=\left({\mathbf{K}}^{T}{\mathbf{S}}_{\mathit{\epsilon }}^{-\mathrm{1}}\mathbf{K}+{\mathbf{S}}_{\mathrm{a}}^{-\mathrm{1}}{\right)}^{-\mathrm{1}}{\mathbf{K}}^{T}{\mathbf{S}}_{\mathit{\epsilon }}^{-\mathrm{1}}\mathbf{K},\end{array}$

where ${\mathbit{x}}_{\mathrm{a},{\mathrm{CH}}_{\mathrm{4}}}$, ${\mathbit{x}}_{\mathrm{t},{\mathrm{CH}}_{\mathrm{4}}}$ and ${\mathbit{x}}_{\mathrm{r},{\mathrm{CH}}_{\mathrm{4}}}$ are the a priori, true and retrieved CH4 mole fraction profiles respectively. A is the averaging kernel, representing the sensitivity of the retrieved CH4 profile to the true atmosphere status. The trace of A is the degree of freedom for signal (DOFS), indicating the number of individual vertical information derived from the retrieval. K is the Jacobian matrix. ε is the retrieval uncertainty. Sa and Sε are the a priori covariance matrix and the measurement covariance matrix respectively. Sε is determined by the signal-to-noise ratio (SNR). ${\mathbf{S}}_{\mathrm{a}}^{-\mathrm{1}}$ and ${\mathbf{S}}_{\mathit{\epsilon }}^{-\mathrm{1}}$ are the two key parameters to constrain the retrieved CH4, and to determine whether the retrieved CH4 profile is mainly from the a priori information or from the measurement information. It is assumed that Sε is a diagonal matrix, where the diagonal elements are the inverse square of the SNR. The SNR of spectra is set to 250 at all the TCCON sites. ${\mathbf{S}}_{\mathrm{a}}^{-\mathrm{1}}$ is created using the Tikhonov L1 method (Tikhonov1963):

$\begin{array}{}\text{(3)}& {\mathbf{S}}_{\mathrm{a}}^{-\mathrm{1}}=\mathit{\alpha }{\mathbf{L}}_{\mathrm{1}}^{T}{\mathbf{TL}}_{\mathrm{1}}\in {\mathbf{R}}^{\left(n,n\right)},\end{array}$

where ${L}_{\mathrm{1}}=\left[\begin{array}{cccccc}-\mathrm{1}& \mathrm{1}& \mathrm{0}& \mathrm{\dots }& \mathrm{0}& \mathrm{0}\\ \mathrm{0}& -\mathrm{1}& \mathrm{1}& \mathrm{\dots }& \mathrm{0}& \mathrm{0}\\ \mathrm{⋮}& \mathrm{⋮}& \mathrm{⋮}& \mathrm{\ddots }& \mathrm{⋮}& \mathrm{⋮}\\ \mathrm{0}& \mathrm{0}& \mathrm{0}& \mathrm{\dots }& -\mathrm{1}& \mathrm{1}\end{array}\right]$,
T=diag(Δh2), where Δh is the thickness of each layer, and regularization strength α is the key parameter to determine the correlation strength among layers.

The optimized α value is chosen by extracting maximum possible information from the measurement while eliminating the artificial oscillation for the retrieved CH4 profiles. Several α values are tested using the spectra on 30 July 2016, and the RMS, DOFS and retrieved CH4 total columns are listed in Table 4, along with the retrieved CH4 vertical profiles in Fig. 3. The retrieved CH4 profile shows a strong oscillation in the troposphere for α=100. The vertical profiles are similar for α=1000 and α=10 000, but they allow us to get a smaller RMS with α=1000. In summary, a regularization strength (α) of 1000 with the DOFS of about 2.4 is selected as the best choice for the SFIT4NIR retrieval.

Table 4The mean and standard deviation of RMS, DOFS and retrieved CH4 total columns from SFIT4NIR retrievals using different regularization strength α values.

Figure 3The SFIT4NIR a priori and the retrieved CH4 vertical profiles (a), together with the ratios of the retrieved profiles to the a priori profile (b), with different regularization strength α values.

### 2.2.4 Averaging kernel

The left panel in Fig. 4 shows the typical averaging kernel (AVK) of SFIT4NIR retrieval with a solar zenith angle (SZA) of 63 at St Denis. The retrieved CH4 profile is sensitive to the altitude range from the surface to the middle stratosphere (about 40 km). The AVK shows that the SFIT4NIR-retrieved profile contains independent information in the troposphere and in the stratosphere (DOFS close to 1.0 for these two layers). In addition, the column-averaging kernels (right panel in Fig. 4) indicate that the retrieved CH4 total column has a good sensitivity in the whole atmosphere, with a value close to 1.0 at all altitudes. The column-averaging kernels slightly vary with the SZAs, which is more constant than the AVK variability for the SZAs of the standard TCCON products (see Fig. 4 in ).

Figure 4(a) A typical CH4 averaging kernel matrix of the SFIT4NIR retrieval with the SZA of 63 at St Denis, in units of the mole fraction profile with respect to the a priori. (b) CH4 column-averaging kernels (in unit of 1; applying for the partial column profile) with different solar zenith angles.

### 2.2.5 Error budget

According to the OEM (Rodgers2000), the measurement uncertainty of the SFIT4NIR retrieval (ε in Eq. 1) is estimated from three components: the smoothing error covariance matrix (Ss), the forward model parameter error covariance matrix (Sf) and the measurement error covariance matrix (Sm).

$\begin{array}{}\text{(4)}& & {\mathbf{S}}_{\mathrm{s}}=\left(\mathbf{A}-\mathbf{I}\right){\mathbf{S}}_{e}\left(\mathbf{A}-\mathbf{I}{\right)}^{T},\text{(5)}& & {\mathbf{S}}_{\mathrm{f}}={\mathbf{G}}_{y}{\mathbf{K}}_{b}{\mathbf{S}}_{b}{\mathbf{K}}_{b}^{T}{\mathbf{G}}_{y}^{T},\text{(6)}& & {\mathbf{S}}_{\mathrm{m}}={\mathbf{G}}_{y}{\mathbf{S}}_{\mathit{\epsilon }}{\mathbf{G}}_{y}^{T},\end{array}$

where Gy is the contribution matrix, representing the sensitivity of the retrieval to the measurement. Se, Sb and Sε are the covariance matrices of the retrieval state vector, the forward model parameter and the measurement respectively. The retrieval state vector (x in Eq. 1) not only includes the CH4 vertical profile, but also includes the H2O and CO2 columns, the slope of the background, the wavenumber shift and several ILS parameters. Each retrieved parameter has systematic and random uncertainties. The relative standard deviation of the CH4 monthly means from the WACCM model in 1980–2020 is calculated as the random uncertainty of the CH4 profile. For the systematic uncertainty, we have chosen a value of 5 % (about 90 ppb in the troposphere), based on the difference between the a priori CH4 mole fraction near the surface and the local in situ measurements . As CH4 is relatively stable in the atmosphere with a lifetime of  9 years, it is assumed that 5 % systematic uncertainty is acceptable for all altitudes. The systematic and the random uncertainties for H2O and CO2 are set to 5 %. The systematic and random uncertainties of ILS parameters are set to 1 %. The other retrieved parameters do not contribute significantly to the CH4 uncertainty. The smoothing error in Table 5 represents the uncertainty contribution from the CH4 vertical profile, while the errors from the retrieved parameters in Table 5 include the contribution from the H2O and CO2 columns, the slope of the background, the wavenumber shift and several ILS parameters. The spectroscopy, the temperature and the SZA are the most important parameters contributing to the forward model. According to the HITRAN2012 , the uncertainty of CH4 absorption in the selected retrieval window is about 2 %–5 %. Therefore, the systematic uncertainty of the spectroscopy is set to 3 %, and the random uncertainty of the spectroscopic data is assumed to be negligible. The systematic and random uncertainties are set to 1 % for the temperature. The systematic uncertainty is set to 0.1 % and the random uncertainty is set to 0.5 % for the SZA. Sε is assumed to be diagonal where the diagonal elements are the inverse square of the SNR. The propagated uncertainties of the total column and the partial columns (troposphere and stratosphere) are listed in Table 5. The mean tropopause height above St Denis is about 16.5 km. The systematic and random uncertainties of the SFIT4NIR-retrieved CH4 total column are 3.2 % and 0.5 % respectively. The dominating component of the systematic uncertainty comes from the spectroscopy. The uncertainties of the partial column in the troposphere are closer to those of the total column, while the uncertainties of the partial column in the stratosphere are relatively large.

Table 5The systematic and random uncertainties for the SFIT4NIR-retrieved CH4 total column, partial columns in the troposphere (0–16.5 km) and in the stratosphere (16.5–50 km). The uncertainties are shown in percentages (%). The empty field shows where the uncertainty is negligible, with a value of less than 0.1 %.

3 Results and discussion

The retrieval strategy listed in Table 2 is applied for all six sites. In this section, the data quality of the SFIT4NIR retrievals is evaluated with TCCON standard retrievals, ground-based in situ measurements, ACE-FTS satellite remote sensing observations, TCCON proxy ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data and AirCore measurements.

## 3.1 TCCON standard retrievals

According to Sect. 2.2.5, the random uncertainty of the SFIT4NIR total column is about 0.5 %, which is close to that of TCCON retrieval . The systematic uncertainty of the SFIT4NIR total column is about 3.2 %, where a large contribution is from the spectroscopy. To better understand the systematic uncertainty of the SFIT4NIR-retrieved total column, the SFIT4NIR ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ at six sites in 2016–2017 is calculated and compared with TCCON standard products. The systematic uncertainty of the TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ products is within 0.2 %.

GGG2014 uses the ratio between CH4 and O2 total columns to calculate the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ , as the atmospheric O2 mole fraction is relatively stable with the mole fraction of 0.2095:

$\begin{array}{}\text{(7)}& {X}_{{\mathrm{CH}}_{\mathrm{4}}}=\mathrm{0.2095}\phantom{\rule{0.25em}{0ex}}{\mathrm{TC}}_{{\mathrm{CH}}_{\mathrm{4}}}/{\mathrm{TC}}_{{\mathrm{O}}_{\mathrm{2}}}.\end{array}$

The ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the SFIT4NIR retrieval is calculated as

$\begin{array}{}\text{(8)}& {X}_{{\mathrm{CH}}_{\mathrm{4}}}=\frac{{\mathrm{TC}}_{{\mathrm{CH}}_{\mathrm{4}}}}{{\mathrm{TC}}_{\mathrm{air}}^{\mathrm{dry}}}=\frac{{\mathrm{TC}}_{{\mathrm{CH}}_{\mathrm{4}}}}{{P}_{\mathrm{s}}/\left(g{m}_{\mathrm{air}}^{\mathrm{dry}}\right)-{\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}\left({m}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}/{m}_{\mathrm{air}}^{\mathrm{dry}}\right)},\end{array}$

where ${\mathrm{TC}}_{\mathrm{air}}^{\mathrm{dry}}$ and ${\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$ are total columns of dry air and H2O; Ps is the surface pressure; g is the total column-averaged gravitational acceleration; ${m}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$ and ${m}_{\mathrm{air}}^{\mathrm{dry}}$ are molecular masses of H2O and dry air respectively . The uncertainty of Ps is better than 0.1 hPa and the uncertainty of H2O column in the troposphere is about 5 %–10 %; as a result, the uncertainty of the dry air column is about 0.1 %. The uncertainty of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is the combination of the uncertainties of the total column of CH4 and the dry air column, while the uncertainty of the dry air column is negligible compared to the uncertainty of the SFIT4NIR retrieval (see Table 5). The SFIT4NIR tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ can be calculated following Eq. (8) using the partial columns of CH4 and dry air in the troposphere and in the stratosphere respectively. The tropopause height is calculated individually for each SFIT4NIR retrieval using the temperature and pressure profiles from the NCEP 6-hourly reanalysis data. The tropopause height varies from site to site according to its latitude. The tropopause height is about 8–11 km at Ny-Ålesund and Sodankylä, 10–12 km at Bialystok, Bremen and Orléans and 16–17 km at St Denis.

Figure 5 shows the time series of the hourly means of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from SFIT4NIR and TCCON retrievals and their differences for measurements performed in 2016–2017. The mean and standard deviation of the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ difference between SFIT4NIR and TCCON (SFIT4NIR–TCCON) at the six sites are in the range between −2.3 ppb (−0.14 %) and 2.5 ppb (0.15 %) and between 4.7 ppb (0.3 %) and 9.9 ppb (0.5 %). The standard deviations of the differences at all sites are within 0.5 %, which is consistent with the combined random uncertainties from SFIT4NIR and TCCON retrievals. The systematic bias between the SFIT4NIR- and TCCON-retrieved ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is much lower than 3.2 %, indicating that the systematic uncertainty of the SFIT4NIR total column from the spectroscopy (see Table 3) is overestimated. Since the systematic uncertainty of the TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieval is better than 0.2 %, it is inferred that the systematic uncertainty of the SFIT4NIR ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieval is within 0.35 %. Figure 6 shows the scatter plots of the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrievals from SFIT4NIR and TCCON at the six sites. The linear regression line (dashed red line) is very close to the one-to-one lines for all panels. The correlation coefficient is in the range between 0.76 and 0.94. No obvious seasonal variation is seen from Figs. 5 and 6.

Figure 5The time series of hourly means of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the SFIT4NIR and the TCCON retrievals at six TCCON sites during 2016–2017, together with their differences. For each site, the lower panel shows the time series of SFIT4NIR and TCCON measurements, and the upper panel shows the absolute difference between them (SFIT4NIR–TCCON; in ppb units). The values in the legend of the lower panel are the means of the TCCON and SFIT4NIR retrievals.

Figure 6The scatter plots between SFIT4NIR and TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ hourly retrievals at the six TCCON sites. The dots are coloured with the measurement months. In each panel, the black line is the one-to-one line and the dashed red line is the linear fitting. N is the measurement number and R is the correlation coefficient.

## 3.2 In situ measurements

This section presents the comparison results between the ground-based in situ measurements at the individual sites and the tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrieved using SFIT4NIR. Ground-based in situ measurements are more sensitive to the local sources and sinks as compared to the FTS measurements. The Traînou tower at the Orléans site takes in situ measurements at four heights (180, 100, 50 and 5 m). The measurements at 180 m are used here as they are less affected by the boundary layer . In situ measurements for the St Denis site are taken from the measurements taken at Maïdo (2155 m) located at about 20 km away from St Denis . The in situ measurements at Maïdo are less affected by the surface, and CH4 is well-mixed in the lower atmosphere with a lifetime of 8–10 years . Both ground-based in situ instruments at Orléans and Maïdo are calibrated frequently at the Laboratoire des Sciences du Climat et de l'Environnement (LSCE). The in situ measurements from other sites are not used in order to reduce the influence from the boundary layer.

Figure 7The time series of the monthly means (solid line) and standard deviations (shading) from the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ and the ground-based in situ CH4 measurements at Orléans (a) and at St Denis (b). At Orléans, the in situ measurements are recorded at 180 m on a tower at the same place. The in situ measurements at St Denis are recorded at 2155 m on Maïdo mountain, which is about 20 km away from St Denis.

Figure 7 shows the monthly means and standard deviations of the co-located ground-based in situ and the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ hourly means at Orléans and St Denis in 2016. In general, the seasonal cycle from the in situ measurements is similar to the one from the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ retrievals at these two sites. However, the in situ tower measurements (180 m) at Orléans are still influenced by the boundary layer, and several high spikes are observed in March, June and December 2016. The in situ measurements at Orléans are found to be about 36 ppb larger than the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$. showed that the CH4 mole fractions at the four layers of the Orléans tower measurements are decreasing with increasing altitude. There is a strong CH4 anthropogenic emission around Orléans , which remains mainly at the surface. This might explain the bias between the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ and the in situ tower measurements at Orléans. The in situ measurements at St Denis are found to be about 24 ppb lower than the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$. pointed out that the air near the surface above St Denis (0–2 km) mainly comes from the Indian Ocean and partly from the southern African region, whereas the air mass in the middle and upper troposphere (4–12 km) mainly comes from Africa and South America. As CH4 emission on land is much larger than that from the ocean, it is reasonable that SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is systematically larger than the CH4 mole faction at the surface.

The phases and amplitudes of the seasonal cycles from the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ and the ground-based in situ CH4 measurements are found to be in good agreement. CH4 mole fraction is high in December–March and low in July–September at Orléans (located in the Northern Hemisphere), and high in July–September and low in December–March at St Denis (located in the Southern Hemisphere). The CH4 seasonal variations in the troposphere are driven by the OH variation, which is the major sink of CH4 in the atmosphere.

## 3.3 ACE-FTS satellite observations

The comparison results between the SFIT4NIR stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ and the ACE-FTS satellite observations are discussed in this section. The vertical range from the tropopause height up to 50 km is treated as the stratosphere in this study. The ACE-FTS satellite has been monitoring the atmospheric CH4 concentration mainly in the stratosphere since 2004 in solar occultation mode . The latest level 2 version 3.6 data with data quality flag equal to 0 (without any known issues) are selected from the ACE/SCISAT data set . The ACE-FTS CH4 profile is retrieved at target altitudes with a vertical resolution of 3–4 km, and then it is interpolated onto a 1 km grid. The older version v2.2 data of the ACE-FTS CH4 data have been compared to space-based satellite, balloon-borne and ground-based FTS data . The accuracy of the version 2.2 data is within 10 % in the upper troposphere–lower stratosphere, and within 25 % in the middle and higher stratosphere up to the lower mesosphere. The uncertainty of the new version of the ACE-FTS data has a reduction of about 10 % near 35–40 km and a slight reduction at 23 km .

Figure 8 shows the SFIT4NIR and ACE-FTS co-located daily means of the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ at Bialystok, Orléans and St Denis. The ACE-FTS measurements are selected within $±\mathrm{3}×\mathrm{30}$ (latitude by longitude) around each FTS site. Limited co-locations are found for Ny-Ålesund, Sodankylä and Bremen sites and so the results are not shown here. Figure 8 shows that the seasonal cycles (both phase and amplitude) of the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from SFIT4NIR and ACE-FTS are similar. The stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ shows a minimum in February–April and a maximum in August–October for the Bialystok and Orléans sites located in the Northern Hemisphere, whereas the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ shows a minimum in August–October and a maximum in February–April for the St Denis site, located in the Southern Hemisphere. The mean and the standard deviation of the differences in stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the SFIT4NIR and ACE-FTS measurements at these three sites are in the range between −0.27 % and 2.06 % and between 1.92 % and 3.21 %, respectively, which are within their uncertainties.

Figure 8(a, c, e) The time series of the daily mean of the co-located SFIT4NIR and ACE-FTS stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ daily mean measurements, together with the absolute differences (unit: ppb) between them for Bialystok, Orléans and St Denis. (b, d, f) The correlation plots between the co-located SFIT4NIR and the ACE-FTS stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ daily means.

## 3.4 TCCON proxy data

In this section, the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from SFIT4NIR retrievals are compared with the results derived from the N2O and HF proxy methods at the six TCCON sites. We refer to and for the details of computing the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ by the proxy retrieval method using N2O and HF. Figure 9 shows the time series of the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the TCCON proxy N2O and HF method. First, the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the N2O and HF proxy methods are close to each other. However, a slight seasonal and site-dependent bias is observed. For example, the difference in the tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the N2O proxy method and HF proxy method is larger in summer than that in winter at Ny-Ålesund. The tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the N2O and HF proxy methods are very close to each other for St Denis, while for the other five sites, the tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the N2O method is larger by about 15–20 ppb than the HF method. The bias in the tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the N2O and HF methods is in a good agreement with Fig. 7 in . As the TCCON N2O retrievals are corrected to the WMO scale , while HF retrievals have not been validated, the systematic bias is probably due to the uncertainty of the XHF product. Second, at St Denis (a moist site), the TCCON HF retrievals are strongly affected by H2O so that the TCCON proxy method tropospheric and the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data using HF have many outliers.

Figure 9 also shows the time series of the tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from the SFIT4NIR retrievals. The SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data are close to the proxy data at St Denis, while the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data are systematically larger than the results from the proxy method at the five sites located in the Northern Hemisphere. The vital difference between St Denis and other sites is that the tropopause height at St Denis is about 16.5 km, which is relatively higher than the tropopause height of 9–12 km at other sites. It seems that the partial column of CH4 from the SFIT4NIR retrieval is larger than that from the TCCON proxy data in the vertical range from surface to about 10 km, while it is smaller than that from the TCCON proxy data above 10 km. The bias in the vertical range from surface to 10 km might be able to be compensated by the part of 10–16.5 km, due to the relatively high tropopause height at St Denis. The phases of the ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ seasonal variations from the SFIT4NIR retrievals are almost the same as those from the proxy method, while the amplitudes of the variations from the SFIT4NIR retrievals are larger than those from the proxy method in the tropospheric component. There are two possible explanations: (1) the proxy method assumes that the vertical mole fraction profile of HF or N2O are constant in the troposphere, and the CH4 mole fraction in the upper troposphere is calculated as the tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ for the proxy method; (2) the tropopause height in the proxy method has a chemical definition, which differs from the tropopause height calculated from the temperature and the altitude profiles .

Figure 9The time series of the tropospheric (left panels) and the stratospheric (right panels) co-located ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ hourly means from the SFIT4NIR and the proxy method (both N2O and HF) at the six TCCON sites.

## 3.5 AirCore measurements at Sodankylä

The AirCore is an atmospheric sampling system which uses a long tube to sample the air from the surrounding atmosphere and to preserve profiles of the trace gases of interest from the surface (few hundred metres) to the middle stratosphere (about 30 km; ). Regular AirCore measurements of CH4 have been carried out at Sodankylä since September 2013. During 2016–2017, we selected seven AirCore profiles which are within 1 h of SFIT4NIR measurements.

Figure 10(a) The CH4 profile from the AirCore measurement (solid black line) on 5 September 2017, together with the SFIT4NIR a priori (dash-dotted orange line) and retrieved (solid orange line) profiles. The AirCore measurement is extrapolated with the surface in situ measurements (green star) and the scaled SFIT4NIR a priori profile (dotted green line). The grey line is the smoothed AirCore profile. (b) The mean (solid black line) and the stand deviation (shading) of the relative difference between the co-located SFIT4NIR-retrieved profiles and the smoothed AirCore measurements ((SFIT4NIR–AirCore)/AirCore × 100 %).

Figure 11The scatter plots of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the SFIT4NIR and the AirCore measurements for the whole atmosphere (a), and for the tropospheric (b) and stratospheric (c) components. In each panel, the black line is the one-to-one line and the dashed red line is the regression line with the intercept to zero ($y=a\cdot x$). N is the co-located measurement number, R is the correlation coefficient, and a is the slope.

As an example, the AirCore CH4 profile on 5 September 2017, together with the co-located (within ± 1 h) a priori and retrieved SFIT4NIR profiles are shown in the left panel of Fig. 10. AirCore and FTS data cannot be compared directly, because the AirCore profile has a high vertical resolution but it covers only a part of the total column that is observed by the FTS. The AirCore measurement for this launch covers the vertical range from about 0.6 to 26 km, and needs to be extended for comparison with the FTS data. For the extrapolation, a scaled SFIT4NIR a priori profile is applied to extend the AirCore CH4 profile above 26 km, and the local surface CH4 mole fraction observations are applied to extend the AirCore CH4 profile below 0.6 km. In order to take the vertical sensitivity of the FTS retrieval into account (Rodgers2003), the “extended” AirCore profile is then smoothed with the co-located SFIT4NIR retrieval

$\begin{array}{}\text{(9)}& {\mathbit{x}}_{\mathrm{aircore},\mathrm{s}}={\mathbit{x}}_{\mathrm{a}}+\mathbf{A}\left({\mathbit{x}}_{\mathrm{insitu}}-{\mathbit{x}}_{\mathrm{a}}\right),\end{array}$

where xinstu is the “extended” AirCore profile, xa is the a priori profile of the SFIT4NIR retrieval and xaircore,s is the smoothed AirCore profile. The mean and the standard deviation of the relative differences between the co-located SFIT4NIR retrievals and the smoothed AirCore profile ((SFIT4NIR–AirCore)/AirCore × 100 %) are shown in the right panel of Fig. 10. The bias is about +1.5 % in the lower and the middle troposphere, between +1 and −4 % in the upper troposphere and lower stratosphere region, and about −2.5 % in the middle and upper stratosphere.

Figure 11 shows the scatter plots of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the co-located SFIT4NIR retrievals and the AirCore measurements for the whole atmosphere, and for the tropospheric and stratospheric components. The error bars are the random uncertainties of the SFIT4NIR retrievals and the AirCore measurements. It is assumed that the random uncertainty of the AirCore profile is about 0.1 % between the surface and its maximum measurement altitude (∼30 km), and it is about 2 % above the maximum measurement altitude. The slope of the regression line (a=1.001) in the whole atmosphere indicates that there is almost no systematic difference between the SFIT4NIR and the AirCore ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$, which is consistent with the result in the comparison between SFIT4NIR and TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ measurements (Figs. 5 and 6). The SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is about 1.1 ± 0.4 % larger than the AirCore measurements and the SFIT4NIR stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is about 4.0±2.0 % less than the AirCore measurements. These differences between the SFIT4NIR retrievals and AirCore measurements are within the systematic uncertainties of the SFIT4NIR partial columns in the troposphere and stratosphere, and it is inferred that the systematic uncertainty of the SFIT4NIR partial column mainly comes from the uncertainty of the spectroscopy (see Table 5).

Figure 12The scatter plots of ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ between the SFIT4NIR and the IMECC aircraft measurements together with the AirCore measurements for the tropospheric components. The black line is the one-to-one line and the dashed red line is the regression line with the intercept to zero ($y=a\cdot x$). N is the co-located measurement number, R is the correlation coefficient and a is the slope.

## 3.6 Aircraft measurements during the IMECC campaign

The Infrastructure for Measurement of the European Carbon Cycle (IMECC) aircraft equipment passed over several European TCCON sites in September and October 2009, including Orléans, Bremen and Bialystok. We refer to for a detail description of the IMECC aircraft data. The aircraft equipment cover a vertical range from about 300 to 13 000 m, mainly in the troposphere. Therefore, in this section, we use the co-located aircraft measurements for comparison with the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$. The location, date and time of the overflight, SZA and the profile code are listed in Table 1 in . There are four aircraft vertical profiles over Bialystok (BI-OF1a, BI-OF1b, BI-OF2a, BI-OF2b), four profiles over Orléans (OR-OF1a, OR-OF1b, OR-OF2a, OR-OF2b) and two profiles over Bremen (BR-OF1a, BR-OF2a).

To compare the aircraft measurements with the SFIT4NIR, the aircraft profiles need to be extended for comparison with FTS retrievals. The extrapolation method is the same as described in Sect. 4.2 in . For the near-ground part, ground-based in situ data from the co-located tall-tower stations are used to extend the aircraft data to the ground at Orléans and Bialystok, and the values measured at the lowermost altitude by the aircraft are linearly extrapolated to the surface at Bremen. For the upper part, the TCCON (GGG2012) a priori profile multiplied by the retrieval scaling factor is used. The uncertainties of “extended” aircraft profiles have been shown in Table 2 in . After that, the “extended” aircraft profile is smoothed with FTS retrieval using Eq. (9), where the xinsitu is the aircraft measurement. The SFIT4NIR retrievals within a time window of ± 1 h around the aircraft overflight are chosen. The standard deviation of the co-located SFIT4NIR retrievals is used as the random uncertainty of the FTS retrieval.

The smoothed aircraft tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is 1.0 ± 0.2 % larger than the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$, which is consistent with the result from the comparison between the AirCore measurements and SFIT4NIR retrievals (1.1 ± 0.4 %). Combining the AirCore measurements at Sodankylä and aircraft measurements at Orléans, Bremen and Bialystok, Fig. 12 shows that there is a systematic overestimation of 1.0 ± 0.3 % in the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$. Further investigation is required to see if the systematic bias can be observed at other sites.

4 Conclusions

The retrieval of CH4 vertical information from TCCON FTS NIR spectra has been carried out at six sites during 2016–2017 using the SFIT4 code. The retrieval strategy of the SFIT4NIR has been discussed, including the spectroscopy, retrieval window, an a priori profile, SNR and regularization. The AVK shows that the SFIT4NIR-retrieved profile is sensitive to the altitude range from the surface to the middle stratosphere (about 40 km), and the column-averaging kernel has a good sensitivity in the whole atmosphere. The DOFS of the SFIT4NIR is about 2.4, with two distinct pieces of information in the troposphere and the stratosphere. The systematic and random uncertainties of the SFIT4NIR-retrieved total column are about 3.2 % and 0.5 %.

The SFIT4NIR-retrieved CH4 total columns and partial columns (troposphere and stratosphere) have been evaluated based on the standard TCCON retrievals, ground-based in situ measurements, ACE-FTS satellite observations, TCCON proxy ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data and AirCore measurements at Sodankylä. It is found that the SFIT4NIR-retrieved ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data are very close to the standard TCCON retrievals with the mean bias between −0.14 % and 0.15 % and the standard deviation of bias between 0.3 % and 0.5 % at the six TCCON sites. Additionally, there is no obvious seasonal variation in the difference between the SFIT4NIR and TCCON ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ data. The SFIT4NIR tropospheric and stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ can observe the CH4 seasonal variation very well, which has been confirmed by the ground-based in situ measurements and ACE-FTS observations respectively. The tropospheric and the stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ from SFIT4NIR retrievals have also been compared with the results from the TCCON proxy method. The phases of the seasonal cycles from SFIT4NIR retrievals and TCCON proxy data are consistent, though the amplitudes of the variations from the SFIT4NIR retrievals are relatively larger than those from the proxy method, especially in the troposphere. Further investigation is needed to understand the accuracy of the seasonal cycle from the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ when more aircraft or AirCore measurements become available. By comparison against AirCore measurements at Sodankylä, it is found that there is almost no systematic bias between the SFIT4NIR and AirCore ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ (in the whole atmosphere), which is consistent with the comparison between the SFIT4NIR and the TCCON standard retrievals. An underestimation of 4.0 ± 2.0 % in the SFIT4NIR stratospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is seen by comparison with AirCore measurements, and an overestimation of 1.0 ± 0.3 % in the SFIT4NIR tropospheric ${X}_{{\mathrm{CH}}_{\mathrm{4}}}$ is seen by comparing it with AirCore measurements and IMECC aircraft measurements. These biases are within the systematic uncertainties of SFIT4NIR-retrieved partial columns in the troposphere and stratosphere respectively.

Data availability
Data availability.

The TCCON data are publicly available through the TCCON wiki (https://tccondata.org/, last access: 12 September 2019). The ACE-FTS data used in this study are available from https://ace.uwaterloo.ca/data.php (last access: 20 November 2019) (registration required). The SFIT4NIR retrievals, TCCON proxy data, ground-based in situ measurements and AirCore measurements are available by contacting the author.

Author contributions
Author contributions.

MZ wrote the manuscript. MZ, BL and MDM investigated the SFIT4 retrieval strategy. MKS, CH, CP, TW, JMM, RK and PH provided and interpreted the TCCON data. NK and MR provided and analysed the in situ measurements. HC and RK provided the AirCore measurements. All authors read and commented the manuscript.

Competing interests
Competing interests.

The authors declare that they have no conflict of interest.

Acknowledgements
Acknowledgements.

This study is supported by the EU H2020 RINGO project. The TCCON site at Réunion Island is operated by the Royal Belgian Institute for Space Aeronomy with financial support in 2014/2015 and 2016/2017 as part of the EU project ICOS-Inwire and the ministerial decree for ICOS (FR/35/IC2), and local activities were supported by LACy/UMR8105 – Université de La Réunion. We want to thank Francis Scolas (BIRA-IASB) for maintaining the TCCON measurements at St Denis; Juha Hatakka and Tuomas Laurila (FMI) for operating the in situ and AirCore measurements at Sodankylä; Christoph Gerbig and Dietrich Feist for providing the IMECC aircraft data. We would also like to thank the TCCON network for making the data publicly available. The AirCore data from the Sodankylä site in 2017 is generated from the FRM4GHG project which received financial support from the European Space Agency under the grant agreement no. ESA-IPL-POE-LG-cl-LE-2015-1129.

Financial support
Financial support.

This research has been supported by the EU H2020 RINGO project (grant no. 730944).

Review statement
Review statement.

This paper was edited by Hartwig Harder and reviewed by two anonymous referees.

References

Agusti-Panareda, A., Diamantakis, M., Bayona, V., Klappenbach, F., and Butz, A.: Improving the inter-hemispheric gradient of total column atmospheric CO2 and CH4 in simulations with the ECMWF semi-Lagrangian atmospheric global model, Geosci. Model Dev., 10, 1–18, https://doi.org/10.5194/gmd-10-1-2017, 2017. a

Bernath, P. F., McElroy, C. T., Abrams, M. C., Boone, C. D., Butler, M., Camy-Peyret, C., Carleer, M., Clerbaux, C., Coheur, P. F., Colin, R., DeCola, P., DeMazière, M., Drummond, J. R., Dufour, D., Evans, W. F. J., Fast, H., Fussen, D., Gilbert, K., Jennings, D. E., Llewellyn, E. J., Lowe, R. P., Mahieu, E., McConnell, J. C., McHugh, M., McLeod, S. D., Michaud, R., Midwinter, C., Nassar, R., Nichitiu, F., Nowlan, C., Rinsland, C. P., Rochon, Y. J., Rowlands, N., Semeniuk, K., Simon, P., Skelton, R., Sloan, J. J., Soucy, M. A., Strong, K., Tremblay, P., Turnbull, D., Walker, K. A., Walkty, I., Wardle, D. A., Wehrle, V., Zander, R., and Zou, J.: Atmospheric chemistry experiment (ACE): Mission overview, Geophys. Res. Lett., 32, L15S01, https://doi.org/10.1029/2005GL022386, 2005. a

De Mazière, M., Vigouroux, C., Bernath, P. F., Baron, P., Blumenstock, T., Boone, C., Brogniez, C., Catoire, V., Coffey, M., Duchatelet, P., Griffith, D., Hannigan, J., Kasai, Y., Kramer, I., Jones, N., Mahieu, E., Manney, G. L., Piccolo, C., Randall, C., Robert, C., Senten, C., Strong, K., Taylor, J., Tétard, C., Walker, K. A., and Wood, S.: Validation of ACE-FTS v2.2 methane profiles from the upper troposphere to the lower mesosphere, Atmos. Chem. Phys., 8, 2421–2435, https://doi.org/10.5194/acp-8-2421-2008, 2008. a

De Mazière, M., Sha, M. K., Desmet, F., Hermans, C., Scolas, F., Kumps, N., Metzger, J.-M., Duflot, V., and Cammas, J.-P.: TCCON data from Reunion Island (RE), Release GGG2014R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.reunion01.R0/1149288, 2014. a

De Mazière, M., Thompson, A. M., Kurylo, M. J., Wild, J. D., Bernhard, G., Blumenstock, T., Braathen, G. O., Hannigan, J. W., Lambert, J.-C., Leblanc, T., McGee, T. J., Nedoluha, G., Petropavlovskikh, I., Seckmeyer, G., Simon, P. C., Steinbrecht, W., and Strahan, S. E.: The Network for the Detection of Atmospheric Composition Change (NDACC): history, status and perspectives, Atmos. Chem. Phys., 18, 4935–4964, https://doi.org/10.5194/acp-18-4935-2018, 2018. a

Deutscher, N. M., Griffith, D. W. T., Bryant, G. W., Wennberg, P. O., Toon, G. C., Washenfelder, R. A., Keppel-Aleks, G., Wunch, D., Yavin, Y., Allen, N. T., Blavier, J.-F., Jiménez, R., Daube, B. C., Bright, A. V., Matross, D. M., Wofsy, S. C., and Park, S.: Total column CO2 measurements at Darwin, Australia – site description and calibration against in situ aircraft profiles, Atmos. Meas. Tech., 3, 947–958, https://doi.org/10.5194/amt-3-947-2010, 2010. a

Deutscher, N. M., Notholt, J., Messerschmidt, J., Weinzierl, C., Warneke, T., Petri, C., Grupe, P., and Katrynski, K.: TCCON data from Bialystok (PL), Release GGG2014R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.bialystok01.R0/1149277, 2014. a

Dils, B., Buchwitz, M., Reuter, M., Schneising, O., Boesch, H., Parker, R., Guerlet, S., Aben, I., Blumenstock, T., Burrows, J. P., Butz, A., Deutscher, N. M., Frankenberg, C., Hase, F., Hasekamp, O. P., Heymann, J., De Mazière, M., Notholt, J., Sussmann, R., Warneke, T., Griffith, D., Sherlock, V., and Wunch, D.: The Greenhouse Gas Climate Change Initiative (GHG-CCI): comparative validation of GHG-CCI SCIAMACHY/ENVISAT and TANSO-FTS/GOSAT CO2 and CH4 retrieval algorithm products with measurements from the TCCON, Atmos. Meas. Tech., 7, 1723–1744, https://doi.org/10.5194/amt-7-1723-2014, 2014. a

Ehhalt, D. H. and Heidt, L. E.: Vertical profiles of CH4 in the troposphere and stratosphere, J. Geophys. Res., 78, 5265–5271, https://doi.org/10.1029/JC078i024p05265, 1973. a

European Commission: Emission Database for Global Atmospheric Research (EDGAR), release EDGARv4.2 FT2010, Tech. rep., Joint Research Centre (JRC)/Netherlands Environmental Assessment Agency (PBL), available at: http://edgar.jrc.ec.europa.eu (last access: 12 April 2018), 2013. a

Fraser, A., Palmer, P. I., Feng, L., Boesch, H., Cogan, A., Parker, R., Dlugokencky, E. J., Fraser, P. J., Krummel, P. B., Langenfelds, R. L., O'Doherty, S., Prinn, R. G., Steele, L. P., van der Schoot, M., and Weiss, R. F.: Estimating regional methane surface fluxes: the relative importance of surface and GOSAT mole fraction measurements, Atmos. Chem. Phys., 13, 5697–5713, https://doi.org/10.5194/acp-13-5697-2013, 2013. a

Geibel, M. C., Messerschmidt, J., Gerbig, C., Blumenstock, T., Chen, H., Hase, F., Kolle, O., Lavrič, J. V., Notholt, J., Palm, M., Rettinger, M., Schmidt, M., Sussmann, R., Warneke, T., and Feist, D. G.: Calibration of column-averaged CH4 over European TCCON FTS sites with airborne in-situ measurements, Atmos. Chem. Phys., 12, 8763–8775, https://doi.org/10.5194/acp-12-8763-2012, 2012. a, b, c, d

Houweling, S., Krol, M., Bergamaschi, P., Frankenberg, C., Dlugokencky, E. J., Morino, I., Notholt, J., Sherlock, V., Wunch, D., Beck, V., Gerbig, C., Chen, H., Kort, E. A., Röckmann, T., and Aben, I.: A multi-year methane inversion using SCIAMACHY, accounting for systematic errors using TCCON measurements, Atmos. Chem. Phys., 14, 3991–4012, https://doi.org/10.5194/acp-14-3991-2014, 2014. a

IPCC: Climate change 2013: The physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, 2013. a

Karion, A., Sweeney, C., Tans, P., and Newberger, T.: AirCore: An innovative atmospheric sampling system, J. Atmos. Ocean. Tech., 27, 1839–1853, https://doi.org/10.1175/2010JTECHA1448.1, 2010. a, b

Keppel-Aleks, G., Toon, G. C., Wennberg, P. O., and Deutscher, N. M.: Reducing the impact of source brightness fluctuations on spectra obtained by Fourier-transform spectrometry., Appl. Opt., 46, 4774–4779, https://doi.org/10.1364/AO.46.004774, 2007. a

Kilkki, J., Aalto, T., Hatakka, J., Portin, H., and Laurila, T.: Atmospheric CO2 observations at Finnish urban and rural sites, Boreal Environ. Res., 20, 227–242, 2015. a

Kirschke, S., Bousquet, P., Ciais, P., Saunois, M., Canadell, J. G., Dlugokencky, E. J., Bergamaschi, P., Bergmann, D., Blake, D. R., Bruhwiler, L., Cameron-Smith, P., Castaldi, S., Chevallier, F., Feng, L., Fraser, A., Heimann, M., Hodson, E. L., Houweling, S., Josse, B., Fraser, P. J., Krummel, P. B., Lamarque, J.-F., Langenfelds, R. L., Le Quéré, C., Naik, V., O'Doherty, S., Palmer, P. I., Pison, I., Plummer, D., Poulter, B., Prinn, R. G., Rigby, M., Ringeval, B., Santini, M., Schmidt, M., Shindell, D. T., Simpson, I. J., Spahni, R., Steele, L. P., Strode, S. A., Sudo, K., Szopa, S., van der Werf, G. R., Voulgarakis, A., van Weele, M., Weiss, R. F., Williams, J. E., and Zeng, G.: Three decades of global methane sources and sinks, Nat. Geosci., 6, 813–823, https://doi.org/10.1038/ngeo1955, 2013. a

Kivi, R., Heikkinen, P., and Kyrö, E.: TCCON data from Sodankyla (FI), Release GGG2014R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.sodankyla01.R0/1149280, 2014. a

Notholt, J., Petri, C., Warneke, T., Deutscher, N. M., Buschmann, M., Weinzierl, C., Macatangay, R., and Grupe, P.: TCCON data from Bremen (DE), Release GGG2014R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.bremen01.R0/1149275, 2014. a

Notholt, J., Warneke, T., Petri, C., Deutscher, N. M., Weinzierl, C., Palm, M., and Buschmann, M.: TCCON data from Ny Ålesund, Spitsbergen (NO), Release GGG2014.R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.nyalesund01.R0/1149278, 2017. a

Ostler, A., Sussmann, R., Patra, P. K., Houweling, S., De Bruine, M., Stiller, G. P., Haenel, F. J., Plieninger, J., Bousquet, P., Yin, Y., Saunois, M., Walker, K. A., Deutscher, N. M., Griffith, D. W. T., Blumenstock, T., Hase, F., Warneke, T., Wang, Z., Kivi, R., and Robinson, J.: Evaluation of column-averaged methane in models and TCCON with a focus on the stratosphere, Atmos. Meas. Tech., 9, 4843–4859, https://doi.org/10.5194/amt-9-4843-2016, 2016. a

Pougatchev, N. S., Connor, B. J., and Rinsland, C. P.: Infrared measurements of the ozone vertical distribution above Kitt Peak, J. Geophys. Res., 100, 16689, https://doi.org/10.1029/95JD01296, 1995. a

Rigby, M., Prinn, R. G., Fraser, P. J., Simmonds, P. G., Langenfelds, R. L., Huang, J., Cunnold, D. M., Steele, L. P., Krummel, P. B., Weiss, R. F., O'Doherty, S., Salameh, P. K., Wang, H. J., Harth, C. M., Mühle, J., and Porter, L. W.: Renewed growth of atmospheric methane, Geophys. Res. Lett., 35, L22805, https://doi.org/10.1029/2008GL036037, 2008. a

Rodgers, C. D.: Inverse Methods for Atmospheric Sounding – Theory and Practice, Series on Atmospheric Oceanic and Planetary Physics, vol. 2, World Scientific Publishing Co. Pte. Ltd, Singapore, https://doi.org/10.1142/9789812813718, 2000. a, b, c

Rodgers, C. D.: Intercomparison of remote sounding instruments, J. Geophys. Res., 108, 46–48, https://doi.org/10.1029/2002JD002299, 2003. a

Rothman, L. S., Gordon, I. E., Babikov, Y., Barbe, A., Chris Benner, D., Bernath, P. F., Birk, M., Bizzocchi, L., Boudon, V., Brown, L. R., Campargue, A., Chance, K., Cohen, E. A., Coudert, L. H., Devi, V. M., Drouin, B. J., Fayt, A., Flaud, J. M., Gamache, R. R., Harrison, J. J., Hartmann, J. M., Hill, C., Hodges, J. T., Jacquemart, D., Jolly, A., Lamouroux, J., Le Roy, R. J., Li, G., Long, D. A., Lyulin, O. M., Mackie, C. J., Massie, S. T., Mikhailenko, S., Müller, H. S. P., Naumenko, O. V., Nikitin, A. V., Orphal, J., Perevalov, V., Perrin, A., Polovtseva, E. R., Richard, C., Smith, M. A. H., Starikova, E., Sung, K., Tashkun, S., Tennyson, J., Toon, G. C., Tyuterev, V. G., and Wagner, G.: The HITRAN2012 molecular spectroscopic database, J. Quant. Spectrosc. Rad., 130, 4–50, https://doi.org/10.1016/j.jqsrt.2013.07.002, 2013. a

Saad, K. M., Wunch, D., Toon, G. C., Bernath, P., Boone, C., Connor, B., Deutscher, N. M., Griffith, D. W. T., Kivi, R., Notholt, J., Roehl, C., Schneider, M., Sherlock, V., and Wennberg, P. O.: Derivation of tropospheric methane from TCCON CH4 and HF total column observations, Atmos. Meas. Tech., 7, 2907–2918, https://doi.org/10.5194/amt-7-2907-2014, 2014. a, b

Saad, K. M., Wunch, D., Deutscher, N. M., Griffith, D. W. T., Hase, F., De Mazière, M., Notholt, J., Pollard, D. F., Roehl, C. M., Schneider, M., Sussmann, R., Warneke, T., and Wennberg, P. O.: Seasonal variability of stratospheric methane: implications for constraining tropospheric methane budgets using total column observations, Atmos. Chem. Phys., 16, 14003–14024, https://doi.org/10.5194/acp-16-14003-2016, 2016. a

Saito, R., Patra, P. K., Deutscher, N., Wunch, D., Ishijima, K., Sherlock, V., Blumenstock, T., Dohe, S., Griffith, D., Hase, F., Heikkinen, P., Kyrö, E., Macatangay, R., Mendonca, J., Messerschmidt, J., Morino, I., Notholt, J., Rettinger, M., Strong, K., Sussmann, R., and Warneke, T.: Technical Note: Latitude-time variations of atmospheric column-average dry air mole fractions of CO2, CH4 and N2O, Atmos. Chem. Phys., 12, 7767–7777, https://doi.org/10.5194/acp-12-7767-2012, 2012. a

Schmidt, M., Lopez, M., Yver Kwok, C., Messager, C., Ramonet, M., Wastine, B., Vuillemin, C., Truong, F., Gal, B., Parmentier, E., Cloué, O., and Ciais, P.: High-precision quasi-continuous atmospheric greenhouse gas measurements at Trainou tower (Orléans forest, France), Atmos. Meas. Tech., 7, 2283–2296, https://doi.org/10.5194/amt-7-2283-2014, 2014. a, b

Sheese, P. E., Boone, C. D., and Walker, K. A.: Detecting physically unrealistic outliers in ACE-FTS atmospheric measurements, Atmos. Meas. Tech., 8, 741–750, https://doi.org/10.5194/amt-8-741-2015, 2015. a

Tikhonov, A. N.: Solution of Incorrectly Formulated Problems and the Regularisation Method, Soviet. Math. Dokl., 4, 1035–1038, https://doi.org/10.1111/J.1365-246X.2012.05699.X, 1963. a

Toon, G. C.: Telluric line list for GGG2014, TCCON data archive, hosted by the Carbon Dioxide Information Analysis Center, Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA, https://doi.org/10.14291/tccon.ggg2014.atm.R0/1221656, 2014. a

Tukiainen, S., Railo, J., Laine, M., Hakkarainen, J., Kivi, R., Heikkinen, P., Chen, H., and Tamminen, J.: Retrieval of atmospheric CH4 profiles from Fourier transform infrared data using dimension reduction and MCMC, J. Geophys. Res.-Atmos., 121, 10312–10327, https://doi.org/10.1002/2015JD024657, 2016. a

Wang, Z., Deutscher, N. M., Warneke, T., Notholt, J., Dils, B., Griffith, D. W. T., Schmidt, M., Ramonet, M., and Gerbig, C.: Retrieval of tropospheric column-averaged CH4 mole fraction by solar absorption FTIR-spectrometry using N2O as a proxy, Atmos. Meas. Tech., 7, 3295–3305, https://doi.org/10.5194/amt-7-3295-2014, 2014. a, b, c

Wang, Z., Warneke, T., Deutscher, N. M., Notholt, J., Karstens, U., Saunois, M., Schneider, M., Sussmann, R., Sembhi, H., Griffith, D. W. T., Pollard, D. F., Kivi, R., Petri, C., Velazco, V. A., Ramonet, M., and Chen, H.: Contributions of the troposphere and stratosphere to CH4 model biases, Atmos. Chem. Phys., 17, 13283–13295, https://doi.org/10.5194/acp-17-13283-2017, 2017. a, b

Warneke, T., Messerschmidt, J., Notholt, J., Weinzierl, C., Deutscher, N. M., Petri, C., Grupe, P., Vuillemin, C., Truong, F., Schmidt, M., Ramonet, M., and Parmentier, E.: TCCON data from Orléans (FR), Release GGG2014R0, TCCON data archive, hosted by CaltechDATA, https://doi.org/10.14291/tccon.ggg2014.orleans01.R0/1149276, 2014. a

Waymark, C., Waymark, C., Walker, K., Boone, C. D., and Bernath, P. F.: ACE-FTS version 3.0 data set: validation and data processing update, Ann. Geophys., 56, https://doi.org/10.4401/ag-6339, 2014. a

Wunch, D., Toon, G. C., Blavier, J.-F. L., Washenfelder, R. A., Notholt, J., Connor, B. J., Griffith, D. W. T., Sherlock, V., and Wennberg, P. O.: The Total Carbon Column Observing Network, Philos. Trans. R. Soc. A Math. Phys. Eng. Sci., 369, 2087–2112, https://doi.org/10.1098/rsta.2010.0240, 2011. a, b

Wunch, D., Toon, G. C., Sherlock, V., Deutscher, N. M., Liu, C., Feist, D. G., and Wennberg, P. O.: The Total Carbon Column Observing Network's GGG2014 Data Version, p. 43, https://doi.org/10.14291/tccon.ggg2014.documentation.R0/1221662, 2015. a, b, c

Wunch, D., Toon, G. C., Hedelius, J. K., Vizenor, N., Roehl, C. M., Saad, K. M., Blavier, J.-F. L., Blake, D. R., and Wennberg, P. O.: Quantifying the loss of processed natural gas within California's South Coast Air Basin using long-term measurements of ethane and methane, Atmos. Chem. Phys., 16, 14091–14105, https://doi.org/10.5194/acp-16-14091-2016, 2016. a

Yang, Z., Toon, G. C., Margolis, J. S., and Wennberg, P. O.: Atmospheric CO2 retrieved from ground-based near IR solar spectra, Geophys. Res. Lett., 29, 1–4, https://doi.org/10.1029/2001GL014537, 2002. a

Zhou, M., Dils, B., Wang, P., Detmers, R., Yoshida, Y., O'Dell, C. W., Feist, D. G., Velazco, V. A., Schneider, M., and De Mazière, M.: Validation of TANSO-FTS/GOSAT XCO2 and XCH4 glint mode retrievals using TCCON data from near-ocean sites, Atmos. Meas. Tech., 9, 1415–1430, https://doi.org/10.5194/amt-9-1415-2016, 2016.  a

Zhou, M., Langerock, B., Vigouroux, C., Sha, M. K., Ramonet, M., Delmotte, M., Mahieu, E., Bader, W., Hermans, C., Kumps, N., Metzger, J.-M., Duflot, V., Wang, Z., Palm, M., and De Mazière, M.: Atmospheric CO and CH4 time series and seasonal variations on Reunion Island from ground-based in situ and FTIR (NDACC and TCCON) measurements, Atmos. Chem. Phys., 18, 13881–13901, https://doi.org/10.5194/acp-18-13881-2018, 2018. a, b, c