<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//TaxonX//DTD Taxonomic Treatment Publishing DTD v0 20100105//EN" "../../nlm/tax-treatment-NS0.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:tp="http://www.plazi.org/taxpub" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">17</journal-id>
      <journal-id journal-id-type="index">urn:lsid:arphahub.com:pub:8E638694-B4E0-570A-856A-746FF325BF6B</journal-id>
      <journal-id journal-id-type="aggregator">urn:lsid:zoobank.org:pub:FEF66878-15EE-4F8B-B369-7652D735020E</journal-id>
      <journal-title-group>
        <journal-title xml:lang="en">Research Ideas and Outcomes</journal-title>
        <abbrev-journal-title xml:lang="en">RIO</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="epub">2367-7163</issn>
      <publisher>
        <publisher-name>Pensoft Publishers</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.3897/rio.12.e183261</article-id>
      <article-id pub-id-type="publisher-id">183261</article-id>
      <article-id pub-id-type="manuscript">29972</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Project Report</subject>
        </subj-group>
        <subj-group subj-group-type="scientific_subject">
          <subject>Analytical chemistry</subject>
          <subject>Artificial intelligence</subject>
          <subject>Chemistry</subject>
          <subject>Computer &amp; Information sciences</subject>
        </subj-group>
        <subj-group subj-group-type="sdg">
          <subject>Clean water &amp; sanitation</subject>
          <subject>Good health &amp; well-being</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Interpreting 2D-NMR spectra using Grad-CAM</article-title>
      </title-group>
      <contrib-group content-type="authors">
        <contrib contrib-type="author" corresp="no">
          <name name-style="western">
            <surname>Kroon</surname>
            <given-names>Enriko</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author" corresp="no">
          <name name-style="western">
            <surname>Borges</surname>
            <given-names>Ricardo M</given-names>
          </name>
          <xref ref-type="aff" rid="A2">2</xref>
        </contrib>
        <contrib contrib-type="author" corresp="no">
          <name name-style="western">
            <surname>de Jesus</surname>
            <given-names>Rômulo Pereira</given-names>
          </name>
          <uri content-type="orcid">https://orcid.org/0000-0003-1490-2112</uri>
          <xref ref-type="aff" rid="A2">2</xref>
        </contrib>
        <contrib contrib-type="author" corresp="yes">
          <name name-style="western">
            <surname>Kuhn</surname>
            <given-names>Stefan</given-names>
          </name>
          <email xlink:type="simple">stefan.kuhn@ut.ee</email>
          <uri content-type="orcid">https://orcid.org/0000-0002-5990-4157</uri>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
      </contrib-group>
      <aff id="A1">
        <label>1</label>
        <addr-line content-type="verbatim">Tartu Ülikool, Tartu, Estonia</addr-line>
        <institution>Tartu Ülikool</institution>
        <addr-line content-type="city">Tartu</addr-line>
        <country>Estonia</country>
      </aff>
      <aff id="A2">
        <label>2</label>
        <addr-line content-type="verbatim">Walter Mors Institute of Research on Natural Products, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil</addr-line>
        <institution>Walter Mors Institute of Research on Natural Products, Federal University of Rio de Janeiro</institution>
        <addr-line content-type="city">Rio de Janeiro</addr-line>
        <country>Brazil</country>
      </aff>
      <author-notes>
        <fn fn-type="corresp">
          <p>Corresponding author: Stefan Kuhn (<email xlink:type="simple">stefan.kuhn@ut.ee</email>).</p>
        </fn>
        <fn fn-type="edited-by">
          <p>Academic editor: </p>
        </fn>
      </author-notes>
      <pub-date pub-type="collection">
        <year>2026</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>07</day>
        <month>01</month>
        <year>2026</year>
      </pub-date>
      <volume>12</volume>
      <elocation-id>e183261</elocation-id>
      <uri content-type="arpha" xlink:href="http://openbiodiv.net/865A31FF-0CBA-5DB3-9F11-C36B4D5011E2">865A31FF-0CBA-5DB3-9F11-C36B4D5011E2</uri>
      <uri content-type="zenodo_dep_id" xlink:href="https://zenodo.org/record/0">0</uri>
      <permissions>
        <copyright-statement>Enriko Kroon, Ricardo M Borges, Rômulo Pereira de Jesus, Stefan Kuhn</copyright-statement>
        <license license-type="creative-commons-attribution" xlink:href="http://creativecommons.org/licenses/by/4.0/" xlink:type="simple">
          <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p>
        </license>
      </permissions>
      <abstract>
        <label>Abstract</label>
        <p>It has been shown that it is possible to train a (simple) neural network to classify nuclear magnetic resonance spectra by a substructures either being part of the chemical structure measured or not. We now explore the interpretability of such models using techniques from explainable AI, specifically Grad-CAM. We show that those techniques do not give ideal results in the context of NMR, which would be able to identify individual peaks. On the other hand, they enable a better interpretation of the results than those metrics just based on "right or wrong". We can also confirm the result from our previous work, that the trained network performs well for pure compounds, but its generalisability to mixtures is questionable, a limitation that could only be assumed in the original study.</p>
      </abstract>
      <kwd-group>
        <label>Keywords</label>
        <kwd>nuclear magnetic resonance</kwd>
        <kwd>NMR</kwd>
        <kwd>machine learning</kwd>
        <kwd>AI</kwd>
        <kwd>explainable AI</kwd>
        <kwd>structure elucidation</kwd>
      </kwd-group>
      <counts>
        <fig-count count="15"/>
        <table-count count="0"/>
        <ref-count count="21"/>
      </counts>
    </article-meta>
  </front>
  <body>
    <sec sec-type="Introduction">
      <title>Introduction</title>
      <p>The question of determining the actual chemical structure underlying a sensorially perceivable substance, such as the product of a chemical reaction, is a core challenge in chemistry. Analytical chemistry provides a number of techniques to address this problem. Amongst those nuclear magnetic resonance (NMR) spectroscopy is one of the most informative. Each NMR spectrum is characteristic of a specific molecular structure, as different structures produce different spectra. Skilled spectroscopists can infer a structure from spectra, a process known as structure elucidation. For in-depth details of NMR spectroscopy and structure elucidation methodologies, we refer the reader to <xref ref-type="bibr" rid="B13741397">Elyashberg (2015)</xref> and the bibliography there.</p>
      <p>The ambition to automate the process of structure elucidation emerged as soon as computer systems became available in chemistry. Software created for this is known as computer-aided structure elucidation (CASE) software (<xref ref-type="bibr" rid="B13740345">Kuhn et al. 2025</xref>). Major developments in the area included COCON (<xref ref-type="bibr" rid="B13740823">Lindel et al. 1997</xref>), SENECA (<xref ref-type="bibr" rid="B13741973">Kuhn and Steinbeck 2010</xref>), LSD/pyLSD (<xref ref-type="bibr" rid="B13742000">Nuzillard 2003</xref>), Mestrelab MNova (<xref ref-type="bibr" rid="B13741116">MestraLab 2024</xref>), Bruker CMC-se (<xref ref-type="bibr" rid="B13741388">Kessler and Godejohann 2018</xref>), ACD/Structure Elucidator (<xref ref-type="bibr" rid="B13740832">Elyashberg et al. 2004</xref> and Sherlock (<xref ref-type="bibr" rid="B13740936">Wenk et al. 2023</xref>). NMRFilter (<xref ref-type="bibr" rid="B13746774">Kuhn et al. 2019</xref>, <xref ref-type="bibr" rid="B13740559">Kuhn et al. 2020</xref>) is an example of compound annotation in mixtures. Quantum calculations-aided structure elucidation also offers high-precision insights by simulating NMR parameters directly from first-principles (<xref ref-type="bibr" rid="B13740412">Costa et al. 2021</xref>), but those methods will not be addressed here. Those programmes typically compare candidate structures to the spectral data measured using spectrum prediction. Given the vastness of chemical space, they typically use heuristics (e.g. genetic algorithms or simulated annealing) to restrict the search space. Further constraints (e.g. known functional groups) are used to retrieve a result as unambiguous as possible. Nevertheless, the outcome is frequently a ranked list of candidate structures rather than a definitive solution. Given the recent significant successes achieved by artificial intelligence systems (for example, the essays produced by large language models, <xref ref-type="bibr" rid="B13741406">Binz et al. (2025)</xref>), it is a natural question to ask if this task could be performed by an AI system without the explicit steps contained in CASE systems (<xref ref-type="bibr" rid="B13740345">Kuhn et al. 2025</xref>). Whilst, to our knowledge, there is currently no such complete system, steps in the direction have been taken. One example is <xref ref-type="bibr" rid="B13741429">Hu et al. (2024)</xref>, which predicts substructures from 1D spectra and assembles these into structures. The DeepSAT system (<xref ref-type="bibr" rid="B13740521">Kim et al. 2023</xref>) combines structure generation with database searches. As opposed to the directed generation of compounds to find one that matches the measured spectra best, DeepSAT predicts a fingerprint and a chemical class from the spectra using machine-learning techniques and searches a database for the best fit to those predicted properties. In <xref ref-type="bibr" rid="B13741220">Kuhn et al. (2022)</xref>, it was demonstrated that a neural network can tell if a certain fragment is contained in a structure or not from an NMR spectrum. This work uses two-dimensional experiments, namely Heteronuclear Single Quantum Coherence (HSQC) and Heteronuclear Multiple Bond Correlation (HMBC). They show 1-bond and 2/3-bond 13C-1H shift correlations and, therefore, contain a significant amount of structural information. This neural network can be viewed as a step towards data-driven automated structure elucidation.</p>
      <p>Whilst ML methods hold significant promise, there are downsides as well. Chief amongst these is their "black-box" nature, as models often produce predictions without providing insight into the underlying reasoning. They produce a result, but there is no explanation given as to why or any visible reasoning. Not only is this unsatisfying for the user, but it also makes users distrust the results. Hence, explainable AI is a critical development. This paper shows some attempts to make the results from <xref ref-type="bibr" rid="B13741220">Kuhn et al. (2022)</xref> explainable. To the best of our knowledge, this represents the first attempt to incorporate explainable AI into the context of NMR-based structure elucidation.</p>
    </sec>
    <sec sec-type="Description">
      <title>Description</title>
      <sec sec-type="NMR and Machine Learning">
        <title>NMR and Machine Learning</title>
        <p>Machine learning, specifically supervised machine learning, works by presenting a model with solved examples of a class of problems and adjusting parameters in the model to approach the solutions. If the model is then presented with unsolved problems, it can apply the knowledge learnt and give a (good) solution. One possible class of models are neural networks, which are loosely modelled on the structure of the human brain. A specific class of neural networks are convolutional neural networks (CNNs), which have proven their strength particularly for interpreting image and other array-like data. That means that they may also be suitable for NMR spectra, as demonstrated in <xref ref-type="bibr" rid="B13741220">Kuhn et al. (2022)</xref>. Fig. <xref ref-type="fig" rid="F13783722">1</xref> shows the networks employed for the task of classifying spectra by substructures. In Fig. <xref ref-type="fig" rid="F13742392">2</xref>, the three substructures for which the network has been trained are shown. The three structures will be used as examples throughout the paper. For details of the machine-learning architecture and tools used, we refer the reader to <xref ref-type="bibr" rid="B13741220">Kuhn et al. (2022)</xref>.</p>
        <p>Class Activation Maps (CAM), originally introduced by <xref ref-type="bibr" rid="B13742279">Zhou et al. (2016)</xref>, are a possibility to overcome the black-box nature of neural networks in the context of image analysis. Their aim is to display regions in an image that contribute the most to the result. A further development of CAM is Grad-CAM (Gradient-weighted class activation mapping, <xref ref-type="bibr" rid="B13742289">Selvaraju et al. 2017</xref>, <xref ref-type="bibr" rid="B13742268">Selvaraju et al. 2019</xref>), which we will mainly use. Fig. <xref ref-type="fig" rid="F13742422">3</xref> shows an example of an application of Grad-CAM, the identification of a cat and a dog in an image. Not surprisingly, the regions used are the animals themselves. Less obvious is that, seemingly, the identification of the dog mainly uses the face, whereas for the cat, the body is the main contributor.</p>
        <p>Grad-CAM is more universal than CAM since it does not require a specific architecture. Grad-CAM determines the importance of the features by calculating the gradient in respect to the majority class (or any target class of interest) of the feature maps. Then the given gradients are global-average-pooled over the width and height dimensions to obtain the importance of the neurons. The importance scores are then used as the weight of the corresponding feature maps. By combining these weighted maps, a single localised map is created that highlights the areas of the image that had the most significant impact on the decision of the network. After that, the result is passed through ReLu activation to obtain only the areas that had a positive effect on the network's decision-making process, thus creating a heat map. Gradient-weighted class activation mapping plus plus (Grad-CAM++, <xref ref-type="bibr" rid="B13742299">Chattopadhay et al. (2018)</xref>) is a derivative and extension of the Grad-CAM algorithm. It tries to improve on the accuracy of the heatmaps by multiple object instances or small target regions by also using second- and third-order gradients of the feature map for the importance calculation in addition to first-order gradients.</p>
        <p>In Fig. <xref ref-type="fig" rid="F13783636">4</xref>, we show the ideal result of applying CAM to the NMR fragment learning, using the HSQC spectrum of a fatty acid. Ideally, exactly those peaks from the fatty acid fragment would be highlighted since only they have been used. Of course, in reality, some mismatches are to be expected and this result will not be possible.</p>
      </sec>
      <sec sec-type="Data">
        <title>Data</title>
        <p>The data used for this experiment are taken from the download site of the Biological Magnetic Resonance Data Bank (<xref ref-type="bibr" rid="B13742247">Ulrich et al. 2007</xref>) at <ext-link ext-link-type="uri" xlink:href="https://bmrb.io/ftp/pub/bmrb/metabolomics/entry_directories/">https://bmrb.io/ftp/pub/bmrb/metabolomics/entry_directories/</ext-link>. For each compound, there is a subdirectory named bmseX, where X is a number. We will use bmseX numbers in this paper to identify structures. The subdirectory contains raw data, as well as spectral images and a mol file of the structure. The spectral images were manually processed by removing the scales and any other "decorations", for example, grids, as these might confuse the processing. The scales shown in this paper were added later and are not part of the images used for machine learning.</p>
      </sec>
    </sec>
    <sec sec-type="Results">
      <title>Results</title>
      <p>To evaluate the effectiveness of Class Activation Mapping (CAM) methods and neural networks in chemical structure elucidation, a series of heatmap images were generated. The evaluation focuses on comparing the heatmaps of pure substances with those of artificially created mixtures that include the original pure substances. These artificial mixtures are produced by overlaying spectra from the three target compound classes - steroids, fatty acids and indoles - with spectra from compounds that do not belong to any of these subclasses. Each artificial mixture will include spectral data from one of the target classes along with one or two additional spectra from unrelated compounds. This method enables the assessment of the models’ ability to accurately classify relevant substructures and identify the substructure region in the spectra using Grad-CAM and Grad-CAM++ algorithms.</p>
      <sec sec-type="Grad-CAM">
        <title>Grad-CAM</title>
        <sec sec-type="Pure substances">
          <title>Pure substances</title>
          <p>By evaluating pure compounds, the neural network managed to correctly classify all of the substances by both HMBC and HSQC spectra (Fig. <xref ref-type="fig" rid="F13745231">5</xref> and Fig. <xref ref-type="fig" rid="F13745299">6</xref>). The generated heat map images showed minor misalignment with the actual location of the spectra. This could be due to the upscaling of the heatmap when it is generated from the last dense layer of the neural network. Since we are trying to specifically identify substructures, the spectra also contain peaks that are not part of the substructure. As, during the learning process, a multitude of spectra of compounds with the same core substructure are presented to the network, the network can identify the relevant parts. This was demonstrated by the ability of the network to identify test structures not used in the training. Looking at the heat maps, it is obvious that they mostly highlight all regions with peaks. That is a very similar to a first evaluation that an experienced spectroscopist would do. An example where this is not the case is the HSQC spectrum of the steroid, where only a portion of the visible spectral cluster is highlighted, with a substantial amount of peaks left unaccounted for. Ideally, we would see peaks precisely identified like this everywhere.</p>
        </sec>
        <sec sec-type="Mixture with one additional compound">
          <title>Mixture with one additional compound</title>
          <p>When using artificial mixtures for analysis, it becomes evident that the network partly retains its ability to accurately classify the presence of the three target substructures. This was indicated in \cite{fragments}, where, by using the HMBC spectra, all three examples could be identified correctly and, by using the HSQC spectrum, one of the three examples was identified correctly. An example for this is the HMBC spectrum for a steroid (Fig. <xref ref-type="fig" rid="F13746031">9</xref>), where we can observe that the additional spectral information introduced by the mixtures exerts only a minimal influence on the network's decision-making process. The heatmap reveals that regions containing spectral signals from non-target chemical compounds - not the steroid in this case - exhibits slight activation only. On the other hand, for the indole and fatty acid structures (Fig. <xref ref-type="fig" rid="F13745315">7</xref> and Fig. <xref ref-type="fig" rid="F13745317">8</xref>), these areas are still used. It should be noted that the result is correct, but this could be an accidental result. Overall, it is not clear from the heatmaps if the network is able to consistently separate the compounds.</p>
        </sec>
        <sec sec-type="Mixture with two additional compounds">
          <title>Mixture with two additional compounds</title>
          <p>In order to further investigate the effect of mixtures, we checked artificial mixtures of three components (the target substance plus two other substances). In \cite{fragments}, only three of six cases were identified correctly. The heatmaps show a similar picture. In case of the steroid HMBC spectrum (Fig. <xref ref-type="fig" rid="F13746584">12</xref>), the additional peaks are only slightly activated. On the other hand, the HSQC spectra for the indole and fatty acid structures (Fig. <xref ref-type="fig" rid="F13746034">10</xref> and Fig. <xref ref-type="fig" rid="F13746040">11</xref>) show activation of wrong peaks as well and one of them was misclassified. Overall, it can be seen that, by mixtures with more than one additional spectra, the effectiveness of the network can vary significantly. In Fig. <xref ref-type="fig" rid="F13746034">10</xref>, the neural network along with Grad-CAM analysis also includes non-relevant spectral information by the decision, although it classified the substructure correctly.</p>
        </sec>
      </sec>
      <sec sec-type="Grad-CAM++">
        <title>Grad-CAM++</title>
        <p>By applying the Grad-CAM++ algorithm, the heat maps generated for the pure spectra (Fig. <xref ref-type="fig" rid="F13746605">13</xref> and Fig. <xref ref-type="fig" rid="F13746630">14</xref>) are very similar to those generated with Grad-CAM. We also show a mixture Grad-CAM++ heatmap (Fig. <xref ref-type="fig" rid="F13746634">15</xref>). Again, the heatmap looks very similar to the Grad-CAM heatmap. What can be observed is that the misalignment between peaks and regions of attention is less in Grad-CAM++ than in Grad-CAM, using the same network. On the other hand, judging from the examples, fundamental differences are not observable. We therefore do not repeat the details of all experiments with Grad-CAM++ here.</p>
      </sec>
    </sec>
    <sec sec-type="Conclusions">
      <title>Conclusions</title>
      <p>From our observations, we can draw a number of conclusions about the use of CAMs in structure elucidation.</p>
      <p>One observation is that, at least Grad-CAM and Grad-CAM++, do not provide the level of detail which would be needed to identify peaks. This makes the ideal goal of this exercise a target we have not reached.</p>
      <p>On the other hand, the heatmaps produced show that, for pure compounds, relevant parts of the spectrum are considered by the networks. On the other hand, when looking at the mixtures, the picture is not clear - in many cases (but not all), parts of the compounds which should not contribute, are used as well. This confirms the results of <xref ref-type="bibr" rid="B13741220">Kuhn et al. (2022)</xref>, where fragments were identified reliably in pure compounds, whereas mixtures often failed.</p>
      <p>Due to this, heat maps, even if not ideal for determining peaks, can help to evaluate a model beyond the usual metrics. As we have seen, using Grad-CAM, we better understand what is going on in the model than without it. In so far, this can serve as a step towards explainable AI. It should be noted that the basis for the application is the use of spectral images and convolutional neural networks, which are commonly used for image analysis.</p>
    </sec>
    <sec sec-type="Recommendations">
      <title>Recommendations</title>
      <p>We have demonstrated that a class activation map, particularly Grad-CAM, can help better understand the results of analysing spectra using neural networks. Whilst we did not achieve our ideal goal, we have demonstrated that the previous results become better understandable and easier to interpret. It is also clear that better models are needed for the mixtures. In general, finer-grained methods than Grad-CAM would be helpful. Finally, more data will help establish a broader base for analysis.</p>
    </sec>
  </body>
  <back>
    <ack>
      <title>Acknowledgements</title>
      <p>We are grateful to the BMRB project for providing the spectral data used in this paper. Carlos Corbas from MestreLab Research S.L.U, Santiago, Spain and colleagues have kindly helped with data processing.</p>
    </ack>
    <sec sec-type="Author contributions">
      <title>Author contributions</title>
      <p>Conceptualisation, S.K.; methodology, S.K.; software, E.K.; validation, R.M.B., R.P.J.; investigation, S.K., E.K.; writing---original draft preparation, E.K.; writing---review and editing, S.K., R.M.B., R.P.J.; supervision, S.K. All authors have read and agreed to the published version of the manuscript.</p>
    </sec>
    <sec sec-type="Conflicts of interest">
      <title>Conflicts of interest</title>
      <p>No conflict of interest to declare</p>
      <p>Disclaimer: This article is (co-)authored by any of the Editors-in-Chief, Managing Editors or their deputies in this journal.</p>
    </sec>
    <ref-list>
      <title>References</title>
      <ref id="B13741406">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Binz</surname>
              <given-names>Marcel</given-names>
            </name>
            <name name-style="western">
              <surname>Alaniz</surname>
              <given-names>Stephan</given-names>
            </name>
            <name name-style="western">
              <surname>Roskies</surname>
              <given-names>Adina</given-names>
            </name>
            <name name-style="western">
              <surname>Aczel</surname>
              <given-names>Balazs</given-names>
            </name>
            <name name-style="western">
              <surname>Bergstrom</surname>
              <given-names>Carl T.</given-names>
            </name>
            <name name-style="western">
              <surname>Allen</surname>
              <given-names>Colin</given-names>
            </name>
            <name name-style="western">
              <surname>Schad</surname>
              <given-names>Daniel</given-names>
            </name>
            <name name-style="western">
              <surname>Wulff</surname>
              <given-names>Dirk</given-names>
            </name>
            <name name-style="western">
              <surname>West</surname>
              <given-names>Jevin D.</given-names>
            </name>
            <name name-style="western">
              <surname>Zhang</surname>
              <given-names>Qiong</given-names>
            </name>
            <name name-style="western">
              <surname>Shiffrin</surname>
              <given-names>Richard M.</given-names>
            </name>
            <name name-style="western">
              <surname>Gershman</surname>
              <given-names>Samuel J.</given-names>
            </name>
            <name name-style="western">
              <surname>Popov</surname>
              <given-names>Vencislav</given-names>
            </name>
            <name name-style="western">
              <surname>Bender</surname>
              <given-names>Emily M.</given-names>
            </name>
            <name name-style="western">
              <surname>Marelli</surname>
              <given-names>Marco</given-names>
            </name>
            <name name-style="western">
              <surname>Botvinick</surname>
              <given-names>Matthew M.</given-names>
            </name>
            <name name-style="western">
              <surname>Akata</surname>
              <given-names>Zeynep</given-names>
            </name>
            <name name-style="western">
              <surname>Schulz</surname>
              <given-names>Eric</given-names>
            </name>
          </person-group>
          <year>2025</year>
          <article-title>How should the advancement of large language models affect the practice of science?</article-title>
          <source>Proceedings of the National Academy of Sciences</source>
          <volume>122</volume>
          <issue>5</issue>
          <pub-id pub-id-type="doi">10.1073/pnas.2401227121</pub-id>
        </element-citation>
      </ref>
      <ref id="B13742299">
        <element-citation publication-type="conference-preoceeding">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Chattopadhay</surname>
              <given-names>Aditya</given-names>
            </name>
            <name name-style="western">
              <surname>Sarkar</surname>
              <given-names>Anirban</given-names>
            </name>
            <name name-style="western">
              <surname>Howlader</surname>
              <given-names>Prantik</given-names>
            </name>
            <name name-style="western">
              <surname>Balasubramanian</surname>
              <given-names>Vineeth N</given-names>
            </name>
          </person-group>
          <year>2018</year>
          <source>Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks</source>
          <conf-name>2018 IEEE Winter Conference on Applications of Computer Vision (WACV)</conf-name>
          <conf-date>2018</conf-date>
          <size units="page">8</size>
          <pub-id pub-id-type="doi">10.1109/WACV.2018.00097</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740412">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Costa</surname>
              <given-names>Fabio L. P.</given-names>
            </name>
            <name name-style="western">
              <surname>de Albuquerque</surname>
              <given-names>Ana C. F.</given-names>
            </name>
            <name name-style="western">
              <surname>Fiorot</surname>
              <given-names>Rodolfo G.</given-names>
            </name>
            <name name-style="western">
              <surname>Lião</surname>
              <given-names>Luciano M.</given-names>
            </name>
            <name name-style="western">
              <surname>Martorano</surname>
              <given-names>Lucas H.</given-names>
            </name>
            <name name-style="western">
              <surname>Mota</surname>
              <given-names>Gunar V. S.</given-names>
            </name>
            <name name-style="western">
              <surname>Valverde</surname>
              <given-names>Alessandra L.</given-names>
            </name>
            <name name-style="western">
              <surname>Carneiro</surname>
              <given-names>José W. M.</given-names>
            </name>
            <name name-style="western">
              <surname>dos Santos Junior</surname>
              <given-names>Fernando M.</given-names>
            </name>
          </person-group>
          <year>2021</year>
          <article-title>Structural characterisation of natural products by means of quantum chemical calculations of NMR parameters: new insights</article-title>
          <source>Organic Chemistry Frontiers</source>
          <volume>8</volume>
          <issue>9</issue>
          <fpage>2019</fpage>
          <lpage>2058</lpage>
          <pub-id pub-id-type="doi">10.1039/D1QO00034A</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740832">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Elyashberg</surname>
              <given-names>Mikhail E.</given-names>
            </name>
            <name name-style="western">
              <surname>Blinov</surname>
              <given-names>Kirill A.</given-names>
            </name>
            <name name-style="western">
              <surname>Williams</surname>
              <given-names>Antony J.</given-names>
            </name>
            <name name-style="western">
              <surname>Molodtsov</surname>
              <given-names>Sergey G.</given-names>
            </name>
            <name name-style="western">
              <surname>Martin</surname>
              <given-names>Gary E.</given-names>
            </name>
            <name name-style="western">
              <surname>Martirosian</surname>
              <given-names>Eduard R.</given-names>
            </name>
          </person-group>
          <year>2004</year>
          <article-title>Structure Elucidator:þinspace A Versatile Expert System for Molecular Structure Elucidation from 1D and 2D NMR Data and Molecular Fragments</article-title>
          <source>Journal of Chemical Information and Computer Sciences</source>
          <volume>44</volume>
          <issue>3</issue>
          <fpage>771</fpage>
          <lpage>792</lpage>
          <pub-id pub-id-type="doi">10.1021/ci0341060</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741397">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Elyashberg</surname>
              <given-names>Mikhail</given-names>
            </name>
          </person-group>
          <year>2015</year>
          <article-title>Identification and structure elucidation by NMR spectroscopy</article-title>
          <source>TrAC Trends in Analytical Chemistry</source>
          <volume>69</volume>
          <fpage>88</fpage>
          <lpage>97</lpage>
          <pub-id pub-id-type="doi">10.1016/j.trac.2015.02.014</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741429">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Hu</surname>
              <given-names>Frank</given-names>
            </name>
            <name name-style="western">
              <surname>Chen</surname>
              <given-names>Michael S.</given-names>
            </name>
            <name name-style="western">
              <surname>Rotskoff</surname>
              <given-names>Grant M.</given-names>
            </name>
            <name name-style="western">
              <surname>Kanan</surname>
              <given-names>Matthew W.</given-names>
            </name>
            <name name-style="western">
              <surname>Markland</surname>
              <given-names>Thomas E.</given-names>
            </name>
          </person-group>
          <year>2024</year>
          <article-title>Accurate and Efficient Structure Elucidation from Routine One-Dimensional NMR Spectra Using Multitask Machine Learning</article-title>
          <source>ACS Central Science</source>
          <volume>10</volume>
          <issue>11</issue>
          <fpage>2162</fpage>
          <lpage>2170</lpage>
          <pub-id pub-id-type="doi">10.1021/acscentsci.4c01132</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741388">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kessler</surname>
              <given-names>Pavel</given-names>
            </name>
            <name name-style="western">
              <surname>Godejohann</surname>
              <given-names>Markus</given-names>
            </name>
          </person-group>
          <year>2018</year>
          <article-title>Identification of tentative marker in Corvina and Primitivo wines with CMC-se</article-title>
          <source>Magnetic Resonance in Chemistry</source>
          <volume>56</volume>
          <issue>6</issue>
          <fpage>480</fpage>
          <lpage>492</lpage>
          <pub-id pub-id-type="doi">10.1002/mrc.4712</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740521">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kim</surname>
              <given-names>H. W.</given-names>
            </name>
            <name name-style="western">
              <surname>Zhang</surname>
              <given-names>C.</given-names>
            </name>
            <name name-style="western">
              <surname>Reher</surname>
              <given-names>R.</given-names>
            </name>
            <name name-style="western">
              <surname>Wang</surname>
              <given-names>M.</given-names>
            </name>
            <name name-style="western">
              <surname>Alexander</surname>
              <given-names>K. L.</given-names>
            </name>
            <name name-style="western">
              <surname>Nothias</surname>
              <given-names>L. F.</given-names>
            </name>
            <name name-style="western">
              <surname>Han</surname>
              <given-names>Y. K.</given-names>
            </name>
            <name name-style="western">
              <surname>Shin</surname>
              <given-names>H.</given-names>
            </name>
            <name name-style="western">
              <surname>Lee</surname>
              <given-names>K. Y.</given-names>
            </name>
            <name name-style="western">
              <surname>Lee</surname>
              <given-names>K. H.</given-names>
            </name>
            <name name-style="western">
              <surname>Kim</surname>
              <given-names>M. J.</given-names>
            </name>
            <name name-style="western">
              <surname>Dorrestein</surname>
              <given-names>P. C.</given-names>
            </name>
            <name name-style="western">
              <surname>Gerwick</surname>
              <given-names>W. H.</given-names>
            </name>
            <name name-style="western">
              <surname>Cottrell</surname>
              <given-names>G. W.</given-names>
            </name>
          </person-group>
          <year>2023</year>
          <article-title>DeepSAT: Learning Molecular Structures from Nuclear Magnetic Resonance Data</article-title>
          <source>Journal of Cheminformatics</source>
          <volume>15</volume>
          <issue>1</issue>
          <pub-id pub-id-type="doi">10.1186/s13321-023-00738-4</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741973">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kuhn</surname>
              <given-names>Stefan</given-names>
            </name>
            <name name-style="western">
              <surname>Steinbeck</surname>
              <given-names>Christoph</given-names>
            </name>
          </person-group>
          <year>2010</year>
          <article-title>Progress on an open source computer-assisted structure elucidation suite (SENECA)</article-title>
          <source>Journal of Cheminformatics</source>
          <volume>2</volume>
          <issue>1</issue>
          <pub-id pub-id-type="doi">10.1186/1758-2946-2-S1-P34</pub-id>
        </element-citation>
      </ref>
      <ref id="B13746774">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kuhn</surname>
              <given-names>S.</given-names>
            </name>
            <name name-style="western">
              <surname>Colreavy-Donnelly</surname>
              <given-names>S.</given-names>
            </name>
            <name name-style="western">
              <surname>Souza</surname>
              <given-names>J.</given-names>
            </name>
            <name name-style="western">
              <surname>Borges</surname>
              <given-names>R. M.</given-names>
            </name>
          </person-group>
          <year>2019</year>
          <article-title>An integrated approach for mixture analysis using MS and NMR techniques</article-title>
          <source>Faraday Discuss</source>
          <volume>218</volume>
          <fpage>339</fpage>
          <lpage>353</lpage>
          <pub-id pub-id-type="doi">10.1039/C8FD00227D</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740559">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kuhn</surname>
              <given-names>Stefan</given-names>
            </name>
            <name name-style="western">
              <surname>Colreavy-Donnelly</surname>
              <given-names>Simon</given-names>
            </name>
            <name name-style="western">
              <surname>de Andrade Silva Quaresma</surname>
              <given-names>Lucas Eliseu</given-names>
            </name>
            <name name-style="western">
              <surname>de Andrade Silva Quaresma</surname>
              <given-names>Ezequiel</given-names>
            </name>
            <name name-style="western">
              <surname>Borges</surname>
              <given-names>Ricardo Moreira</given-names>
            </name>
          </person-group>
          <year>2020</year>
          <article-title>Applying NMR compound identification using NMRfilter to match predicted to experimental data</article-title>
          <source>Metabolomics</source>
          <volume>16</volume>
          <issue>12</issue>
          <pub-id pub-id-type="doi">10.1007/s11306-020-01748-1</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741220">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kuhn</surname>
              <given-names>Stefan</given-names>
            </name>
            <name name-style="western">
              <surname>Tumer</surname>
              <given-names>Eda</given-names>
            </name>
            <name name-style="western">
              <surname>Colreavy-Donnelly</surname>
              <given-names>Simon</given-names>
            </name>
            <name name-style="western">
              <surname>Moreira Borges</surname>
              <given-names>Ricardo</given-names>
            </name>
          </person-group>
          <year>2022</year>
          <article-title>A pilot study for fragment identification using 2D NMR and deep learning</article-title>
          <source>Magnetic Resonance in Chemistry</source>
          <volume>60</volume>
          <issue>11</issue>
          <fpage>1052</fpage>
          <lpage>1060</lpage>
          <pub-id pub-id-type="doi">10.1002/mrc.5212</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740345">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Kuhn</surname>
              <given-names>Stefan</given-names>
            </name>
            <name name-style="western">
              <surname>Jesus</surname>
              <given-names>Rômulo Pereira</given-names>
            </name>
            <name name-style="western">
              <surname>Borges</surname>
              <given-names>Ricardo Moreira</given-names>
            </name>
          </person-group>
          <year>2025</year>
          <article-title>Nuclear Magnetic Resonance and Artificial Intelligence</article-title>
          <source>Enciclopedia</source>
          <volume>1</volume>
          <pub-id pub-id-type="doi">10.3390/encyclopedia1010000</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740823">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Lindel</surname>
              <given-names>Thomas</given-names>
            </name>
            <name name-style="western">
              <surname>Junker</surname>
              <given-names>Jochen</given-names>
            </name>
            <name name-style="western">
              <surname>Köck</surname>
              <given-names>Matthias</given-names>
            </name>
          </person-group>
          <year>1997</year>
          <article-title>Cocon: From NMR Correlation Data to Molecular Constitutions</article-title>
          <source>Molecular modeling annual</source>
          <volume>3</volume>
          <issue>8</issue>
          <fpage>364</fpage>
          <lpage>368</lpage>
          <pub-id pub-id-type="doi">10.1007/s008940050052</pub-id>
        </element-citation>
      </ref>
      <ref id="B13741116">
        <element-citation publication-type="other">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>MestraLab</surname>
            </name>
          </person-group>
          <year>2024</year>
          <article-title>Mnova Structure Elucidation – Overview</article-title>
          <comment>Accessed: 2025-6-3, 2024.</comment>
          <uri>https://mestrelab.com/guide/ mnova-structure-elucidation-overview.html</uri>
        </element-citation>
      </ref>
      <ref id="B13742000">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Nuzillard</surname>
              <given-names>Jean-Marc</given-names>
            </name>
          </person-group>
          <year>2003</year>
          <article-title>Automatic structure determination of organic molecules: Principle and implementation of the LSD program</article-title>
          <source>Chinese Journal of Chemistry</source>
          <volume>21</volume>
          <issue>10</issue>
          <fpage>1263</fpage>
          <lpage>1267</lpage>
          <pub-id pub-id-type="doi">10.1002/cjoc.20030211006</pub-id>
        </element-citation>
      </ref>
      <ref id="B13742289">
        <element-citation publication-type="other">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Selvaraju</surname>
              <given-names>Ramprasaath R.</given-names>
            </name>
            <name name-style="western">
              <surname>Das</surname>
              <given-names>Abhishek</given-names>
            </name>
            <name name-style="western">
              <surname>Vedantam</surname>
              <given-names>Ramakrishna</given-names>
            </name>
            <name name-style="western">
              <surname>Cogswell</surname>
              <given-names>Michael</given-names>
            </name>
            <name name-style="western">
              <surname>Parikh</surname>
              <given-names>Devi</given-names>
            </name>
            <name name-style="western">
              <surname>Batra</surname>
              <given-names>Dhruv</given-names>
            </name>
          </person-group>
          <year>2017</year>
          <article-title>Grad-CAM: Why did you say that?</article-title>
          <uri>arXiv:1611.07450</uri>
          <pub-id pub-id-type="doi">10.48550/arXiv.1611.07450</pub-id>
        </element-citation>
      </ref>
      <ref id="B13742268">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Selvaraju</surname>
              <given-names>Ramprasaath R.</given-names>
            </name>
            <name name-style="western">
              <surname>Cogswell</surname>
              <given-names>Michael</given-names>
            </name>
            <name name-style="western">
              <surname>Das</surname>
              <given-names>Abhishek</given-names>
            </name>
            <name name-style="western">
              <surname>Vedantam</surname>
              <given-names>Ramakrishna</given-names>
            </name>
            <name name-style="western">
              <surname>Parikh</surname>
              <given-names>Devi</given-names>
            </name>
            <name name-style="western">
              <surname>Batra</surname>
              <given-names>Dhruv</given-names>
            </name>
          </person-group>
          <year>2019</year>
          <article-title>Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization</article-title>
          <source>International Journal of Computer Vision</source>
          <volume>128</volume>
          <issue>2</issue>
          <pub-id pub-id-type="doi">10.1007/s11263-019-01228-7</pub-id>
        </element-citation>
      </ref>
      <ref id="B13742247">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Ulrich</surname>
              <given-names>Eldon L.</given-names>
            </name>
            <name name-style="western">
              <surname>Akutsu</surname>
              <given-names>Hideo</given-names>
            </name>
            <name name-style="western">
              <surname>Doreleijers</surname>
              <given-names>Jurgen F.</given-names>
            </name>
            <name name-style="western">
              <surname>Harano</surname>
              <given-names>Yoko</given-names>
            </name>
            <name name-style="western">
              <surname>Ioannidis</surname>
              <given-names>Yannis E.</given-names>
            </name>
            <name name-style="western">
              <surname>Lin</surname>
              <given-names>Jundong</given-names>
            </name>
            <name name-style="western">
              <surname>Livny</surname>
              <given-names>Miron</given-names>
            </name>
            <name name-style="western">
              <surname>Mading</surname>
              <given-names>Steve</given-names>
            </name>
            <name name-style="western">
              <surname>Maziuk</surname>
              <given-names>Dimitri</given-names>
            </name>
            <name name-style="western">
              <surname>Miller</surname>
              <given-names>Zachary</given-names>
            </name>
            <name name-style="western">
              <surname>Nakatani</surname>
              <given-names>Eiichi</given-names>
            </name>
            <name name-style="western">
              <surname>Schulte</surname>
              <given-names>Christopher F.</given-names>
            </name>
            <name name-style="western">
              <surname>Tolmie</surname>
              <given-names>David E.</given-names>
            </name>
            <name name-style="western">
              <surname>Kent Wenger</surname>
              <given-names>R.</given-names>
            </name>
            <name name-style="western">
              <surname>Yao</surname>
              <given-names>Hongyang</given-names>
            </name>
            <name name-style="western">
              <surname>Markley</surname>
              <given-names>John L.</given-names>
            </name>
          </person-group>
          <year>2007</year>
          <article-title>BioMagResBank</article-title>
          <source>Nucleic Acids Research</source>
          <volume>36</volume>
          <issue>suppl 1</issue>
          <pub-id pub-id-type="doi">10.1093/nar/gkm957</pub-id>
        </element-citation>
      </ref>
      <ref id="B13740936">
        <element-citation publication-type="article">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Wenk</surname>
              <given-names>Michael</given-names>
            </name>
            <name name-style="western">
              <surname>Nuzillard</surname>
              <given-names>Jean-Marc</given-names>
            </name>
            <name name-style="western">
              <surname>Steinbeck</surname>
              <given-names>Christoph</given-names>
            </name>
          </person-group>
          <year>2023</year>
          <article-title>Sherlock—A Free and Open-Source System for the Computer-Assisted Structure Elucidation of Organic Compounds from NMR Data</article-title>
          <source>Molecules</source>
          <volume>28</volume>
          <issue>3</issue>
          <pub-id pub-id-type="doi">10.3390/molecules28031448</pub-id>
        </element-citation>
      </ref>
      <ref id="B13742279">
        <element-citation publication-type="conference-preoceeding">
          <person-group person-group-type="author">
            <name name-style="western">
              <surname>Zhou</surname>
              <given-names>Bolei</given-names>
            </name>
            <name name-style="western">
              <surname>Khosla</surname>
              <given-names>Aditya</given-names>
            </name>
            <name name-style="western">
              <surname>Lapedriza</surname>
              <given-names>Agata</given-names>
            </name>
            <name name-style="western">
              <surname>Oliva</surname>
              <given-names>Aude</given-names>
            </name>
            <name name-style="western">
              <surname>Torralba</surname>
              <given-names>Antonio</given-names>
            </name>
          </person-group>
          <year>2016</year>
          <source>Learning Deep Features for Discriminative Localization</source>
          <conf-name>2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)</conf-name>
          <conf-date>2016</conf-date>
          <size units="page">8</size>
          <pub-id pub-id-type="doi">10.1109/CVPR.2016.319</pub-id>
        </element-citation>
      </ref>
    </ref-list>
  </back>
  <floats-group>
    <fig id="F13783722" position="float" orientation="portrait">
      <object-id content-type="arpha">456F626C-9F32-57E2-9021-96F31698179E</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 1.</label>
      <caption>
        <p>Architecture of the single spectrum convolutional neural network used in this work.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g001.png" position="float" id="oo_1497782.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1497782</uri>
      </graphic>
    </fig>
    <fig id="F13742392" position="float" orientation="portrait">
      <object-id content-type="arpha">4373B04D-8A43-58BA-8801-A0C05121D3FA</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 2.</label>
      <caption>
        <p>Example for the three categories of structures, with the characteristic substructure highlighted. Left: Elaidic Acid, bmse000643, middle: Hydroxyindoleacetic Acid, bmse000364, right: α-Cholestan-3-one, bmse000489. Substructure searches exclude side chains on the fatty acid, but allow any groups otherwise.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g002.png" position="float" id="oo_1489893.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1489893</uri>
      </graphic>
    </fig>
    <fig id="F13742422" position="float" orientation="portrait">
      <object-id content-type="arpha">B0676146-BC44-53A2-96B3-44CCA05D42C1</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure11</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 3.</label>
      <caption>
        <p>An example of Grad-Cam explaining how a neural network identifies a cat and a dog in an image. Heatmap from <xref ref-type="bibr" rid="B13742268">Selvaraju et al. (2019)</xref>, original image "Sabian and Maggy" by Joyell VanGelder is licensed under CC BY 2.0.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g003.png" position="float" id="oo_1489894.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1489894</uri>
      </graphic>
    </fig>
    <fig id="F13783636" position="float" orientation="portrait">
      <object-id content-type="arpha">B3A1D4F2-84E1-5CB7-A230-0A7A32CA3B4D</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 4.</label>
      <caption>
        <p>Left: The unchanged HSQC spectrum of a fatty acid (bmse000643). Right: The ideal result of the tool, applied to this spectrum. The tool would highlight exactly those peaks belonging to the atoms in the fatty acid fragment. In the image, the region where important peaks are located is enlarged.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g004.png" position="float" id="oo_1497772.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1497772</uri>
      </graphic>
    </fig>
    <fig id="F13745231" position="float" orientation="portrait">
      <object-id content-type="arpha">76223667-5F1F-5ECD-ADFE-A8DB0D965B76</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 5.</label>
      <caption>
        <p>Grad-CAM analysis of pure HMBC spectra showing feature importance for different compound classes. Left: A fatty acid spectrum, bmse000643, centre: A steroid spectrum, bmse000489, right: An indole spectrum, bmse000364.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g005.png" position="float" id="oo_1490758.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1490758</uri>
      </graphic>
    </fig>
    <fig id="F13745299" position="float" orientation="portrait">
      <object-id content-type="arpha">A448C1AA-887B-5472-A35F-C27B4B304D24</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 6.</label>
      <caption>
        <p>Grad-CAM analysis of pure HSQC spectra showing feature importance for different compound classes. Left: A fatty acid spectrum, bmse000643, centre: A steroid spectrum, bmse000489, right: An indole spectrum, bmse000364.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g006.png" position="float" id="oo_1490769.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1490769</uri>
      </graphic>
    </fig>
    <fig id="F13745315" position="float" orientation="portrait">
      <object-id content-type="arpha">F94FE194-6B35-5F66-B55E-9E9951CBF2CE</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 7.</label>
      <caption>
        <p>Fatty acid HMBC spectrum (bmse000643), artificial mixture with bmse000060 (Adenine), Grad-CAM analysis of the mixture.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g007.png" position="float" id="oo_1490844.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1490844</uri>
      </graphic>
    </fig>
    <fig id="F13745317" position="float" orientation="portrait">
      <object-id content-type="arpha">3E14060E-8AFF-5D36-843E-C14A232F7A93</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 8.</label>
      <caption>
        <p>Indole HMBC spectrum (bmse000364), mixture with bmse000060 (Adenine), Grad-CAM analysis of the mixture.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g008.png" position="float" id="oo_1490847.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1490847</uri>
      </graphic>
    </fig>
    <fig id="F13746031" position="float" orientation="portrait">
      <object-id content-type="arpha">49B88B59-1D3B-5958-9BE2-F1BEF8895D14</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 9.</label>
      <caption>
        <p>Steroid HMBC spectrum (bmse000489), artificial mixture with bmse000060 (Adenine), Grad-CAM analysis of the mixture.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g009.png" position="float" id="oo_1491354.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491354</uri>
      </graphic>
    </fig>
    <fig id="F13746034" position="float" orientation="portrait">
      <object-id content-type="arpha">DD0F58E0-D1F2-5E30-8936-408A700020E5</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 10.</label>
      <caption>
        <p>Fatty acid HSQC spectrum (bmse000643), bmse000060 (Adenine) and bmse000061 (Adenosine), Grad-CAM analysis of the artificial mixture. Misclassified as steroid.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g010.png" position="float" id="oo_1491369.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491369</uri>
      </graphic>
    </fig>
    <fig id="F13746040" position="float" orientation="portrait">
      <object-id content-type="arpha">8C85A7CF-C670-5343-A88B-358583E83279</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 11.</label>
      <caption>
        <p>Indole HSQC spectrum (bmse000364), artificial mixture with bmse000060 (Adenine) and bmse000061 (Adenosine), Grad-CAM analysis of the artificial mixture.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g011.png" position="float" id="oo_1491403.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491403</uri>
      </graphic>
    </fig>
    <fig id="F13746584" position="float" orientation="portrait">
      <object-id content-type="arpha">B96BC681-B7FF-51A9-8B10-CE9CB143B339</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 12.</label>
      <caption>
        <p>Steroid HMBC spectrum (bmse000489), artificial mixture with bmse000060 (Adenine) and bmse000061 (Adenosine), Grad-CAM analysis of the artificial mixture.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g012.png" position="float" id="oo_1491452.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491452</uri>
      </graphic>
    </fig>
    <fig id="F13746605" position="float" orientation="portrait">
      <object-id content-type="arpha">E438E445-A064-5D60-BC1B-6704C3256CF0</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure1</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 13.</label>
      <caption>
        <p>Grad-CAM++ analysis of pure HMBC spectra showing feature importance for different compound classes. Left: A fatty acid spectrum, bmse000643, centre: a steroid spectrum, bmse000489, right: An indole spectrum, bmse000364.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g013.png" position="float" id="oo_1491472.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491472</uri>
      </graphic>
    </fig>
    <fig id="F13746630" position="float" orientation="portrait">
      <object-id content-type="arpha">B06F93A1-4FBF-5006-8D9B-AFBC81391578</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 14.</label>
      <caption>
        <p>Grad-CAM++ analysis of pure HSQC spectra showing feature importance for different compound classes. Left: A fatty acid spectrum, bmse000643, centre: a steroid spectrum, bmse000489, right: An indole spectrum, bmse000364.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g014.png" position="float" id="oo_1491485.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491485</uri>
      </graphic>
    </fig>
    <fig id="F13746634" position="float" orientation="portrait">
      <object-id content-type="arpha">F429C28C-7589-5D58-9FE5-451EF6F2DF64</object-id>
      <object-id content-type="doi">10.3897/rio.12.e183261.figure15</object-id>
      <object-id content-type="zenodo_dep_id">0</object-id>
      <label>Figure 15.</label>
      <caption>
        <p>Fatty acid HMBC spectrum (bmse000643), artificial mixture with bmse000060 (Adenine), Grad-CAM++ analysis of the mixture. Misclassified as steroid.</p>
      </caption>
      <graphic xlink:href="rio-12-e183261-g015.png" position="float" id="oo_1491494.png" orientation="portrait" xlink:type="simple">
        <uri content-type="original_file">https://binary.pensoft.net/fig/1491494</uri>
      </graphic>
    </fig>
  </floats-group>
</article>
