Advanced search
1 file | 13.86 MB Add to list

1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in noisy environments

Author
Organization
Project
  • SUNDIAL (SUrvey Network for Deep Imaging Analysis and Learning)
Abstract
Filamentary structures (one-dimensional manifolds) are ubiquitous in astronomical data sets. Be it in particle simulations or observations, filaments are always tracers of a perturbation in the equilibrium of the studied system and hold essential information on its history and future evolution. However, the recovery of such structures is often complicated by the presence of a large amount of background and transverse noise in the observation space. While the former is generally considered detrimental to the analysis, the latter can be attributed to measurement errors and it can hold essential information about the structure. To further complicate the scenario, one-dimensional manifolds (filaments) are generally non-linear and their geometry difficult to extract and model. Thus, in order to study hidden manifolds within the dataset, particular care has to be devoted to background noise removal and transverse noise modeling, while still maintaining accuracy in the recovery of their geometrical structure. We propose 1-DREAM: a toolbox composed of five main Machine Learning methodologies whose aim is to facilitate manifold extraction in such cases. Each methodology has been designed to address particular issues when dealing with complicated low-dimensional structures convoluted with noise and it has been extensively tested in previously published works. However, for the first time, in this work all methodologies are presented in detail, joint within a cohesive framework and demonstrated for three particularly interesting astronomical cases: a simulated jellyfish galaxy, a filament extracted from a simulated cosmic web and the stellar stream of Omega-Centauri as observed with the GAIA DR2. Two newly developed visualization techniques are also proposed, that take full advantage of the results obtained with 1-DREAM. This contribution presents the toolbox in all its details and the code is made publicly available to benefit the community. The controlled experiments on a purposefully built data set prove the accuracy of the pipeline in recovering the real underlying structures.
Keywords
Computer Science Applications, Astronomy and Astrophysics, Space and Planetary Science, Methods, N-body simulations, data analysis, statistical, Galaxies, Dwarf, (Cosmology, ) large-scale structure of universe, (Galaxy, ) globular clusters, individual (Omega-Centauri), DIGITAL SKY SURVEY, LARGE-SCALE STRUCTURE, NONLINEAR DIMENSIONALITY REDUCTION, RAM-PRESSURE, HALO SUBSTRUCTURE, SPIN ALIGNMENT, STELLAR STREAM, DARK ENERGY, GALAXIES, FILAMENTS

Downloads

  • 1-s2.0-S2213133722000725-main.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 13.86 MB

Citation

Please use this url to cite or link to this publication:

MLA
Canducci, M., et al. “1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in Noisy Environments.” ASTRONOMY AND COMPUTING, vol. 41, Elsevier BV, 2022, doi:10.1016/j.ascom.2022.100658.
APA
Canducci, M., Awad, P., Taghribi, A., Mohammadi, M., Mastropietro, M., De Rijcke, S., … Tiňo, P. (2022). 1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in noisy environments. ASTRONOMY AND COMPUTING, 41. https://doi.org/10.1016/j.ascom.2022.100658
Chicago author-date
Canducci, M., P. Awad, A. Taghribi, M. Mohammadi, Michele Mastropietro, Sven De Rijcke, R. Peletier, R. Smith, K. Bunte, and P. Tiňo. 2022. “1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in Noisy Environments.” ASTRONOMY AND COMPUTING 41. https://doi.org/10.1016/j.ascom.2022.100658.
Chicago author-date (all authors)
Canducci, M., P. Awad, A. Taghribi, M. Mohammadi, Michele Mastropietro, Sven De Rijcke, R. Peletier, R. Smith, K. Bunte, and P. Tiňo. 2022. “1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in Noisy Environments.” ASTRONOMY AND COMPUTING 41. doi:10.1016/j.ascom.2022.100658.
Vancouver
1.
Canducci M, Awad P, Taghribi A, Mohammadi M, Mastropietro M, De Rijcke S, et al. 1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in noisy environments. ASTRONOMY AND COMPUTING. 2022;41.
IEEE
[1]
M. Canducci et al., “1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in noisy environments,” ASTRONOMY AND COMPUTING, vol. 41, 2022.
@article{01GXB0RGSRTRGCK6E2NP17XVE8,
  abstract     = {{Filamentary structures (one-dimensional manifolds) are ubiquitous in astronomical data sets. Be it in particle simulations or observations, filaments are always tracers of a perturbation in the equilibrium of the studied system and hold essential information on its history and future evolution. However, the recovery of such structures is often complicated by the presence of a large amount of background and transverse noise in the observation space. While the former is generally considered detrimental to the analysis, the latter can be attributed to measurement errors and it can hold essential information about the structure. To further complicate the scenario, one-dimensional manifolds (filaments) are generally non-linear and their geometry difficult to extract and model. Thus, in order to study hidden manifolds within the dataset, particular care has to be devoted to background noise removal and transverse noise modeling, while still maintaining accuracy in the recovery of their geometrical structure. We propose 1-DREAM: a toolbox composed of five main Machine Learning methodologies whose aim is to facilitate manifold extraction in such cases. Each methodology has been designed to address particular issues when dealing with complicated low-dimensional structures convoluted with noise and it has been extensively tested in previously published works. However, for the first time, in this work all methodologies are presented in detail, joint within a cohesive framework and demonstrated for three particularly interesting astronomical cases: a simulated jellyfish galaxy, a filament extracted from a simulated cosmic web and the stellar stream of Omega-Centauri as observed with the GAIA DR2. Two newly developed visualization techniques are also proposed, that take full advantage of the results obtained with 1-DREAM. This contribution presents the toolbox in all its details and the code is made publicly available to benefit the community. The controlled experiments on a purposefully built data set prove the accuracy of the pipeline in recovering the real underlying structures.}},
  articleno    = {{100658}},
  author       = {{Canducci, M. and Awad, P. and Taghribi, A. and Mohammadi, M. and Mastropietro, Michele and De Rijcke, Sven and Peletier, R. and Smith, R. and Bunte, K. and Tiňo, P.}},
  issn         = {{2213-1337}},
  journal      = {{ASTRONOMY AND COMPUTING}},
  keywords     = {{Computer Science Applications,Astronomy and Astrophysics,Space and Planetary Science,Methods,N-body simulations,data analysis,statistical,Galaxies,Dwarf,(Cosmology,) large-scale structure of universe,(Galaxy,) globular clusters,individual (Omega-Centauri),DIGITAL SKY SURVEY,LARGE-SCALE STRUCTURE,NONLINEAR DIMENSIONALITY REDUCTION,RAM-PRESSURE,HALO SUBSTRUCTURE,SPIN ALIGNMENT,STELLAR STREAM,DARK ENERGY,GALAXIES,FILAMENTS}},
  language     = {{eng}},
  pages        = {{33}},
  publisher    = {{Elsevier BV}},
  title        = {{1-DREAM : 1D Recovery, Extraction and Analysis of Manifolds in noisy environments}},
  url          = {{http://doi.org/10.1016/j.ascom.2022.100658}},
  volume       = {{41}},
  year         = {{2022}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: