xenLite: exploration of a class for Xenium demonstration data
October 29, 2024
Contents
1 Introduction
1.1 Motivation
Numerous groups are working on methodology for analyzing new data resources emerging from spatial transcriptomics experiments. The “computing technology stack” necessary to work with such data is complex. The following comment (Aug 16 2024) from the scverse group is characteristic:
The SpatialData Zarr format, which is described in our design doc, is an extension of the OME-NGFF specification, which makes use of the OME-Zarr, the AnnData Zarr and the Parquet file formats. We need to use these combination of technologies because currently OME-NGFF does not provide all the fundamentals required for storing spatial omics dataset; nevertheless, we try to stay as close as OME-NGFF as possible, and we are contributing to ultimately make spatial omics support available in pure OME-NGFF.
In Bioconductor 3.19, we might be committed to all these technologies (which include but do not mention HDF5) plus R, reticulate, basilisk, and sf to have a widely functional solution. Attaching the Voyager package leads to loading over 100 associated packages. The xenLite package is intended to explore the balance between functionality and high dependency load specifically for the analysis of outputs from 10x Xenium experiments. The XenSPEP class extends SpatialExperiment to include references to parquet files that manage voluminous geometry data; geometry can also be handled as DataFrame for sufficiently low volume experiments.
As of 0.0.7 of xenLite, a new class, XenSPEP, is provided to address parquet representation of cell, nucleus and transcript coordinates.
1.3 Data
This package is based on publicly available datasets.
Human dermal melanoma FFPE Human pan tissue dataset. For this dataset, we retrieved the
outs.zipfile from this site and ranXenSCE::ingestXenon the contents, producing a XenSPEP instance which was then saved in an HDF5-backed representation. This, along with the parquet files for cell, nucleus, and transcript coordinates, are zipped together and placed in an Open Storage Network bucket for retrieval viacacheXenPdmelLite.Human prostate adenocarcinoma FFPE Human pan tissue dataset. For this dataset, we retrieved the
outs.zipfile from this site and ranXenSCE::ingestXenon the contents, producing a XenSPEP instance which was then saved in an HDF5-backed representation. This, along with the parquet files for cell, nucleus, and transcript coordinates, are zipped together and placed in an Open Storage Network bucket for retrieval viacacheXenProstLite.Human Lung FFPE Lung cancer preview, Use
example(cacheXenLuad)to obtain this instance of XenSPEP.
1.4 A quick look
1.4.1 Hybrid example
In this example, transcript counts are in memory
in a sparse matrix, but geometry information is
handled in parquet. The viewSegG2 function
allows selection of two gene symbols, and
cells are colored according to single or double
occupancy.
library(xenLite)
pa <- cacheXenLuad()
luad <- restoreZipXenSPEP(pa)
rownames(luad) <- make.names(SummarizedExperiment:::rowData(luad)$Symbol, unique = TRUE)
out <- viewSegG2(luad, c(5800, 6300), c(1300, 1800), lwd = .5, gene1 = "CD4", gene2 = "EPCAM")
legend(5800, 1390, fill = c("purple", "cyan", "pink"), legend = c("CD4", "EPCAM", "both"))
## [1] 20741.4.2 Interactivity
In inst/app4, code is provided to work with the primary dermal melanoma
dataset. A map of the cell coordinates can drive focused exploration. The
region of interest is shown by a whitened rectangle in the upper left corner.
Figure 1: Map based on cell centroids
Cells are colored by quintile of size. Points where FBL transcripts are found are plotted as dots.
Figure 2: Zoom to slider-specified subplot
More work is needed to identify useful exploratory visualizations.
1.4.3 Large disk-based example
1.4.3.1 HDF5+parquet-backed example: not ready in xenLite
We want to be able to accommodate very large numbers of cells and transcripts without heavy infrastructure commitments.
We’ll use the prostate adenocarcinoma 5K dataset to demonstrate. A 900MB zip file will be cached.
prost is the path to a zip file in a BiocFileCache instance.
Create a folder to work in, and unzip.
Restore the SpatialExperiment component.
2 Session information
## R Under development (unstable) (2024-10-21 r87258)
## Platform: x86_64-pc-linux-gnu
## Running under: Ubuntu 24.04.1 LTS
##
## Matrix products: default
## BLAS: /home/biocbuild/bbs-3.21-bioc/R/lib/libRblas.so
## LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.12.0
##
## locale:
## [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
## [3] LC_TIME=en_GB LC_COLLATE=C
## [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
## [7] LC_PAPER=en_US.UTF-8 LC_NAME=C
## [9] LC_ADDRESS=C LC_TELEPHONE=C
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
##
## time zone: America/New_York
## tzcode source: system (glibc)
##
## attached base packages:
## [1] stats graphics grDevices utils datasets methods base
##
## other attached packages:
## [1] xenLite_1.1.0 BiocStyle_2.35.0
##
## loaded via a namespace (and not attached):
## [1] tidyselect_1.2.1 EBImage_4.49.0
## [3] dplyr_1.1.4 blob_1.2.4
## [5] arrow_17.0.0.1 filelock_1.0.3
## [7] bitops_1.0-9 fastmap_1.2.0
## [9] SingleCellExperiment_1.29.0 RCurl_1.98-1.16
## [11] BiocFileCache_2.15.0 promises_1.3.0
## [13] digest_0.6.37 mime_0.12
## [15] lifecycle_1.0.4 RSQLite_2.3.7
## [17] magrittr_2.0.3 compiler_4.5.0
## [19] rlang_1.1.4 sass_0.4.9
## [21] tools_4.5.0 utf8_1.2.4
## [23] yaml_2.3.10 knitr_1.48
## [25] S4Arrays_1.7.0 htmlwidgets_1.6.4
## [27] bit_4.5.0 curl_5.2.3
## [29] DelayedArray_0.33.0 abind_1.4-8
## [31] HDF5Array_1.35.0 withr_3.0.2
## [33] purrr_1.0.2 BiocGenerics_0.53.0
## [35] grid_4.5.0 stats4_4.5.0
## [37] fansi_1.0.6 colorspace_2.1-1
## [39] xtable_1.8-4 Rhdf5lib_1.29.0
## [41] ggplot2_3.5.1 scales_1.3.0
## [43] tinytex_0.53 SummarizedExperiment_1.37.0
## [45] cli_3.6.3 rmarkdown_2.28
## [47] crayon_1.5.3 generics_0.1.3
## [49] rjson_0.2.23 httr_1.4.7
## [51] DBI_1.2.3 cachem_1.1.0
## [53] rhdf5_2.51.0 zlibbioc_1.53.0
## [55] assertthat_0.2.1 BiocManager_1.30.25
## [57] XVector_0.47.0 tiff_0.1-12
## [59] matrixStats_1.4.1 vctrs_0.6.5
## [61] Matrix_1.7-1 jsonlite_1.8.9
## [63] bookdown_0.41 IRanges_2.41.0
## [65] fftwtools_0.9-11 S4Vectors_0.45.0
## [67] bit64_4.5.2 magick_2.8.5
## [69] jpeg_0.1-10 locfit_1.5-9.10
## [71] jquerylib_0.1.4 glue_1.8.0
## [73] gtable_0.3.6 later_1.3.2
## [75] GenomeInfoDb_1.43.0 GenomicRanges_1.59.0
## [77] UCSC.utils_1.3.0 munsell_0.5.1
## [79] tibble_3.2.1 pillar_1.9.0
## [81] htmltools_0.5.8.1 rhdf5filters_1.19.0
## [83] GenomeInfoDbData_1.2.13 R6_2.5.1
## [85] dbplyr_2.5.0 evaluate_1.0.1
## [87] shiny_1.9.1 lattice_0.22-6
## [89] Biobase_2.67.0 highr_0.11
## [91] png_0.1-8 SpatialExperiment_1.17.0
## [93] memoise_2.0.1 httpuv_1.6.15
## [95] bslib_0.8.0 Rcpp_1.0.13
## [97] SparseArray_1.7.0 xfun_0.48
## [99] MatrixGenerics_1.19.0 pkgconfig_2.0.3