Getting Started with scSimEval: Unified Benchmarking for Single-Cell Multiomics Simulations3 days ago
1. Introduction | 2. Package Architecture and Workflow | Step 1: Input Real and Simulated Data | 2.1 Input Data Formats & Metadata Requirements (Cell Types & Batch Labels) | 2.2 Metric Measurement Capacity by Data & Metadata Mode | Step 2: Calculate Evaluation Measures | Step 3: Run the Complete Benchmark | Step 4: Review Scores, Rankings, and Figures | 3. Score Normalization and Visual Mapping Workflow | 3.1 Two-Step Score Normalization | 3.2 Visual Mapping to Bubble Matrices | 4. Installation and Getting Started | 5. Evaluating Data Properties and Distributions | 5.1 Comparative Distribution QC Plot (plot_distribution_qc) | 6. Evaluating Cell Clustering and Group Structure | 7. Evaluating Batch Effects and Technical Confounders | 8. Evaluating Cell Lineages and Developmental Trajectories | 9. Evaluating Biological Signals and Marker Genes (DEGs) | 10. Evaluating Computational Resource Usage (Scalability) | 11. Master Evaluation Pipeline: evaluate_multiomics_accuracy | 12. Visualization Suite | 12.1 Multi-Dimensional Benchmarking Bubble Matrix (plot_benchmark_bubble_matrix) | 12.2 Evaluation Summary Horizontal Bar Matrix (plot_evaluation_summary) | 12.2b Simulator Performance Leaderboard (compute_method_leaderboard) | 12.3 Metric Score Distributions Across Categories (plot_metric_boxplots) | 12.4 Comprehensive Benchmark Heatmap (plot_metric_heatmap) | 12.5 Dimension Reduction and Ordination Plots (PCA & MDS) | 12.6 Cell Embeddings (t-SNE, UMAP, & PCA) and Low-Dimensional Quality Metrics | 13. Multi-Dataset and Multi-Method Benchmarking | 14. Interactive Web Application (Shiny Studio) | 14.1 The 7 Modular Application Tabs | 15. Supported Multiomics Data Types and Metric Compatibility | 15.1 Three Experimental Designs | 15.2 Metric Compatibility by Data Type | 15.3 Recommended Functions by Data Type | 16. Large-Scale Multi-Dataset Benchmarking on HPC Clusters | 17. Extension to Other Single-Cell Data Types | 18. Summary | 19. Authors and Maintainers | 18. Session Information