Configuration

FrameFlow (Scaffold-Lab unconditional generation)

Configuration of FrameFlow: Flow-based method, released 2023-10; run inside the Scaffold-Lab pipeline on shared hardware.

12 evaluations · 12 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

12 evaluations · 12 results. Different protocols are not a single leaderboard.

Dataset: Scaffold-Lab generated backbones (100 per length group)

Sorted by Designability (Table 3 'Designability' column, printed as a group mean without data preprocessing; the Metrics section counts a backbone as designable when the mean sc-TM of its top 3 ProteinMPNN sequences refolded with ESMFold exceeds 0.5 (equation 1); the table does not state whether the value is the share of designable backbones or a mean sc-TM; not comparable with the 2 Angstrom sc-RMSD criterion in the concept definition; length 100) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configuration	Protocol and dataset	Designability (Table 3 'Designability' column, printed as a group mean without data preprocessing; the Metrics section counts a backbone as designable when the mean sc-TM of its top 3 ProteinMPNN sequences refolded with ESMFold exceeds 0.5 (equation 1); the table does not state whether the value is the share of designable backbones or a mean sc-TM; not comparable with the 2 Angstrom sc-RMSD criterion in the concept definition; length 100)	Designability (Table 3 'Designability' column, printed as a group mean without data preprocessing; the Metrics section counts a backbone as designable when the mean sc-TM of its top 3 ProteinMPNN sequences refolded with ESMFold exceeds 0.5 (equation 1); the table does not state whether the value is the share of designable backbones or a mean sc-TM; not comparable with the 2 Angstrom sc-RMSD criterion in the concept definition; length 50)	Proportion (unique Foldseek-Cluster clusters divided by the number of backbones in the group, clustering TM-score threshold 0.5; group mean without data preprocessing; length 100)	Proportion (unique Foldseek-Cluster clusters divided by the number of backbones in the group, clustering TM-score threshold 0.5; group mean without data preprocessing; length 50)	Rank (rank within the length group by mean TOPSIS relative closeness; Short group)	Runtime (average time taken to generate each backbone over 100 backbones per group, on identical hardware; length 100)	Runtime (average time taken to generate each backbone over 100 backbones per group, on identical hardware; length 50)	TM score (novelty as the pdb-TM of designable backbones against the PDB (lower is more novel); group mean without data preprocessing; length 100)	TM score (novelty as the pdb-TM of designable backbones against the PDB (lower is more novel); group mean without data preprocessing; length 50)	Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, mean over the lengths in the group; Short group)	Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, per length; length 100)	Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, per length; length 50)
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Designability(↑)	0.862	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Ci	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.525	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Ci	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.509
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Designability(↑)	Not reported	0.807	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Diversity (↑)	Not reported	Not reported	0.4	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Diversity (↑)	Not reported	Not reported	Not reported	0.32	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Efficiency (↓)	Not reported	Not reported	Not reported	Not reported	Not reported	0.17	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Efficiency (↓)	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.11	Not reported	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Mean Ci	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.517	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Novelty(↓)	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.721	Not reported	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Novelty(↓)	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	0.812	Not reported	Not reported	Not reported
FrameFlow (Scaffold-Lab unconditional generation)Evaluation	Scaffold-Lab unconditional generation: Rank	Not reported	Not reported	Not reported	Not reported	1	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported

All 12 result rows with coverage, uncertainty and sources

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Ci Dataset: Scaffold-Lab generated backbones (100 per length group)	0.525 Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, per length; length 100) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Ci on Scaffold-Lab unconditional generation, length 100 lit-structure-20261011-scaffoldlab-protocol-ci Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 100, column 'Ci'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Ci Dataset: Scaffold-Lab generated backbones (100 per length group)	0.509 Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, per length; length 50) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Ci on Scaffold-Lab unconditional generation, length 50 lit-structure-20261011-scaffoldlab-protocol-ci Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 50, column 'Ci'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Designability(↑) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.862 Designability (Table 3 'Designability' column, printed as a group mean without data preprocessing; the Metrics section counts a backbone as designable when the mean sc-TM of its top 3 ProteinMPNN sequences refolded with ESMFold exceeds 0.5 (equation 1); the table does not state whether the value is the share of designable backbones or a mean sc-TM; not comparable with the 2 Angstrom sc-RMSD criterion in the concept definition; length 100) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Designability(↑) on Scaffold-Lab unconditional generation, length 100 lit-structure-20261011-scaffoldlab-protocol-designability Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 100, column 'Designability(↑)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Designability(↑) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.807 Designability (Table 3 'Designability' column, printed as a group mean without data preprocessing; the Metrics section counts a backbone as designable when the mean sc-TM of its top 3 ProteinMPNN sequences refolded with ESMFold exceeds 0.5 (equation 1); the table does not state whether the value is the share of designable backbones or a mean sc-TM; not comparable with the 2 Angstrom sc-RMSD criterion in the concept definition; length 50) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Designability(↑) on Scaffold-Lab unconditional generation, length 50 lit-structure-20261011-scaffoldlab-protocol-designability Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 50, column 'Designability(↑)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Diversity (↑) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.4 Proportion (unique Foldseek-Cluster clusters divided by the number of backbones in the group, clustering TM-score threshold 0.5; group mean without data preprocessing; length 100) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Diversity (↑) on Scaffold-Lab unconditional generation, length 100 lit-structure-20261011-scaffoldlab-protocol-diversity Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 100, column 'Diversity (↑)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Diversity (↑) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.32 Proportion (unique Foldseek-Cluster clusters divided by the number of backbones in the group, clustering TM-score threshold 0.5; group mean without data preprocessing; length 50) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Diversity (↑) on Scaffold-Lab unconditional generation, length 50 lit-structure-20261011-scaffoldlab-protocol-diversity Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 50, column 'Diversity (↑)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Efficiency (↓) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.17 Runtime (average time taken to generate each backbone over 100 backbones per group, on identical hardware; length 100) unit-unreported · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Efficiency (↓) on Scaffold-Lab unconditional generation, length 100 lit-structure-20261011-scaffoldlab-protocol-efficiency Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 100, column 'Efficiency (↓)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Efficiency (↓) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.11 Runtime (average time taken to generate each backbone over 100 backbones per group, on identical hardware; length 50) unit-unreported · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Efficiency (↓) on Scaffold-Lab unconditional generation, length 50 lit-structure-20261011-scaffoldlab-protocol-efficiency Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 50, column 'Efficiency (↓)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Mean Ci Dataset: Scaffold-Lab generated backbones (100 per length group)	0.517 Topsis relative closeness (TOPSIS relative closeness with CRITIC weights, mean over the lengths in the group; Short group) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Mean Ci on Scaffold-Lab unconditional generation, Short group lit-structure-20261011-scaffoldlab-protocol-mean-ci Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow', column 'Mean Ci'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Novelty(↓) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.721 TM score (novelty as the pdb-TM of designable backbones against the PDB (lower is more novel); group mean without data preprocessing; length 100) unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Novelty(↓) on Scaffold-Lab unconditional generation, length 100 lit-structure-20261011-scaffoldlab-protocol-novelty Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 100, column 'Novelty(↓)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Novelty(↓) Dataset: Scaffold-Lab generated backbones (100 per length group)	0.812 TM score (novelty as the pdb-TM of designable backbones against the PDB (lower is more novel); group mean without data preprocessing; length 50) unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Novelty(↓) on Scaffold-Lab unconditional generation, length 50 lit-structure-20261011-scaffoldlab-protocol-novelty Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow' / length 50, column 'Novelty(↓)'
Configuration: FrameFlow (Scaffold-Lab unconditional generation)	Protocol: Scaffold-Lab unconditional generation: Rank Dataset: Scaffold-Lab generated backbones (100 per length group)	1 Rank (rank within the length group by mean TOPSIS relative closeness; Short group) unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Evidence concern: excluded from comparisons Table 3 Designability column: equation (1) defines a per-backbone success over 100 backbones per length, which gives two-decimal fractions, but the column prints three-decimal group means; the aggregation behind the column is not stated, and the criterion is sc-TM above 0.5, not the 2 Angstrom sc-RMSD in the store's designability concept. Do not compare these values with other designability results.Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, column 'Designability(↑)'; Metrics, equation (1) Methods, coverage and source FrameFlow Rank on Scaffold-Lab unconditional generation, Short group lit-structure-20261011-scaffoldlab-protocol-rank Aggregation: Not reported Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Table 3, row 'Short' / 'FrameFlow', column 'Rank'

Source checking is not independent reproduction. Release 2026-10-23-5347695500ed.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-23-5347695500ed
Property and statement	Original source and location	Review and provenance

No evidence rows match these filters. Choose another scope or clear the search.

How to read the evidence

Sources and history

Release 2026-10-23-5347695500ed · Record review: source checked

1 source record and release history

Scaffold-Lab: Critical evaluation and ranking of protein backbone generation methods in a unified framework · Original source · Version of record, PLoS Computational Biology 2026 (PMC13225634 JATS full text)

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: lit-structure-20261011-scaffoldlab-config-frameflow

areas: protein-structure
contexts: research
method types: specialist
reported name: FrameFlow
reported configuration: Flow-based method, released 2023-10; run inside the Scaffold-Lab pipeline on shared hardware
source locator: Table 1, row 'FrameFlow'; Table 3 row labels
missing metadata: version: reason: unreported; note: Table 1 gives the repository and release date, not a version
provenance note: FrameFlow as run in the Scaffold-Lab unconditional generation benchmark, with ProteinMPNN sequence design and ESMFold refolding.

Related records

Suggest a correction