Skip to content

Additional Verification#1184

Merged
jlarson4 merged 30 commits intodev-3.x-canaryfrom
testing/additional-verification
Feb 26, 2026
Merged

Additional Verification#1184
jlarson4 merged 30 commits intodev-3.x-canaryfrom
testing/additional-verification

Conversation

@jlarson4
Copy link
Collaborator

Additional verification before next beta

  • Making sure every Architecture that has supported_models has at least 5 models that have been ran through Core Verification (HF comparison)
  • Improving the estimation system for memory usage in verify_models.py
  • Ensuring weights maintain their dtype even if a specific dtype is requested to avoid corruption

Checklist:

  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have not rewritten tests relating to key interfaces which would affect backward compatibility

bryce13950 and others added 30 commits January 2, 2026 22:36
… compatibility reporting

- Added batch verification system (verify_models.py) with status codes (0=unverified, 1=verified, 2=skipped, 3=failed)
- HF scraper with min_downloads=500 threshold (4,846 models across 20 architectures)
- 58 models verified, HF token sanitization in verification notes
- Registry data stored in single supported_models.json and verification_history.json files
- API, validation, and benchmark tooling updated for new registry format
…enting verification changes via a new page in the docs site.
…ve memory estimate for verify_models. Add verification for 36 more high value models
@jlarson4 jlarson4 merged commit 8210b99 into dev-3.x-canary Feb 26, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants