Skip to content

Conversation

@jbolor21
Copy link
Contributor

@jbolor21 jbolor21 commented Jan 29, 2026

Description

This PR is adding scorers to evaluate audio files by using AzureTTS to transcribe an audio file. I have also added this scorer to our video files so we can now score the audio in generated videos as well. This works by extracting the audio from the generated video and then using this new base audio scorer.

  • Added new audio_scorer along with audio_true_false and audio_scale files
  • Added functionality to video scorer to score audio

Tests and Documentation

Added examples in our notebooks for a demo and added unit tests

@jbolor21 jbolor21 changed the title [DRAFT] FEAT: Adding audio scoring FEAT: Adding audio scoring Jan 29, 2026
@rlundeen2 rlundeen2 self-assigned this Jan 30, 2026
@bashirpartovi
Copy link
Contributor

I think it would be great reading through this @jbolor21 https://junkangworld.com/blog/inheritance-vs-composition-5-key-rules-for-clean-code-2025 or if you have more time, you can explore Object Composition chapter https://learning.oreilly.com/library/view/composing-software/9781836644637/chap15.xhtml#leanpub-auto-what-is-object-composition

Copy link
Contributor

@bashirpartovi bashirpartovi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, just some minor comments

Copy link
Contributor

@bashirpartovi bashirpartovi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome job @jbolor21 , just a few minor nits, feel free to ignore

@jbolor21 jbolor21 merged commit ad7f52a into Azure:main Feb 11, 2026
28 checks passed
@jbolor21 jbolor21 deleted the users/bjagdagdorj/video_scorer branch February 11, 2026 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants