Milestone Demo 3

Acceptance Testing can be found here

Documentation on how to run the Backend can be found in the Readme

Release notes - AAC API - 1.0.0

Story

AAC-85 Integrate Synonym Map to CommandLibrary and to CommandMapping.

AAC-86 Update CommandConverter to Check Synonyms

AAC-88 Create a logging class to make all transcribed text and recognized game commands persist

AAC-89 Update SpeechConverter class to use the logging class

AAC-90 Update CommandConverter class to use the logging class

AAC-102 Return a response of some way so that the game dev is aware of what synonyms have been mapped

AAC-106 Submit changelog for review

AAC-108 Ability to toggle the synonym functionality

AAC-113 Research a phonetic matching algorithm or npm package to use

AAC-114 Integrate phonetic matching algorithm into the engine

AAC-115 Update the modal to display the score received from the phonetic match

AAC-116 Allow game dev to apply a threshold of what is considered good enough for the phonetic matching

Milestone Demo 2

Release notes - AAC API - 0.2.0

AAC-84 Implement SynonymResolver class

AAC-87 Write Unit Tests for SynonymResolver

AAC-91 Change SpeechConverter to an interface

AAC-93 Create backend directory in project root

AAC-94 Create api endpoints to return transcribed text

AAC-95 Create uniform responses for the api endpoints

AAC-96 Create a class for speechbrain transcription

AAC-97 Create a class for speechbrain voice separation

AAC-98 Create a virtual environment for python

AAC-99 Test endpoints

AAC-100 Write a function to convert float32Array to speechbrains format

AAC-101 create a backendConverter class in TS that uses the backend

AAC-103 Update facade class to let game dev choose the speechConverter implementation

AAC-104 Review changelog and changes in documentation

AAC-107 update getTranscribedFull to a better name

AAC-109 automate the api documentation in the ci/cd pipeline

Milestone Demo 1

Release notes - AAC API - 0.1.0

Story

AAC-8 Create initialization function that allows developers to start using the API

AAC-9 Create initialization function that allows developers to start using the API

AAC-15 Implement a way to start capturing microphone input

AAC-25 Filter out words from transcribed speech that arent specified game commands

AAC-30 Convert input to text

AAC-31 Display command history

AAC-34 Handle the errors for when the API cannot convert voice to text

AAC-35 Ability to mute the game during gameplay

AAC-39 Project Setup

AAC-41 Update Github readme so that document link points to correct link

AAC-42 Fix the Hello World message on the Docusaurus page

AAC-43 Finalize block diagram to a more professional looking illustration

AAC-44 Update requirements document abstract

AAC-45 Rewrite 1-5 use-cases based on the feedback

AAC-46 Rewrite 6-10 use-cases based on the feedback

AAC-47 Update Features and Requirements based on feedback

AAC-48 Rewrite General Requirements based on feedback

AAC-49 Update System Block Diagram in documentation based on feedback

AAC-50 Update System Block Diagram Description in documentation

AAC-51 Update Conceptual Design and Background based on feedback

AAC-52 Detailed descriptions for 2 components Accessibility Tools and Developer Tools

AAC-53 Create sequence diagrams for user stories 1-3

AAC-54 Create sequence diagrams for user stories 4-7

AAC-55 Create Sequence Diagram for user stories 8-10

AAC-57 Create descriptions for components AudioHandler and Command converter

AAC-59 Create unit tests for SpeechConverter.ts

AAC-60 Create Unit Tests for AudioInputHandler.ts

AAC-62 Create Unit Tests for commandHistory.ts

AAC-63 Make our first push to npm

AAC-66 Create a Coverage Report of project

AAC-67 Research Speech Seperation

AAC-68 Create a command Mapping class

AAC-70 Simple game to attach our npm package to for DEMO

AAC-72 Allow ability for game dev to add an import file of json

AAC-73 Start Researching how to handle synonyms of game commands

AAC-74 Update SpeechConverter.ts: Split up getTranscribed() into function for logging full transcription and function for passing transcription to commandConverter

AAC-75 Create dummy game github repo and share with team

AAC-76 Test dummy game with multiple Whisper models to make sure they all work

AAC-77 Test npm package on dummy game

AAC-78 Update readme with how to run instructions

AAC-79 Make sure that the command interface and transcription log work through the facade class? Figure out if this needs to be updated.

AAC-80 Gray out Whisper init button once Whisper initialized.

AAC-81 Test demo on Zoom