Log scale,
Annotation Pulse Width and kHz frequency
ability to toggle between log and linear scales for the spectrogram

What we want the User to see:

• Start time
• End time
• Date of recording
• Location (show on map)
• Default species list (nice to have later), uses a Grid Cell number to map up to the species. Assume there is some python stuff to do lat/long to grid cell.

Map of where the annotations were recorded from

Uploaded Requirements:

• Audio Files
• Location
• Equipment information

Nice to haveAdded in a default species list

Some way to reduce the noise in the spectrogram

Creating a way to link the DB values to the viewer.

• Items aren't directly referenced in S3/MinIO so I need a way to connect the File name to the system.
• A way to hopefully link the annotations with a species type.

Notes:
Below I have the structure of the tables and how to associate some of the data.

• Projects - Top Level Item
• Surveys - have a foreign key into projects
• SurveyEvents -> foreign key into Surveys
• AcousticBatch -> foreign key into SurveyEvent
• AcousticFileBatch -> foreign key into AcoustBatchObject and AcousticFile
• AcousticFile -> foreign key into a Project

Some Endpoints that will be needed:

• /projects upper level item that has a header to the system
• /survey - listing of the surveys
• /survey_event - listing of survey_events
• /acoustic_batch - listing of acoustic batches
• /acoustic_file_batch - list of acoustic_file_batches
• /acoustic_file - list of all acoustic files
• species - list of all annotated species

Behavior:

• Initially I would love to have an endpoint that could list audio files and when clicking on an audio file it would request the resigned URL for the wav file and provide the relevant species annotations and segments for that file.
  • This would require from the audio file getting the related audio file images to get the offset milliseconds and the frequency for the image.
  • I would then need to find the AcousticFileBatch to get the speciesObject to display the species

For an given audiofile I think I want the return to look like:

{
    "filename": "example.wav",
    "url": "presigned_S3/MinIO/URL",
    "survey": {
        "type": {
            "description":  "text descriptio",
            "mapColor": "#000000"
        }
    },
    "generated_image": "base64 image data",
    "project": {
        "key": "uuid-key",
        "name": "name of project",
        "decription": "description",
        "created": "ISO Date"
    },
    "annotations": [
        {
            "offset": "offset in ms",
            "frequency": "frequency center in ms"
        }
    ],
    "species": {
        "code": "code",
        "family": "family",
        "genus": "genus",
        "species": "species",
        "commonName": "commonname"

    }
}

Notes:
50ms windows on spectrogram from database
Offset is most likely the start time for that window.
Double check frequency to see if it is bottom/top/center.

Capability to edit annotations and create new annotations.

Start looking at the spectrogram generation code and seeing if this can be made on the back-end instead of the front-end

Would be nice to display the frequency/time in ms of a point in the interface properly when hovering over it.

Using new endpoints create a client side code for the following:

• Listing available audio files in a list format. These files should include if they existing the s3/MinIO location as well as if they have annotations. If they have annotations it should list the species.
• Create an API endpoint to get a list of all the species available which can be used for selection
• When selecting an audio file it should be able to be loaded into the spectrogram for proper rendering and comparison with the image files that were generated.

Project listing with geospatial area and number of surveys.
You can click on a project to go to surveys filtered by the project.
Then each individual survey you can then see the number of files associated with each survey and geospatial information about it.
Clicking on the file takes you to more information about that file including the auto/manual species identification.