Quick Acoustic Classification

Analysing and classifying underwater acoustic signals can be a daunting task. To simplify the process, we have developed standardised procedures and dedicated software. These innovative tools help researchers and operators create detailed spectrograms and visual analyses, allowing them to extract critical information quickly and efficiently.

Most of the following procedures are for MS Windows machines, but we are trying to extend the packages to OSX also!

What our processes offer:

Impeccable organisation: Forget messy audio files! Our procedures standardise file nomenclature, ensuring a clear and easily interpretable timeline.
Guaranteed reliability: An automatic integrity check of the audio files (WAV) ensures that the data is error-free and ready for analysis.
Customised spectrograms: Generate spectrograms with a standard 15 minute time window optimised for your research needs. Adjust basic parameters for optimal signal visualisation.
Overview: Create extended timelines (as an option) to visualise longer periods of time in a single image, making it easier to identify long-term patterns.
Intuitive classification: Visually classify the contents of spectrograms to identify signal classes of interest. Generate data tables ready for graphing and statistical analysis.

File Naming Options: Towards a Shared Standard

Several file naming conventions have been proposed in the field of underwater acoustics, each with its own rationale. After careful evaluation, we have chosen to adopt a widely recognized format, aligned with that used by devices such as SoundTrap:

  • File Name Structure: The file name consists of two segments separated by a period (.). The first segment includes identifying information such as the recorder ID, the deployment campaign, or other relevant metadata. The second segment reports the date (YYMMDD) and time (HHmmss) of the recording start.
  • Format and Extension: All files are in uncompressed WAV format, with a .WAV extension.

Examples of Compliant File Names:

lavagna-44D45.241211090655.wav
test_33D566.250214153411.wav
…

You can easily find your preferred file renaming utility if you need to rename a whole batch of files and/or if your recordings do not yet match this standard. We suggest BulkRenameUtility which is tested, free for personal use and is easy and highly configurable.
Always consider that changing filenames is a critical operation. You might loose crucial information is you make mistakes.

This standard (acb_acb_.YYMMDDhhmmss.wav) is mandatory.

When you have a file list with SOUNDS

When you have a list of audio files it is time to download and install a set of tools that will be needed to manage the files extracting the information you need. All links (and projects) are external unless specified, so we have nothing to do with their great developers.

The tools you need are a few:

  • 1. SoX, the swiss-army knife of audio processing. It is a set of tools for sound processing. It is here
    Once you have installed SoX please remember to add its path to your system variables. (If you have no idea about what we are talking about, please seek help among friends).
  • 2. ffmpeg library to process part of the spectrograms. ffmpeg is here. Download your needed package, unpack, put all files in the same folder that keeps SoX (it should be already in your system’s path, so the system will find the files when needed).
  • 3. Download our Spectrogram Generator interface from HERE.
    This is a simplified interface that helps working with SoX. You will download a Windows executable that installs the libraries you need.
    Please consider that the generator will only work if the Sox and the ffmpeg libraries are already installed on your system.

Spectrogram Generator

SELECT FOLDER

Only select folder name, without opening it

Once you have installed the Spectrogram Generator, run it and you should see something like this.

This software is written in Python.

You will need to select the folder you want to operate on. Press FOLDER–> SELECT FOLDER (and include all subfolders if you want to).

Conder that you need to select a folder WITHOUT OPENING IT, so do NOT double-click on its name. Click just once.

VERIFY AUDIO FILES

Corrupted files will be renamed in their extension (from .wav to .wavcorr).

Press VERIFY AUDIO FILE to check if all audio files are consistent. This operation is needed in order to rename corrupted files (mainly due to battery problems) excluding them from the further processing.

Sometimes audio files have a glitch at their beginning. This might be related to errors in writing the first bytes of each file.
The FILE TRIM function can be used to cut the first milliseconds of each file, correcting the problem when performing statistical analysis of the files (like checking max levels).

It is easier if files have all the same duration

Considering that you will generate a spectrogram that is always the same size in pixels, it easier if we keep the horizontal axis always at the same duration. We like 15′ (900 seconds), shown on a 4096 pixel axis over a 1024 y axis.

If you have files with longer duration (for example 1 hour each) you can get 4 files of 15′ each automatically using the CHUNK SIZE (minutes) function. When you ENABLE this function all processed files will be chunked in smaller parts of 15′ each (if you set the minutes to 1… you will get 1′ chunks. 60 chunks per each hour). All chunks will be saved separately in a dedicated folder, and to their name will be added a trailing CNK_.

and now?

It is time to GENERATE SPECTROGRAMS

So, summarizing:

  • 4096 time resolution x
  • 1024 frequency resolution y
  • Select SPECTROGRAM SCALE LINEAR
  • CHUNK SIZE at 15′ if your files are longer than that
  • SPECTROGRAM PALETTE set at RAINBOW (we like it)
  • press GENERATE SPECTROGRAM and get a coffe

Spectrogram generation can be a rather long process

There will be a long long delay from your click to the SUCCESSFULL message.

You should see a progress bar, slowly increasing depending on the total number of files to be processed.

From a list of spectrograms to a table

The spectrograms will be created in a new folder named SPECTRA.
The folder SPECTRA will be created under the same folder containing the audio files.
If INCLUDE SUBFOLDERS is selected in the folder selection tab, then each sub-folder will have its new SPECTRA folder, one per folder.

In the TursioNet repository, all folders already contain their SPECTRA folder with spectrograms already generated.

Now it is time to download one SPECTRA folder, with spectrograms in it, and check their contents.

Our helper for human-based classification

Download and install our helper.
It will make things much easier.

It is called SPECTROGRAM VIEWER

DOWNLOAD FROM HERE

Once installed our software works this way:

  1. Tell the system who you are, so each line of the resulting tables will retain the identity of who carried out that task;
  2. Select a folder containing spectrograms. SELECT THE FOLDER AND NOT THE FILES!! Filenames must be consistent with the rules of the above Spectrogram Generator.
  3. Define and Use you specific list of tags while browsing your spectrograms and when searching for signals. Your list of tags is a sort of configuration that can be saved and shared.
  4. Go, check the spectrograms, quickly look at them and do the classification, get tables with the results.


Write or confirm your name

select THE FOLDER that contains spectra with consisting filenaming

Add the tags that you will be using, or load the ones of your workgroup

Tags will be standardized in your workgroup (?), you can add the quick key (one letter or number) that you can use on your keyboard. A button can also be used if you prefer a mouse-click of a touchscreen.

It’s time to browse the spectrograms!
Use the right/left arrows to go to the next one, click on the keys if you see signals that match your tags and interests, two clicks=2, three clicks=3 (this is a score you can give this particular spectrograms you are watching), SHIFT+CLICK=2 again. SHIFT+KEY rolls back your scoring.

When you have finished with one image just go to the next. You can ADD A NOTE, if you need to.

EXPORT PREVIEW takes you to the table you populating. so that you can check what’s going on.
You can PAUSE the classification using the EXPORT SESSION (and later reimport using IMPORT SESSION), so your progress can be divided into different sessions…

EXPORT FILE allows you to save the table, so that you will be able to do some statistics over it.