Skip to content

Tutorial 2: Getting started with LSL (multiple streams)

Jump to bottom Edit New page
mgbleichner edited this page Sep 11, 2018 · 15 revisions

In this tutorial, you learn to record two streams simultaneously, one data stream (here Audio), and one marker stream (key presses)

For this tutorial you need

The LSL App can be downloaded from the ftp as .zip files.

  • Start LabRecorder.exe
  • Start AudioCaptureWin.exe
  • Start Keyboard.exe

Now we conduct a little experiment in which we record button presses and microphone input

  • Start a new recording in the LabRecorder: Click 'Start'

  • Repeat the following steps for all letters on the middle row of the keyboard (from ‘a’ to ‘l’, on a QWERTY keyboard)

    1. Press down the key on the keyboard
    2. Pronounce the letter
    3. Release the key (make sure that you release the key once you are finished pronouncing this letter).

  • Stop the recording

  • In MATLAB change to the directory of MATLAB Importer

    • Load the .xdf file you just recorded: data=load_xdf(‘C:\yourfilepath\’)

The load_xdf function provides several advanced options for time synchronization, support for breaks in the data, as well as other defects (see help load_xdf), that is beyond this tutorial.

  • You should see that the resulting cell array contains two entries
   
1×2 cell array

    {1×1 struct}    {1×1 struct}

type data{1} to see the first stream. The info structure contains additional information that describes this stream in more detail (see below), the time series (i.e. the actual audio data, here a mono recording) and the corresponding time stamps (i.e. for each data sample you have the exact time when this sample was acquired.

    info: [1×1 struct]
    segments: [1×1 struct]
    time_series: [1×667233 single]
    time_stamps: [1×667233 double]

Here the first stream is the Audio (The order of streams could be different for your experiment). type data{1}.info to see more details. You see the name and type of the stream, the nominal_srate (i.e. the sampling rate the device is intending to send), the source_id etc.

  struct with fields:

               name: 'AudioCaptureWin'
               type: 'Audio'
      channel_count: '1'
      nominal_srate: '44100'
     channel_format: 'float32'
          source_id: 'DESKTOP-I9R6TCB{0.0.1.00000000}.{9349f85e-b1ac-40d9-a83f-3c3cf9edbd91}'
            version: '1.1000000000000001'
         created_at: '437615.75132321799'
                uid: 'fdb68f1e-c192-486c-a289-871506575d60'
         session_id: 'default'
           hostname: 'DESKTOP-I9R6TCB'
          v4address: [1×1 struct]
        v4data_port: '16573'
     v4service_port: '16579'
          v6address: [1×1 struct]
        v6data_port: '16573'
     v6service_port: '16579'
               desc: [1×1 struct]
      clock_offsets: [1×1 struct]
    first_timestamp: '438262.4887584534'
     last_timestamp: '438277.6188940192'
       sample_count: '667233'
    effective_srate: 4.4099e+04

type data{2} to see the second stream. The second stream is the Keyboard stream. In time_series you find which key was used and whether it was pressed or released. In time_stamps you find the corresponding time steps of when the key was pressed or released.

    info: [1×1 struct]
    time_series: {1×20 cell}
    time_stamps: [1×20 double]

type data{2}.info to see more details.

  struct with fields:

               name: 'Keyboard'
               type: 'Markers'
      channel_count: '1'
      nominal_srate: '0'
     channel_format: 'string'
          source_id: 'KeyboardCapture_DESKTOP-I9R6TCB'
            version: '1.1000000000000001'
         created_at: '437621.11354082898'
                uid: 'ea8b74eb-7101-4543-87f3-1337ecabea6b'
         session_id: 'default'
           hostname: 'DESKTOP-I9R6TCB'
          v4address: [1×1 struct]
        v4data_port: '16574'
     v4service_port: '16581'
          v6address: [1×1 struct]
        v6data_port: '16574'
     v6service_port: '16581'
               desc: [1×1 struct]
      clock_offsets: [1×1 struct]
    first_timestamp: '438265.853400029'
     last_timestamp: '438276.141606314'
       sample_count: '20'

Check the first 6 entries of your marker stream by typing data{2}.time_series(1:6) you should see something like:


  1×6 cell array

    {'A pressed'}    {'A released'}    {'S pressed'}    {'S released'}    {'D pressed'}    {'D released'}

To visualize the results you can type: Note, the order of streams might be reversed in your case.

figure;
plot(data{1}.time_stamps, data{1}.time_series)
hold all
plot(data{2}.time_stamps, zeros(size(data{2}.time_stamps)),'o', 'LineWidth',2)

For EEGlab users there is and xdf_import plugin.

  • Start EEG lab
  • You can load the data either from the gui or the command line
  • EEG=pop_loadxdf(filepath,’streamtype’, ‘Audio’)
  • Specify in this case that the stream has the type ‘Audio’
  • With the option ‘exclude_markerstreams’ you can select to exclude some marker streams if needed
  • You now can use the standard functionality of EEGLab such as data visualization or epoching
Add a custom footer
Add a custom sidebar
Clone this wiki locally