Skip to main content

Augmented Songbook
Augmented Reality for the music education of children using Catalan popular songs.

Augmented Songbook is a project aimed at building an Augmented Reality Android app for increasing awareness of abstract musical concepts for young children using Catalan popular songs.

Description

Augmented Songbook is a project aimed at building an Augmented Reality Android app for increasing awareness of abstract musical concepts for young children using Catalan popular songs.

The demo app allows to recognize and augment the different musical sheets. It guides the child to play the melody with a virtual keyboard while highlighting the relevant note to play in the staff. The application also allows to play the melody with different instruments.

Highlights:

  1. we use a marker-less augmented reality technology;
  2. the detection, recognition and tracking of the musical sheet are done in real-time;
  3. the augmented image, the virtual keyboard and the note to play are synchronized.



Downloads

You can download the demo musical sheets to print them:

You can download a demo version of the Android app following this link:
The demo has been tested in a Google Nexus 7, and it might not be stable in other devices.

You can download the test dataset following this link.

Who are we?

Two research labs collaborated to build the Augmented Songbook:

Fundings

Project funded by the People Programme (Marie Curie Actions) of the Seventh Framework Programme of the European Union (FP7/2007-2013) under REA grant agreement no. 600388, and by the Agency of Competitiveness for Companies of the Government of Catalonia, ACCIÓ.