Android Audio Playback & Recording

[Peter Reid]

Hi BR

More specifically, I'm developing an app to help aphasia sufferers to practice their pronunciation of simple everyday words.  The idea is that they will see the word in a large text size together with a picture to reinforce the meaning of the word.  They will hear the word pronounced by the tablet and then attempt to say the word themselves.  They will be able to repeatedly try to say the word until they get it right.

I have the basic UI flow working and I've written the app such that it consists of a companion app for the Mac/PC that loads the media (list of words, list of pictures and list of related sound clips) into background cards and custom properties.  The idea is that I can have a small collection of files & folders that become absorbed into the app by running it in the development environment prior to generating an APK for uploading into the tablet.  This way the app is self-contained, with flexible media already prepared for use.  This is working as well as the UI.

I have the following left to do in order to complete this app and get a copy delivered (pre-installed on a Fire 7 tablet) to an elderly relative of a friend:

1. Find a way of getting the Fire/Android to play an arbitrary sound clip (typically less than 2-3 secs). I've gone for WAV format initially but I can easily make them something else (MP3, AAC, OGG, etc). ANY IDEAS for this?

2. Find a way of getting the Fire/Android to record the sufferer's speech (probably less than 5-10 secs). ANY IDEAS for this?

3. Figure out how to compare the two sound clips (sample against user), or convert the user speech input into text for comparison with the original Word. Again, any good ideas would be welcome, but I'm prepared to do a bit of general research about this.

Points 1. and 2. above are potential showstoppers as the lack of either one stops this project in its tracks! Point 3. above still needs doing, but there are various ways of tackling this.

Thanks for any help with this.

Peter
--
Peter Reid
Loughborough, UK

> On 12 Sep 2017, at 11:00am, use-livecode-request at lists.runrev.com wrote:
> 
> Message: 3
> Date: Tue, 12 Sep 2017 03:27:35 +0000
> From: Sannyasin Brahmanathaswami <brahma at hindu.org>
> To: How to use LiveCode <use-livecode at lists.runrev.com>
> Subject: Re: Android Audio Playback & Recording
> Message-ID: <EC9EA6AE-9A3C-40D5-8B2A-53F5EC255B14 at hindu.org>
> Content-Type: text/plain; charset="utf-8"
> 
> Aloha Peter
> 
> 
> I think we also want ot have the voice recognition option here so that we could record short notes, or issue commands 
> 
> Maybe that is OT for your use case, but  I have some users interest in this.  
> 
> BR
> 
> 
> 
> On 9/10/17, 11:06 AM, "use-livecode on behalf of Peter Reid via use-livecode" <use-livecode-bounces at lists.runrev.com on behalf of use-livecode at lists.runrev.com> wrote:
> 
>    Hi,
> 
>    I'm making an app for Android in the form of an Amazon Fire 7 tablet (2017 version).  I'm doing the development with LC 9-dp8 and a Mac running macOS 10.12.6.
> 
>    A key part of this app requires the user to say a word or two, which will be recorded by the tablet and saved for subsequent comparison with a speech fragment played earlier.  What I'm looking for is the way to include the output of a word or short phrase, as spoken text; followed by speech input from the user, and then compared with the original speech recorded previously.
> 
>    Andy suggestions please?
> 
>    Thanks.
> 
>    Peter
>    --
>    Peter Reid
>    Loughborough, UK
> 
>