Synchronisation of sound and vision

[Tore Nilsen]

Yes, you have to manually set the callbacks. I would opt for lines rather than words. You get the callback points by getting the currentTime property from the player. If you start at the beginning you can set the first item of the first line of the callbacks to: 0. Then you can set a callback for each line in the poem by pausing the player after each line and get the currentTime of the player. This could be semi automated with a script that is triggered each time you pause the player, I guess.

Regards
Tore
 

> 12. feb. 2020 kl. 13:28 skrev Graham Samuel via use-livecode <use-livecode at lists.runrev.com>:
> 
> Thanks, that’s a start - I will look at the dictionary. I suppose the callbacks rely on one analysing how long each line/word takes the performer to say. It’s a lot of work, but there’s no way around it since potentially every line takes a different length of time to recite. If it’s too much work, I guess I can just display the whole text and have one callback at the end of each recording. Maybe that is really the practical solution for a large body of work (say all the Shakespeare sonnets, for example).
> 
> Anyway thanks for the hint.
> 
> Graham
> 
>> On 12 Feb 2020, at 12:16, Tore Nilsen via use-livecode <use-livecode at lists.runrev.com> wrote:
>> 
>> You will have to use the callbacks property of the player to do what you want to do. The callbacks list would be your cues. From the dictionary:
>> 
>> The callbacks of a player <> is a list of callbacks, one per line. Each callback consists of an interval number, a comma, and a message <> name. 
>> 
>> 
>> Regards 
>> Tore Nilsen
>> 
>> 
>>> 12. feb. 2020 kl. 11:25 skrev Graham Samuel via use-livecode <use-livecode at lists.runrev.com>:
>>> 
>>> Folks, forgive my ignorance, but it’s a long time since I considered the following and wondered what pitfalls there are.
>>> 
>>> I have in mind a project where a recording of someone reading a poetry text (“old fashioned” poetry in metrical lines) needs to be synchronised to the display text itself on the screen, ideally so that a cursor or highlight would move from word to word with the speaker, although that would almost certainly involve too much work for the developer (me), or at least highlight lines as they are being spoken. I see that one would inevitably have to add cues to the spoken text file to fire off the highlighting, which is indeed an unavoidable amount of work, but can it be done at all in LC? For example, what form would the cues take?
>>> 
>>> TIA
>>> 
>>> Graham
>>> _______________________________________________
> 
> 
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com <mailto:use-livecode at lists.runrev.com>
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode <http://lists.runrev.com/mailman/listinfo/use-livecode>