Bumping up this recent thread on the bookreader list about text-to-speech. Mike and Gregor, in case you haven't seen what's currently possible: I believe James S's Read Etexts uses speech-dispatcher to read selected text. Aleksey and others may have done further work with espeak... I've included some old threads from the Sugar list this past spring below. SJ On Thu, Oct 29, Mike McCabe <<a href="mailto:mccabe@archive.org">mccabe@archive.org</a>> wrote: I also think this is a great idea. I've worked with several text-to-speech readers recently, as part of my effort to make the Internet Archive books available to print disabled people. They're very useful, and I think that this mode of reading could be of use to a very broad range of users. I suspect we'll see more of it soon. I'm also curious to hear about specific experiences with linux-compatible free TTS, as we may be producing audio books with this to work with the new Library of Congress audio players. Best regards - Mike == [1] old note from James Simmons == ( in repsponse to this speech-synthesis summer of code proposal: <a href="http://wiki.sugarlabs.org/go/speech-synthesis" target="_blank">http://wiki.sugarlabs.org/go/speech-synthesis</a> ) Chirag, Since you have been working with Aleksey Lim you probably know about text to speech with highlighting in Read Etexts. I wrote the original TTS code that used speech-dispatcher with some assistance from Hemant Goyal and the folks on the speech-dispatcher project. Aleksey refactored my code so it could work with either speech-dispatcher or his own gstreamer espeak plugin. Not only does his plugin need no configuration to work, it also does a LOT better in producing timely callbacks as it reads each word. As you point out in your proposal, highlighting the word as it is spoken is a big part of the benefit of what you're proposing. If all you wanted to do was capture some highlighted text in the clipboard and have it spoken in a voice you can configure in a control panel, that would be easy, even trivial. It's the highlighting that's difficult. When I added speech to Read Etexts I deliberately tried for the simplest approach that would get the job done. It reads only the current page. It always starts either at the first word on the page, or if speech has been paused, it resumes with the last word spoken. You can't choose the word to start on. The Activity itself receives the callbacks as each word is spoken and takes care of doing the highlight and scrolling the textarea so the highlighted word stays on the screen. If I had to write a facility that did what Read Etexts does outside of the Activity I wouldn't know how to do it. It seems to me that highlighting is best done by the Activity itself. I can't deny that it would be useful to have all this work done as you have described without the Activity knowing anything about it, but it doesn't seem feasible. You'd have to have something that could work with gtk textareas, the evince component Read uses, Abiword, and everything else that came along. Another thing you'd have to deal with is PDFs composed of scanned in book pages. There are a lot of these around (the Internet Archive is full of them) and somehow the kid trying to select words on a scanned in page would have to be clued in that these words are not selectable. I suppose you could make an Activity that grabbed whatever text was in the clipboard, displayed it in a textarea, and highlighted the words in that textarea as it spoke them. I'm pretty sure that wasn't what you had in mind. Splitting sentences into separate words will be a challenge. I just use spaces as delimiters and filter out characters like asterisks, vertical bars, etc. That works OK for English but not for other languages. If I wanted Read Etexts to do highlighting on the Bhagavad-Gita in the original Sanskrit it wouldn't work. Even in English I get tripped up by double hyphens (--). It would be nice if Gutenberg etexts put spaces around double hyphens but they don't. It looks like you've picked a challenging project, and I would love to be proven wrong about everything I've mentioned here. Good luck with this, James Simmons == 2: SynPhony and reading assistance == <div class="gmail_quote">On Tue, Feb 17, 2009 at 12:48 PM, Carol Farlow Lerche <<a href="mailto:cafl@msbit.com" target="_blank">cafl@msbit.com</a>> wrote: <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">I'd like to call your attention again to <a href="http://synphony.wiki.sourceforge.net/" target="_blank">SynPhony</a>. We are close to a base release (probably this week) of a 44,000 word English word database that has a very rich array of information helpful to the teaching of English, especially reading. A 10,000 word Spanish lexicon and 50000 word German one will follow. Norbert Rennert who compiled these, would like very much to work with other language experts to extend this effort to other languages. Some highlights of the English lexicon: screened from the CMU Sphynx corpus for accessibility to children, each word entry has frequency data from analysis with respect to a large corpus of text merged in, phoneme breakdown (used by reading curricula to decide the order in which words should be introduced or deemed decodable), etymology, semantic domain (categorization), IPA coding, syllabification and stress marking. The second release will merge in many images, though we don't expect to have a complete image-to-word mapping without a volunteer effort. We plan to create an API and a way to define a curriculum sequence for word groups once the basic database is released, to allow integration of the word bank across all the activities that are literacy related, as well as create more. We also hope to use the word bank to score texts for reading level and assist in creation of simplified version of extant texts suitable for use by emergent readers. Please read our design documents at the above site. <div class="gmail_quote"><div><div>On Tue, Feb 17, 2009 at 2:02 AM, Tomeu Vizoso <<a href="mailto:tomeu@sugarlabs.org" target="_blank">tomeu@sugarlabs.org</a>> wrote: </div></div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div><div> Aleksey has started a very interesting new path: <a href="http://lists.sugarlabs.org/archive/sugar-devel/2009-February/011470.html" target="_blank">http://lists.sugarlabs.org/archive/sugar-devel/2009-February/011470.html</a> </div></div></blockquote></div></blockquote></div> <div class="gmail_quote"> <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div><div class="h5">Gregor Kervina wrote: > Hi Sayamindu, > thanks for quick reply! > There is a lot of text to speech software out there - I use > <a href="http://www.bytecool.com/coolspch.htm" target="_blank">http://www.bytecool.com/coolspch.htm</a> that you can try trial and download > additional voices, just to get a feeling, but it is not free and not for > linux. Many other programs are more complex and complicated and some of > them use very complex voice engines that in my opinion doesn't sound > very good. (I use Mary voice with cool speech) > > OK I spent some time to find all TTS software that is free for linux and > here are some links: > > <a href="http://linux-sound.org/speech.html" target="_blank">http://linux-sound.org/speech.html</a> > <a href="http://linuxhelp.blogspot.com/2006/01/festival-text-to-speech-synthesis.html" target="_blank">http://linuxhelp.blogspot.com/2006/01/festival-text-to-speech-synthesis.html</a> > <a href="http://larswiki.atrc.utoronto.ca/wiki/Software" target="_blank">http://larswiki.atrc.utoronto.ca/wiki/Software</a> - see the links under > Speech section > <a href="http://www.xenocafe.com/tutorials/php/festival_text_to_speech/index.php" target="_blank">http://www.xenocafe.com/tutorials/php/festival_text_to_speech/index.php</a> > <a href="http://www.wikihow.com/Convert-Text-to-Speech-on-Linux" target="_blank">http://www.wikihow.com/Convert-Text-to-Speech-on-Linux</a> > <a href="http://www.cstr.ed.ac.uk/projects/festival/" target="_blank">http://www.cstr.ed.ac.uk/projects/festival/</a> > <a href="http://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html" target="_blank">http://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html</a> - listen to > some demo voices > <a href="http://sourceforge.net/projects/dhvani/" target="_blank">http://sourceforge.net/projects/dhvani/</a> - this one not english > <a href="http://sourceforge.net/projects/tts-cubed/" target="_blank">http://sourceforge.net/projects/tts-cubed/</a> > <a href="http://www.speech.cs.cmu.edu/hephaestus.html" target="_blank">http://www.speech.cs.cmu.edu/hephaestus.html</a> - click the links in Speech > Synthesis section > <a href="http://www.speech.cs.cmu.edu/comp.speech/Section5/Synth/rsynth.html" target="_blank">http://www.speech.cs.cmu.edu/comp.speech/Section5/Synth/rsynth.html</a> > <a href="http://www.linux.com/archive/feature/122197" target="_blank">http://www.linux.com/archive/feature/122197</a> - two readers - plug-ins for > firefox. > > I can not test them because I'm not a linux user. Maybe you can modify > some of these software (probably Festival) for more user friendly > reading and maybe program a specific button on XO keyboard that will > automatically read the selected text no matter what program is used for > opening the text. > > Judging from google search result for DTBooks, this technology is not > spread at all. The other problem is that it uses somtimes recorded audio > and the size of that is too large for XO... I think the most important > is that TTS works with reader that will open 1.6M e-books from internet > archive </div></div>> <<a href="http://www.xconomy.com/boston/2009/10/24/internet-archive-opens-1-6-million-e-books-to-olpc-laptops/" target="_blank">http://www.xconomy.com/boston/2009/10/24/internet-archive-opens-1-6-million-e-books-to-olpc-laptops/</a>>(are <div class="im">> you in this team?). > > Also one important thing is to add cheap headphones with laptop so > children could listen to reading without desturbing others and in the > noisy environments ... another advantage of audio reading is much longer > battery life because you can turn off LCD monitor and audio alone does > not consume much energy. > > Let me know what you think. > All the best, > Gregor > > > > On Mon, Oct 26, 2009 at 4:08 PM, Sayamindu Dasgupta <<a href="mailto:sayamindu@gmail.com">sayamindu@gmail.com</a> </div><div class="im">> <mailto:<a href="mailto:sayamindu@gmail.com">sayamindu@gmail.com</a>>> wrote: > > Hi Gregor, > Thanks a lot for jumping in :-) > > On Mon, Oct 26, 2009 at 2:38 AM, Gregor Kervina </div><div><div></div><div class="h5">> <<a href="mailto:gregor.kervina@gmail.com">gregor.kervina@gmail.com</a> <mailto:<a href="mailto:gregor.kervina@gmail.com">gregor.kervina@gmail.com</a>>> wrote: > > Dear Sayamindu Dasgupta, SJ Klein and other members of this list, > > > > I'm a student of electrical engineering from Europe and would > like to share > > with you my very positive experience with text to speech > technology that can > > in my opinion significantly increase the educational potential of > XO if used > > in the right way. > > > > For the past 12 years (since I was 15 years old) I'm daily > learning from > > e-books and internet using text to speech software. I know this > software is > > unpopular in developed world, many people don't even know that it > exists. On > > the other hand many people (including me) don't like reading long > texts on > > the LCD screens - that's why e-books are also not very popular. > > > > But unlike my friends I read 50+ e-books every ear and also daily > news on > > the internet - I just select the text, copy it, and CoolSpeech > software > > (using Mary voice) reads me all the text with speeds 300 to 500 > words per > > minute. In this way I can browse other sites or look at photos or > just lay > > down and listen while my laptop is reading to me. > > Other people don't understand what I'm reading because it is too > fast for > > them but it can be learned quickly with slower speeds at beginning. > > > > I think XO laptops should definitely have such software > pre-installed and a > > video introduction how to use it and what reading speeds can they > expect > > after some time of practicing. > > It is also ideal for children with poor eye sight. > > > > This sounds awesome. Could you let us know if the text to speech > software you have in mind is free/opensource and if it works on Linux > ? > I am also looking at DTBooks specifications for digital talking books > - do you know how useful/widespread this technology is ? > > Thanks, > Sayamindu > > > -- > Sayamindu Dasgupta > [<a href="http://sayamindu.randomink.org/ramblings" target="_blank">http://sayamindu.randomink.org/ramblings</a>] > > > </div></div>> ------------------------------------------------------------------------ <div><div></div><div class="h5">> > _______________________________________________ > Bookreader mailing list > <a href="mailto:Bookreader@lists.laptop.org">Bookreader@lists.laptop.org</a> > <a href="http://lists.laptop.org/listinfo/bookreader" target="_blank">http://lists.laptop.org/listinfo/bookreader</a> _______________________________________________ Bookreader mailing list <a href="mailto:Bookreader@lists.laptop.org">Bookreader@lists.laptop.org</a> <a href="http://lists.laptop.org/listinfo/bookreader" target="_blank">http://lists.laptop.org/listinfo/bookreader</a> </div></div></blockquote></div>