[Sugar-devel] [Sugar Labs] New proposal by PositiveDeviancy: Hack a Stuffed Animal

[Steve Thomas]

Wow, I'm impressed.

Couple of comments:
1) Durability is a really good point as is safety. I met some folks at
MakerFaire in NYC and one recommended using conductive cloth as cheap and
safe switch (also may be easy to make repairs, which would be another
consideration).  Not sure about the durability/reliability but may be
something to explore.  One idea they had to make a switch was to place some
foam between two pieces of conductive cloth to keep them separate until
they are squeezed at which point they make contact and complete the
circuit.  I will see if I can find their contact information as they seemed
interested in helping and may have a bunch of kids who can help test your
designs/plans.

2) Interfacing with Etoys (and Turtle Art, Scratch et al) basically
involves emulating a keyboard.  So as long as you can emulate a USB
keyboard/keystrokes you should be okay

3) Raspberry Pi is one good option and it also opens up other possibilities
as you have linux on the Animal.

4) Another option you may want to consider is using an Arduino (I think the
Leonardo supports keyboard emulation, but that was when I checked a while
back).

Cheers,
Stephen


On Mon, Apr 7, 2014 at 2:53 PM, Jade Deviancy
<positive.deviancy at gmail.com>wrote:

> Ok- Here is the progress that I have made so far:
>
> I have been doing a lot of research on what the range of motor skill
> levels are for kids in the autistic spectrum and I ended up being able to
> go to the NIH and speak with an outreach counselor (Ms. Sona Nahvi) on what
> some obstacles are with their motor and non verbal skills. She was very
> informative about different types of things that are common and she  said
> that they have a reflex called Palmer's reflex where they tend to ball
> their hands into fists very tightly and squeeze. Also she really emphasized
> that texture and feel was a very big part for some of the clients that she
> works with and she really thought that a stuffed animal was a great idea.
> She was a little worried about the durability aspect also.
>
>  I went along with her to some of the clients (4 total) that she thought
> that it would be good for me to interact with and see what would be
> appropriate for their needs. 3 were male and one was female, they were all
> pretty much in the middle of the spectrum for Autism (more on the social).
> They were all under 18 too. The good part was that they all really liked
> playing with iPads and they were able to use a mouse. I brought over a few
> different types of input device examples (Joystick, Driving wheel,
> Playstation controller, Large buttons, Mouse, Keyboard, and  a set of
> switches) I introduced them to each person one at a time and I timed which
> types they were able to correctly use for input and also kept them engaged
> the longest. These were all not attached to anything I just let them play
> with it for as long as they wanted. Joystick and switches were the worst
> for attention and usage and the best was the keyboard and the playstation
> controller. The kids really liked gripping the controller and the keyboard
> they liked running their hands all up and down it. One boy was not that
> interested in the keyboard so I decided I would try integrating the
> controller for the stuffed animal.
>
>  I have ordered about 3 really inexpensive generic controllers ( that I am
> going to download an emulator for and test them with raspberry PI) I need
> to verify that the emulator is open source and compatible with EToys and
> this way a computer would not even be needed because the Raspberry PI would
> fill that gap and all you would need is an SD card that could load the
> software in the Raspberry PI.  Best part is that the Raspberry Pi only
> costs around $25 new. The controller is around $7 each and the SD cards I
> would have to find how much GB is needed for the software and instead of
> running it though a computer you can use a video cord (AV in or HDMI) and
> connect it with a TV. So fingers crossed!!! I have also taken apart a
> keyboard and I and trying to figure out a way to get rid of the keys and
> integrate the little push buttons in a stuffed animal. I don't want there
> to be any chance of there being a way to shock or burn someone from it so I
> am thinking of getting a flexible keyboard ($8) and cutting it into strips
> and sealing them back with silicone and possibly sewing them into the
> stuffed animal. Let me know what your thoughts are and if you have any
> suggestions. Also- Do you want me to start documenting the frankensteining
> on video? That way we could have a YouTube channel dedicated on hacking the
> stuffed animal?
>
>
> Jade Garrett
>
>
> On Sun, Mar 23, 2014 at 11:52 PM, Steve Thomas <sthomas1 at gosargon.com>wrote:
>
>> Jade,
>>
>> Here are my thoughts:
>>
>>    1. First lets separate the parts of the project into:
>>       1. input device - which sends "keystrokes" over a USB cable
>>       2. A program to facilitate a non-verbal child's communication with
>>       others
>>
>> A successful project would be one where one or more of the following
>> occurs:
>>
>>    1. The building of the input device could be replicated by
>>       1. Young children 12-16 building a number of these devices for:
>>          1. shipment to OLPC sites around the world
>>          2. use in their local communities
>>          3. Fun cause its cool to have your stuffed animal used as a
>>          game controller
>>       2. Teachers/Volunteers/Parents at OLPC sites around the world
>>       3. In a class or after school setting to teach making
>>    2. The software program could easily be extended  the same groups
>>    mentioned in items 1 and 2
>>       1. By extended I mean they can add "visual vocabulary" and can
>>       re-arrange the Pictures/Sounds to facilitate their communication needs.
>>
>>
>> I like your idea of frankenstiening parts as one possible solution.  That
>> said another good objective would be to have more than one solution and to
>> have kids know how to do things more than one way.
>>
>> Cheers,
>> Stephen
>>
>>
>> On Sun, Mar 23, 2014 at 9:33 PM, Jade Deviancy <
>> positive.deviancy at gmail.com> wrote:
>>
>>> Thank you so much for the prompt response! I ultimately would like to
>>> get it down to $15-20 max, but I am hesitant because I don't like to raise
>>> hopes in case it is not possible for me to deliver. Another option would be
>>> to try to frankenstein parts from an old computer or another machine that
>>> would provide alternatives for buying the parts, which would help in
>>> getting the cost down. Definitely I would try out many different input
>>> devices, even taking a keyboard and modding it so that it looks like it
>>> only has 5-8 large keys (putting large stickers or even painting over the
>>> keys)  might work. One thing that caught my eye was a flexible keyboard. I
>>> am looking into that and trying to brainstorm some ideas.
>>>
>>> One thing that is really important to me is to have clear objectives. If
>>> we could brainstorm on what those would be, it would help give me direction
>>> to come up with many options within limitations.
>>>
>>> Here is what I have gathered to be the main objectives -
>>> 1. Turn a stuffed animal into an input device so that it can interact
>>> with an Etoys program.
>>> 1a. Narrow down what types of input devices would be the best for the
>>> child and price point.
>>> 1b. With the input device agreed on, choose what type of program that
>>> would be the best way to interact using that.
>>>         I just emailed 2 local special ed teachers that I have worked
>>> with in the past and I asked them what they think would be good options for
>>> input and also what would really engage children with non-verbal
>>> challenges. I could also make a google survey and email it to as many
>>> teachers/special ed teachers to try to get a consensus.
>>>
>>> 2. It will have to be able to be created with the parts list being as
>>> low cost as possible.
>>> 2a. See if there are any common alternatives to parts that people could
>>> use
>>> 2b. Check to see if there are any Generic part alternatives or bulk
>>> options
>>>
>>>
>>> Could you give me what you would define as the best case scenario?
>>> What you would consider the basic requirements for a successful
>>> prototype would be?
>>> This way, we have something to shoot for and then measure if it was
>>> successful or not.
>>>
>>> Thanks! I really look forward to working on this with you guys! Let me
>>> know if there is anything else that you need from me and also, when do you
>>> know when the project will be approved through Google?
>>>
>>> Jade Garrett
>>>
>>>
>>>
>>>
>>> On Mar 21, 2014, at 11:06 PM, Steve Thomas <stevesargon at gmail.com>
>>> wrote:
>>>
>>> Jade,
>>>
>>> Thanks for your submission to Google Summer of Code for "Hack a Stuffed
>>> Animal".  I like your idea of providing some type of feedback to the user
>>> (ex:led) and have no problem with you developing using arduino as part of
>>> the solution.
>>>
>>> In regards to cost I would challenge you to bring the price as low as
>>> possible and perhaps even having a number of different solutions as there
>>> are different needs.
>>>
>>> Cheers,
>>> Stephen Thomas
>>>
>>>
>>> On Wed, Mar 19, 2014 at 11:22 AM, Walter Bender <walter.bender at gmail.com
>>> > wrote:
>>>
>>>> ---------- Forwarded message ----------
>>>> From:  <no-reply at google-melange.appspotmail.com>
>>>> Date: Wed, Mar 19, 2014 at 9:45 AM
>>>> Subject: [Sugar Labs] New proposal by PositiveDeviancy: Hack a Stuffed
>>>> Animal
>>>> To: walter at sugarlabs.org
>>>>
>>>>
>>>> Hi,
>>>>
>>>> PositiveDeviancy has submitted a new proposal to Sugar Labs named Hack
>>>> a Stuffed Animal at
>>>>
>>>> http://www.google-melange.com/gsoc/proposal/review/org/google/gsoc2014/positivedeviancy/5629499534213120
>>>> :
>>>>
>>>> About you
>>>>
>>>>
>>>>
>>>> What is your name?  Jade Garrett
>>>>
>>>>
>>>>
>>>> What is your email address?  PositiveDeviancy at gmail.com
>>>>
>>>>
>>>>
>>>> What is your Sugar Labs wiki username?  OpenIDUser9
>>>>
>>>>
>>>>
>>>> What is your IRC nickname on irc.freenode.net?  positivedeviancy
>>>>
>>>>
>>>>
>>>> What is your first language?  English
>>>>
>>>>
>>>>
>>>> Where are you located, and what hours (UTC) do you tend to work?
>>>> Fairfax Virginia EST. I work at all hours, however, I am usually
>>>> working from 11AM-4PM and 9PM-1AM.
>>>>
>>>>
>>>>
>>>> Have you participated in an open-source project before?  I have
>>>> participated in BJC (beauty and joy of computing) and Stars Mentors
>>>> Program, mainly in the capacity of tutoring and teaching programming.
>>>>
>>>> http://ait.gmu.edu/stars/contact.html (Stars Mentor for GMU)
>>>>
>>>> http://stem.volgenau.gmu.edu/current.html (I teach the BJC programming
>>>> class and the Web Design class) BJC uses SNAP! a Scratch Derivative
>>>> and is open source.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> About your project
>>>>
>>>>
>>>>
>>>> What is the name of your project?  Hack a Stuffed Animal
>>>>
>>>>
>>>>
>>>> Describe your project in 10-20 sentences.
>>>>
>>>>
>>>>
>>>> What are you making?  A Robotic Stuffed Animal that will execute
>>>> commands, act as an input device for an Etoys program, and also
>>>> interact with children while being used.
>>>>
>>>>
>>>>
>>>> Who are you making it for, and why do they need it?  Children, but
>>>> more specifically, children who have challenges with non-verbal
>>>> communication and would benefit from interacting with a stuffed animal
>>>> robot. Some children will use it to keep them entertained and engaged
>>>> while using the program, it could even be a character in the program
>>>> for example. Some children might use it for its ease of usability or
>>>> it could help foster a familiar comforting feeling while using the
>>>> software and technology. Mainly, it will be used to help bridge the
>>>> gap with children who have challenges with non verbal communication
>>>> such as children with autism, by helping aid interaction using other
>>>> forms of communication besides verbal such as - Gestures, Movements,
>>>> Sign Language, Mimicry, and Signals. By making a familiar object such
>>>> as a loved stuffed animal turned into an input device, it changes the
>>>> whole dynamics of using technology and interaction, it allows for the
>>>> child to project their own method of communication through the stuffed
>>>> animal where a keyboard would be confusing and frustrating.
>>>>
>>>>
>>>>
>>>> What technologies (programming languages, etc.) will you be using?  It
>>>> is requested that I use Sugar Lab's Etoys program, however, I will
>>>> have to use Arduino 1.0.5 for coding the commands for the stuffed
>>>> animal so that it will act as an input device using either a keyboard
>>>> with modified keys or a joystick. Then I will use Etoys to create a
>>>> simple interactive program (non verbal) that the child could have
>>>> certain pre-programmed interactions and outcomes using the stuffed
>>>> animal. I would like to try to integrate some type of responsive
>>>> feedback, for example, a small LED light blinking, or a sound that is
>>>> produced from the stuffed animal to show that the communication and
>>>> interaction is two sided. (That might be a good idea for another
>>>> project for GSOC)
>>>>
>>>>
>>>>
>>>> What is the timeline for development of your project? The Summer of
>>>> Code work period is from May 19 - August 22; tell us what you will be
>>>> working on each week. (As the summer goes on, you and your mentor will
>>>> adjust your schedule, but it's good to have a plan at the beginning so
>>>> you have an idea of where you're headed.) Note that you should
>>>> probably plan to have something "working and 90% done" by the midterm
>>>> evaluation (27 June); the last steps always take longer than you
>>>> think, and we will consider cancelling projects which are not mostly
>>>> working by then.  I will start the day that I find that I am approved,
>>>> even if it is before May 19th.
>>>>
>>>> Now-May 19th: Design and focus on creating a functioning input device.
>>>> Clarify requirements and main goals for the stuffed animal hack. Focus
>>>> on what method is best for input (Joystick, keyboard, strategically
>>>> placed buttons, motion sensors, etc). Set firm and clear goals for
>>>> this project. Designing a program that would take the input and have
>>>> it interact in a way that is stimulating and engaging. Possibly a
>>>> music program that will play certain animal sounds while showing a
>>>> picture of the animal. Or perhaps a flashcard/slideshow program with
>>>> certain words that can be recorded by a family member and pictures of
>>>> things that the child shows interest in. Interview teachers who work
>>>> with kids with special needs to further improve design and function.
>>>> Conduct research on pricing the materials and creating a parts list.
>>>> Starting with a goal of under $50.00 and then trying to beat that
>>>> price by 20% in the week of July 14th. Gather all the parts and tools
>>>> necessary to begin creating prototypes.
>>>>
>>>> Week of May 19th - Begin assembling the parts and testing if the input
>>>> received is working properly.
>>>>
>>>> Week of May 26th - Testing how the inputs work with the program.
>>>>
>>>> Week of June 2nd - Fixing input bugs and design flaws.
>>>>
>>>> Week of June 9th - Further testing interaction between stuffed animal
>>>> and program.
>>>>
>>>> Week of June 16th - Finalizing the design and look for the stuffed
>>>> animal. I want to have 3 prototypes created.
>>>>
>>>> Week of June 23rd - Creating a usability metric for the stuffed animal
>>>> and start testing with target users - children and children who have
>>>> challenges with non-verbal communication.
>>>>
>>>> MID POINT EVALUATIONS - Gather up all the notes and enter the
>>>> evaluation.
>>>>
>>>> Week of June 30th- Analyzing the feed back and making adjustments and
>>>> correcting any issues.
>>>>
>>>> Week of July 7th - Work on creating another program to also be used
>>>> with the stuffed animal after feedback sessions and requests for
>>>> certain modifications.
>>>>
>>>> Week of July 14th  - Finalize the parts list for all the necessary
>>>> pieces. Price out the parts list for one stuffed animal and also for
>>>> bulk production (20 at a time). Look into different retailers, check
>>>> for generic parts vs brand name, look into 3D printing to see if that
>>>> is an option.
>>>>
>>>> Week of July 21st - Make a PDF on how to create the stuffed animal and
>>>> how to assemble it. Also create a video that shows construction step
>>>> by step, and also how to debug, test, and connect the stuffed animal.
>>>>
>>>> Week of July 28th - Continue work on the previous week. Send updates
>>>> and request feedback.
>>>>
>>>> 2-3 weeks of gathering data, refining the stuffed animal and its
>>>> programs. Also one week to factor in delays etc.
>>>>
>>>> Work on the final evaluations until the Final Date for Project.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Convince us, in 5-15 sentences, that you will be able to successfully
>>>> complete your project in the timeline you have described. This is
>>>> usually where people describe their past experiences, credentials,
>>>> prior projects, schoolwork, and that sort of thing, but be creative.
>>>> Link to prior work or other resources as relevant.
>>>>
>>>>  My major is Applied Information Technology with a Certificate in
>>>> Entrepreneurship. I have previous experience with building robots
>>>> using Lego Mindstorm, VEX, and Arduino. I also have experience writing
>>>> programs using Scratch and Snap! (Berkeley University's version of
>>>> Scratch) and I even teach a programming class on the weekends to high
>>>> school kids using Snap!  I feel that I am perfect for this project
>>>> because I have years of experience with all necessary aspects of
>>>> creating a robotic stuffed animal that accepts and returns input. I
>>>> have previously conducted usability tests with feedback, written
>>>> software programs using Scratch, created working moving robots, rapid
>>>> prototyping of applications, and I have a strong background with
>>>> electronics engineering. I already have most of the electronic parts
>>>> and tools that are necessary for creating a stuffed animal robot that
>>>> can send and receive input, light up, and execute simple commands.  I
>>>> have my own lab space at GMU Campus where I am able to work
>>>> undisturbed and focus. I am willing to document the process of
>>>> creating/testing the hacked stuffed animal by video blog, regular
>>>> blog, and also possibly conducting a class where high school kids use
>>>> Etoys and design their own programs for the stuffed animal. Most
>>>> importantly, I am very passionate about this project, I have worked
>>>> with many children with Autism (I used to teach adapted aquatics) and
>>>> I have a strong connection to this cause. I am beyond excited to work
>>>> together and create something that helps children learn.
>>>>
>>>>
>>>>
>>>> You and the community
>>>>
>>>> If your project is successfully completed, what will its impact be on
>>>> the Sugar Labs community?
>>>>
>>>> Jade's Response: I think that it will not only help children with
>>>> challenges in non-verbal communication, it will help especially young
>>>> children, children who are just beginning to use computers, and
>>>> children with attention issues stay engaged in learning new
>>>> technology. It will also provide a valuable resource to families who
>>>> are not able to afford buying pre-made robots that have the
>>>> functionality that we have added with the focus of non-verbal
>>>> interaction. Also, instead of just being impacted by it, the Sugar
>>>> Labs community could use it to help the world by creating programs
>>>> using Etoys that would lead to more awareness and possibly even more
>>>> treatment and therapy for kids with challenges with non-verbal
>>>> communication. Innovation is contagious and other members would have
>>>> the resources to create and modify their own versions of the stuffed
>>>> animal and programs, which in turn lead to totally new uses,
>>>> inventions, and ideas. It is a snowball effect of awesomeness.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> What will you do if you get stuck on your project and your mentor
>>>> isn't around?  I already have a clear idea of what needs to be done
>>>> and I plan on starting research and designing this as soon as I am
>>>> chosen to work on this project. I would try contacting the mentor
>>>> using different methods, but I never really depended on any single
>>>> person enough to stop me from working or figuring things out on my
>>>> own, I have so many resources online, from the college library, other
>>>> professors and peers that have experience in some aspect of this
>>>> project. If I really did get stuck, I would work on another aspect of
>>>> the project while I was waiting for the communication or backtrack
>>>> some steps and try to find out where I was stuck. If I have to wait, I
>>>> will be busy working out where the issue is while I am.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> How do you propose you will be keeping the community informed of your
>>>> progress and any problems or questions you might have over the course
>>>> of the project?
>>>>
>>>>  I would like to keep a video blog of my progress as I work on this
>>>> project which would be accessible on YouTube. I would also be
>>>> constantly working on documenting what has been done, what is being
>>>> worked on and how I am doing it, and then also the tasks that I need
>>>> to still finish. I would send weekly status update emails every Sunday
>>>> to my mentor and who ever else was involved in this project. I would
>>>> send pictures, video, and sketches whenever I reached a new task to
>>>> work on in the project so that everything is fully documented on my
>>>> approach, results, and any issues that arose and how I fixed them. I
>>>> also can chat, blog, use WebEx, talk on the phone, email, hand write a
>>>> letter and mail it, possibly even send you an update using Morse code
>>>> if I had enough time. I am so excited about the project that you could
>>>> possibly ask me to not contact and share so much information with you
>>>> guys.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Miscellaneous
>>>>
>>>>
>>>>
>>>> Describe a great learning experience you had as a child
>>>>
>>>>  I remember my first AHA! moment when I was creating my first website.
>>>> For the longest time I could not find out why my website was not
>>>> loading the way that I wanted to. I had looked over the HTML at least
>>>> a hundred times and I still couldn't find the error. Just when I was
>>>> about to throw my computer out my window and give up, I checked how I
>>>> saved the file and instead of saving it as index.html, I saved it as
>>>> index.htl. I can't even begin to explain the intense happiness that I
>>>> felt then. I was literally on the brink of crying like a baby with all
>>>> the mixed emotions of frustration, weariness, and pure joy. That
>>>> feeling of being smarter than my computer made me fall in love with
>>>> programming right then and there.
>>>>
>>>>
>>>>
>>>> Is there anything else we should have asked you or anything else that
>>>> we should know that might make us like you or your project more?
>>>> This is a project that is very different from most of the other
>>>> suggestions I viewed on your site. I think that this will be somewhat
>>>> uncharted territory for everyone on what would be the best approach,
>>>> design, features, and goals. I want everyone to know that I am always
>>>> open to trying new ideas and respond well to constructive criticism. I
>>>> prefer being upfront and open about expectations and I hope that my
>>>> mentor is just as candid about them as I will be. I am definitely
>>>> psyched and ready to start this awesome project where I can give back
>>>> to the community.
>>>>
>>>>
>>>>
>>>> Please include the category tag at the bottom of your page:
>>>>
>>>>
>>>>
>>>> [[Category:2014 GSoC applications]]
>>>>
>>>> Greetings,
>>>> Google Open Source Programs
>>>>
>>>> ---
>>>>
>>>> You are receiving this message because you are participating in Google
>>>> Summer of Code 2014.
>>>> To stop receiving these messages, go to:
>>>> http://www.google-melange.com/gsoc/profile/notifications/google/gsoc2014
>>>> .
>>>>
>>>>
>>>> --
>>>> Walter Bender
>>>> Sugar Labs
>>>> http://www.sugarlabs.org
>>>>
>>>
>>>
>>>
>>> --
>>> To some of us, writing computer programs is a fascinating game. A
>>> program is a building of thought. It is costless to build, weightless,
>>> growing easily under our typing hands. If we get carried away, its size and
>>> complexity will grow out of control, confusing even the one who created it.
>>> This is the main problem of programming. It is why so much of today's
>>> software tends to crash, fail, screw up.
>>>
>>> When a program works, it is beautiful. The art of programming is the
>>> skill of controlling complexity. The great program is subdued, made simple
>>> in its complexity.
>>>
>>> - Martin Harverbeke (from Eloquent JavaScript<http://eloquentjavascript.net/index.html>
>>> )
>>>
>>>
>>
>>
>> --
>>
>> To some of us, writing computer programs is a fascinating game. A program
>> is a building of thought. It is costless to build, weightless, growing
>> easily under our typing hands. If we get carried away, its size and
>> complexity will grow out of control, confusing even the one who created it.
>> This is the main problem of programming. It is why so much of today's
>> software tends to crash, fail, screw up.
>>
>> When a program works, it is beautiful. The art of programming is the
>> skill of controlling complexity. The great program is subdued, made simple
>> in its complexity.
>>
>> - Martin Harverbeke (from Eloquent JavaScript<http://eloquentjavascript.net/index.html>
>> )
>>
>
>


-- 

To some of us, writing computer programs is a fascinating game. A program
is a building of thought. It is costless to build, weightless, growing
easily under our typing hands. If we get carried away, its size and
complexity will grow out of control, confusing even the one who created it.
This is the main problem of programming. It is why so much of today's
software tends to crash, fail, screw up.

When a program works, it is beautiful. The art of programming is the skill
of controlling complexity. The great program is subdued, made simple in its
complexity.

- Martin Harverbeke (from Eloquent
JavaScript<http://eloquentjavascript.net/index.html>
)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sugarlabs.org/archive/sugar-devel/attachments/20140407/e22c6779/attachment-0001.html>