Presentation slids:

https://docs.google.com/presentation/d/1NpaZIwJPXmeNpKULN6qX_w8lsLlCbyCFJfsqeXeqErE/edit?usp=sharing

• Sketch link

https://editor.p5js.org/YuhongSun/sketches/Ilt2bA8SD

• One sentence description

The world of chaos and amplification when people are not focused.

• Project summary (250-500 words)

The aim of this project is to develop a real-time sensory experience simulation system that utilizes computer vision and audio processing technology. Through image recognition and sound modulation, it helps users understand and experience the sensory overload and information processing methods that individuals with autism may experience in their daily lives. At the same time, it also reminds people of the inability to concentrate in an era of information overload and many temptations. The system combines real-time camera capture, object recognition, glitter effects, and audio spectrum modulation to create an immersive sensory experience.

• Inspiration: How did you become interested in this idea? Quotes, photographs, products, projects, people, music, political events, social ills, etc.

A video simulator the world of autism: https://youtu.be/DgDR_gYk_a8

• Process: How did you make this? What did you struggle with? What were you able to implement easily and what was difficult?

I tried transformer.js but failed to make the object detection in video, so I changed back to ml5 cocossd.

The machine accuracy is not that well, sometimes will detected person for things it can’t recognize.

When I zoom in, I can only zoom in the position of object detection even the camera already moves, I can’t stick to that object.

• Audience/Context: Who is this for? How will people experience it? Is it interactive? Is it practical? Is it for fun? Is it emotional? Is it to provoke something?

This project shift to not only about a simulator of Autism, but also showing how people are easily get distracted by environment.

All. To let people notice this kind of group of people, and also remind people how we are impact by those distractions.

• User testing: What was the result of user testing? How did you apply any feedback?

High frequency sound does create a harsh feeling, but it is not very smooth - playing sound while recording sound It's best to have a contrast with the background after zooming in - the background becomes black and white