Posts

Computer Vision and Natural Language Processing / Task 3

Image
 CV&NLP Task 3 ToDo: For this group assignment, we plan to utilise facial recognition technology to identify the unique facial features of three members, thereby directing them to their respective rooms. Processing: My first step was to import the House models of the Group into Unity. Then I added NavMesh Surface to help the bot identify which paths it can take. Next, I added navigation points for three houses.   Next is the code section Here is the full code: https://www.notion.so/saibase/Task-3-Group-Assignment-2-30-274fd41960338089b801c3b4436f1aac?source=copy_link#2defd419603380b5b29ae8af7b772377 Presentation: Reflection: In Task 3, I learned how to use face recognition to detect faces and then control a bot in Unity to navigate to other people's rooms. I found this process quite interesting. For example, the default face count is 0; when we recognize a text_Pro value of 0, navigation should occur. However, for demonstration purposes, we skipped recording faces with a ...

Home Automation

Image
Home Automation Name: wangsai Student ID : 0367388 Course: Bachelor Of Interactive spatial Design (Hons)  Week 1 - Week 15 Reflection: Reflecting on the development journey of this smart switch, it has been quite a rollercoaster. From the outset, configuring the development environment proved challenging. Networking issues with the VMware virtual machine prevented Home Assistant from obtaining an IP address, highlighting the critical importance of establishing a solid foundational setup. During the hardware debugging phase, the OLED screen's “distorted display” and “vertical stripes” became the most significant stumbling blocks. Progressing from initial I2C communication failures (NACK), through identifying signal interference caused by excessively long DuPont wires, to finally confirming the screen driver chip was the SH1106 rather than the common SSD1306, this journey provided profound insights into the critical roles of hardware anti-interference measures (such as frequenc...

Advanced Modeling & Animation / Final Project

Image
 Final Project Todo: Processing: I first created a VR file in UE5, then followed the tutorial to set it up, and after completing the setup, I started making it. I plan to build the model in the previous file and then transfer it to the VR File, so I'll start making it first. I first rearranged the model's position, then added some pinlight, and optimized the animation, adding purple lighting to make it look more futuristic. Next, I added several high-tech streetlights to guide the user forward and placed chairs next to them. I migrated the project to Final and configured the Nav Mesh Bounds Volume. I'm currently working on making the seats in AR mode move along with the model. I've added a Sequence Player to the teacher's previous work. The other one remained the same, but I added VRpawn. The animation is finished, now it's time for the parking project. Presentation: Reflection: During the development of this final project, some models encountered errors when ...

Computer Vision and Natural Language Processing / Final Project

Image
 Final Project Todo: Processing: We first went to purchase plastic sheets and some essential materials, then set about assembling them. I shall commence by completing my section. My design comprises an entry system featuring three principal components: the HC-SR04 ultrasonic sensor, the SG90 servo motor, and a buzzer. My approach involves using an HC-SR04 ultrasonic sensor to control door access upon entry, or alternatively enabling voice recognition for door opening. Once inside, voice recognition can be employed to activate voice commands and subsequently deactivate them. Afterwards, I tidied up the wiring and affixed it to the plastic board, then fitted it to my model. Click here to view the code: https://www.notion.so/saibase/Final-Project-30-274fd4196033804cbdc0e80e70d0d63a?source=copy_link Individual presentation: This is the part I made myself. Group Presentation:

Computer Vision and Natural Language Processing / Task 2

Image
CV&NLP Task 2 Todo: Processing: I initially constructed my home model within Blender, using an image of a Scandinavian-style house I found online as my reference. Plan Blender Model After creating the model, I exported it and imported it into Unity, thus establishing the base. The next step is to import the speech recognition plugin (Whisper) into Unity. Then, after adding our floor, the voice-controlled robot will automatically navigate its walking route. I have added navigation waypoints to facilitate the bot locating the position. Next, I added several lights, each in a different room. I set three colours: white, green, and red, with white as the default. Next up is my demonstration video.     Reflection: During the course of this task assignment, I gained an understanding of how NLP operates. It proved less daunting than anticipated. The most challenging aspect of this project was undoubtedly troubleshooting the code bugs that arose, though the debugging process itsel...

Experiential Design / Final Project

Image
 Final Project Name: wangsai Student ID : 0367388 Course: Bachelor Of Interactive spatial Design (Hons)  Week 10 - Week 14 Todo: Processing: I shall refine my Campus AR Kit further based on my Task 3 project. I have decided to begin by creating an AR effect capable of recognising campus ID cards.  I intend to design a student card within Figma that can display our information. I intend to add a button to the AR camera to assist me in recognising this student card.  I created a new scene and incorporated Taylor's elements into it. Additionally, an optimisation has been implemented to add a back button. I have placed my student card here so that it can be viewed directly; after my modifications, it is now more intuitive. Next, we shall proceed to enhance the visual presentation of the previous timetable information. I have designed more detailed course information in Figma. As I am using Windows and cannot build for iOS, I shall provide my source files. They are organi...