Computer Vision and Natural Language Processing / Task 2

-

CV&NLP Task 2


Todo:


Processing:

I initially constructed my home model within Blender, using an image of a Scandinavian-style house I found online as my reference.


Plan

Blender Model

After creating the model, I exported it and imported it into Unity, thus establishing the base.

The next step is to import the speech recognition plugin (Whisper) into Unity.



Then, after adding our floor, the voice-controlled robot will automatically navigate its walking route.




I have added navigation waypoints to facilitate the bot locating the position.






Next, I added several lights, each in a different room. I set three colours: white, green, and red, with white as the default.



Next up is my demonstration video.


   


Reflection:

During the course of this task assignment, I gained an understanding of how NLP operates. It proved less daunting than anticipated. The most challenging aspect of this project was undoubtedly troubleshooting the code bugs that arose, though the debugging process itself proved rather engaging. Throughout the entire endeavour, I recognised that my coding proficiency requires further study and deeper comprehension. Only then can I more effectively collaborate with engineers in the future to design a flawless product.








Comments

Post a Comment

Popular posts from this blog

Games Development / Week 1 Homework

-
Image
  Week 1 Homework To do: Individually come out with a game idea (or many ideas, remember the limitations), and make your first game pitch. Some lucky (or unlucky) students will be selected to do a 10-minute presentation of their game idea(s) next week on September 30. No specific format for now (we’ll do Game Design Document in a later class), so try to find the most creative and effective way to convey your game ideas. This may not end up being your Final Project, but it will still contribute to your Continuous Assessment grade. Hence, document the process in your blog. Submit the link to your blog post by Sept 29 midnight.
Read more

Embedded System1 Project 1 Functional Concepts

-
Image
Embedded System Project 1   Week 1  This week we've had a general introduction to the embedded system, and we've covered it in class. An Embedded System is a specialized computing system that is embedded into a larger device or system to perform specific tasks. Unlike general-purpose computers, embedded systems are highly optimized , have specific functions , and are not used for general computing . They typically consist of hardware (e.g., microcontrollers, sensors, memory) and software (e.g., firmware, real-time operating systems). Key Features of Embedded Systems： 1. Specific Functionality Typically performs only specific functions, such as control, monitoring, or data processing. 2. Limited Resources Limited in computing power, storage, and power consumption, requiring efficient optimization. 3. Real-time Performance Many embedded systems must respond within a specific time frame, such as in autonomous driving systems. 4. Low Power Consumption Many embedded devices (e.g...
Read more

Experiential Design / Assignment1 Trending Experience

-
Image
 Assignment1 Trending Experience Todo: Task 1 helps you explore current Augmented Reality (AR) trends and understand marker-based , markerless , and location-based experiences before choosing your final project idea. Research AR Trends Experiment Reflect Propose 3 Ideas Processing: Research AR Trends I have identified three commonly used AR applications on the market to serve as my inspiration. 1. Apple Ar :   These applications combine the limitless choices of online shopping with the “hands-on experience” of offline retail, ultimately aiming to eliminate consumer uncertainty during purchases. By overlaying virtual product models onto real-world environments at a 1:1 scale, users can intuitively assess size, style, and outfit compatibility, enabling more informed purchasing decisions. User input:  Previewing an orange iPhone 17 Pro Max on my computer keyboard App output: 2. Particle Cam: The core value of this type of application lies not in “previewing products” or “...
Read more