Computer Vision and Natural Language Processing / Task 1 Case Study

-

Task 1 Case Study 


Todo:


Processing:

Case 1: The Smart Hub


Core Function: Serve as the hub for interaction, communication, and control within the home.



Natural Language Processing: Users can control all connected smart devices, make video calls, look up information, or set reminders using voice commands.


Computer Vision: The built-in camera uses facial recognition to display personalised information (such as calendars and to-do lists) for different family members. During video calls, the camera automatically tracks people to keep them centred in the frame. It also recognises gestures, such as raising a hand to pause music.


Computer Vision and Natural Language Processing: Personalised proactive interaction. When you enter the living room, CV recognises your identity, and the screen proactively displays your schedule; you can use NLP to ask, “What are the details of my first meeting today?”

Spatial Design: It transforms the traditional living room layout into a hub for information and interaction. Designers must reserve the optimal placement for it on countertops or walls—ensuring family members can easily view the screen and be captured by the camera while seamlessly integrating with the overall decor style.


Case 2: Home Security Systems



NLP: When an unfamiliar person approaches the door, the Xiaomi smart lock automatically records video footage. Additionally, when someone comes within 30 cm of the lock, all security devices throughout the home enter alert mode.

Xiaomi's gas detector also operates in real time to monitor home safety.


Xiaomi's door/window sensors and motion sensors are designed to detect when someone climbs through doors or windows to break into a home.


CV: When all sensors are activated, the 360-degree camera inside the house will track unregistered faces of strangers and automatically record the process.


Space Design: Door lock installation height and viewing angle must cover visitors' faces; interior layout impacts surveillance functionality.


Case 3: Kitchen System



NLP: User voice command: “Xiao Ai, turn on the kitchen air conditioner, turn on the range hood, set the stove to medium heat for 15 minutes, and while you're at it, give the kitchen a quick sweep.”





CV: Smart refrigerator camera identifies ingredients inside (e.g., “There are still 2 eggs and 1 tomato.”)

Integration: CV-based inventory + NLP request → recipe recommendation + smart stove control

Spatial Design: The operational triangle (fridge-sink-hob) must be within sensor and voice pickup range.


Case 4: Xiaomi SU7 + Mi Home Integration



NLP: In-car command: “Xiaoai, I’m almost home—turn on the AC.”

CV: In-car DMS camera identifies driver identity/fatigue, or facial recognition unlocks home door



Integration: GPS proximity triggers “Coming Home” mode; voice enables remote control of home devices



Spatial Design: Seamless transition from vehicle to home, with consistent identity across spaces

Comments

Post a Comment

Popular posts from this blog

Games Development / Week 1 Homework

-
Image
  Week 1 Homework To do: Individually come out with a game idea (or many ideas, remember the limitations), and make your first game pitch. Some lucky (or unlucky) students will be selected to do a 10-minute presentation of their game idea(s) next week on September 30. No specific format for now (we’ll do Game Design Document in a later class), so try to find the most creative and effective way to convey your game ideas. This may not end up being your Final Project, but it will still contribute to your Continuous Assessment grade. Hence, document the process in your blog. Submit the link to your blog post by Sept 29 midnight.
Read more

Experiential Design / Assignment1 Trending Experience

-
Image
 Assignment1 Trending Experience Todo: Task 1 helps you explore current Augmented Reality (AR) trends and understand marker-based , markerless , and location-based experiences before choosing your final project idea. Research AR Trends Experiment Reflect Propose 3 Ideas Processing: Research AR Trends I have identified three commonly used AR applications on the market to serve as my inspiration. 1. Apple Ar :   These applications combine the limitless choices of online shopping with the “hands-on experience” of offline retail, ultimately aiming to eliminate consumer uncertainty during purchases. By overlaying virtual product models onto real-world environments at a 1:1 scale, users can intuitively assess size, style, and outfit compatibility, enabling more informed purchasing decisions. User input:  Previewing an orange iPhone 17 Pro Max on my computer keyboard App output: 2. Particle Cam: The core value of this type of application lies not in “previewing products” or “...
Read more

Embedded System1 Final Project Prototype Ideation

-
Image
 Final Pro ject PProject introduce Week 5 Requirement Analysis : Understand stakeholder needs, define functional and non-functional requirements, identify constraints, and conduct a feasibility study. Outcome: Requirements Specification Document. Feasibility Analysis : Evaluate project viability through technical, economic, operational, and legal/ethical checks. Outcome: Feasibility Report. Design & Implementation : Create detailed hardware and software designs, select components, and build the system. Outcome: Fully developed embedded system. Integration & Testing : Combine hardware and software, perform various tests (functional, performance, security, etc.) to ensure quality. Outcome: Bug-free, high-quality product. Product Release & Marketing : Launch the product, provide user documentation, and execute marketing strategies. Outcome: Successfully launched product. Operations, Maintenance & Upgrades : Monitor performance, fix bugs, main...
Read more