This Classroom Utilizes AI And VR For Mandarin Teaching
Harin - Jul 30, 2019
To make the learning process more interactive, New York-based Rensselaer Polytechnic Institute sets up a classroom with AI and VR for Mandarin teaching.
- 6 Cutting-Edge Features of Galaxy AI & Lineup of Supported Samsung Smartphones
- 4 Ways AI Could Change The Mobile Gaming Industry
- New ‘Deep Nostalgia’ AI Allow Users To Bring Old Photos To Life
The process of learning new languages is a time-consuming and hectic one. Learners are required to invest in a lot of time as well as effort. More often than not, the process can be a little bit boring since foreign words are hard to understand and memorize. So, in order to make the learning process more interactive, New York-based Rensselaer Polytechnic Institute has set up a classroom equipped with AI and VR for Mandarin teaching.
The AI and VR used is a result of a partnership with IBM Research. Inside the classroom, there is a 360-degree virtual environment which is based on Beijing street. Students get to learn the language by interacting with street vendors and ordering food.
The people who work on the project think that the easiest and best way to study a new language is to being exposed to the environment where the language is natively spoken. And because it is not feasible for language learners to move to another country just to study a new language, they will get a similar experience with this classroom.
With AI, student queries are answered in real-time. The institute’s two faculty members were the one behind the project’s idea. They once used role-playing games so that students can understand the conversation better.
The classroom uses several sensors to adjust to the students’ behaviors to offer a better learning experience.
The image above shows how a student is interacting with the system. A camera is used to track the body movements and a mic for voice input.
It’s simple to interact with the environment. When students need to know more about a specific object, they just need to point at it and ask “What is this?” After that, relevant and suitable answers will be provided by AI.
Besides giving students the chance to interact with the environment, the platform also improves their pronunciation. This can be done via audio along with visual feedback given to students so that they can pronounce the words correctly. The platform’s algorithms also make a comparison between the student’s speech with one of the native speakers. Also, students can know how their pronunciation differs from native speakers.
At this moment, the classroom is still in its testing phase. It will be implemented later this year in a six-week course at the institute. The virtual environment will be deployed for half the duration while the other half will be for traditional classes. However, this will depend on the efficiency and effectiveness of the virtual environment.
Featured Stories
![6 Cutting-Edge Features of Galaxy AI & Lineup of Supported Samsung Smartphones](https://img.mobygeek.com/crop/320x180/photo_galleries/2024/12/18/visual-search-with-google-lens-like-87c5.png)
Features - Dec 18, 2024
6 Cutting-Edge Features of Galaxy AI & Lineup of Supported Samsung Smartphones
![5 Apps Every Creative Artist Should Know About](https://img.mobygeek.com/crop/227x128/photo_galleries/2024/01/23/procreate-pocket-3304.png)
Features - Jan 23, 2024
5 Apps Every Creative Artist Should Know About
![Bet365 India Review - Choosing the Right Platform for Online Betting](https://img.mobygeek.com/crop/227x128/photo_galleries/2024/01/22/bet365-india-review-3bf1.png)
Features - Jan 22, 2024
Bet365 India Review - Choosing the Right Platform for Online Betting
![Online Casinos as a Business Opportunity in India](https://img.mobygeek.com/crop/227x128/2023/08/15/email-4caf.png)
Features - Aug 15, 2023
Online Casinos as a Business Opportunity in India
![The Impact of Social Media on Online Sports Betting](https://img.mobygeek.com/crop/227x128/2023/08/03/social-network-4094.jpg)
Features - Aug 03, 2023
The Impact of Social Media on Online Sports Betting
![5 Most Richest Esports Players of All Time](https://img.mobygeek.com/crop/227x128/2023/07/10/esports-players-5c2a.jpg)
Features - Jul 10, 2023
5 Most Richest Esports Players of All Time
![Is it safe to use a debit card for online gambling?](https://img.mobygeek.com/crop/227x128/2021/10/27/online-gambling-ede7.jpg)
Features - Jun 07, 2023
Is it safe to use a debit card for online gambling?
![Everything You Need to Know About the Wisconsin Car Bill of Sale](https://img.mobygeek.com/crop/227x128/2023/05/20/untitled-d49d.png)
Features - May 20, 2023
Everything You Need to Know About the Wisconsin Car Bill of Sale
![How to Take Advantage of Guarantee Cashback in Online Bets](https://img.mobygeek.com/crop/227x128/2022/04/25/betting-image-9bc9.jpg)
Features - Apr 27, 2023
How to Take Advantage of Guarantee Cashback in Online Bets
![White Label Solutions for Forex](https://img.mobygeek.com/crop/227x128/2021/03/17/1610531384-bitcoin-crypto-wallet-lost-password-300d.jpg)
Features - Mar 08, 2023
Comments
Sort by Newest | Popular