This Classroom Utilizes AI And VR For Mandarin Teaching
Harin - Jul 30, 2019
To make the learning process more interactive, New York-based Rensselaer Polytechnic Institute sets up a classroom with AI and VR for Mandarin teaching.
- New ‘Deep Nostalgia’ AI Allow Users To Bring Old Photos To Life
- Pilots Passed Out Mid-Flight, AI Software Got The Aircraft Back Up Automatically
- YouTube AI Mistakes Black And White In Chess For Racism
The process of learning new languages is a time-consuming and hectic one. Learners are required to invest in a lot of time as well as effort. More often than not, the process can be a little bit boring since foreign words are hard to understand and memorize. So, in order to make the learning process more interactive, New York-based Rensselaer Polytechnic Institute has set up a classroom equipped with AI and VR for Mandarin teaching.
The AI and VR used is a result of a partnership with IBM Research. Inside the classroom, there is a 360-degree virtual environment which is based on Beijing street. Students get to learn the language by interacting with street vendors and ordering food.
The people who work on the project think that the easiest and best way to study a new language is to being exposed to the environment where the language is natively spoken. And because it is not feasible for language learners to move to another country just to study a new language, they will get a similar experience with this classroom.
With AI, student queries are answered in real-time. The institute’s two faculty members were the one behind the project’s idea. They once used role-playing games so that students can understand the conversation better.
The classroom uses several sensors to adjust to the students’ behaviors to offer a better learning experience.
The image above shows how a student is interacting with the system. A camera is used to track the body movements and a mic for voice input.
It’s simple to interact with the environment. When students need to know more about a specific object, they just need to point at it and ask “What is this?” After that, relevant and suitable answers will be provided by AI.
Besides giving students the chance to interact with the environment, the platform also improves their pronunciation. This can be done via audio along with visual feedback given to students so that they can pronounce the words correctly. The platform’s algorithms also make a comparison between the student’s speech with one of the native speakers. Also, students can know how their pronunciation differs from native speakers.
At this moment, the classroom is still in its testing phase. It will be implemented later this year in a six-week course at the institute. The virtual environment will be deployed for half the duration while the other half will be for traditional classes. However, this will depend on the efficiency and effectiveness of the virtual environment.
Featured Stories

Features - May 09, 2025
Huawei Officially Launches PC-Exclusive Operating System, Completely Replacing...

Features - Apr 09, 2025
EliteHubs Opens Computer Showroom in Pune with Extended Support Services

Review - Apr 05, 2025
Nintendo Switch 2 vs PlayStation 4, Which Is More Powerful?

Review - Apr 03, 2025
Top 5 Budget Cameras For Beginners (2025)

Features - Feb 26, 2025
Elon Musk Eyes Indian Market: Tesla’s Next Big Move?

Features - Aug 03, 2023
The Impact of Social Media on Online Sports Betting

Features - Jul 10, 2023
5 Most Richest Esports Players of All Time

Features - Jun 07, 2023
Is it safe to use a debit card for online gambling?

Features - May 20, 2023
Everything You Need to Know About the Wisconsin Car Bill of Sale

Features - Apr 27, 2023
How to Take Advantage of Guarantee Cashback in Online Bets
Read more

Mobile- May 09, 2025
After Windows Replacement OS, Huawei Set to Launch "Kirin X90" Chip for PCs to Replace Intel
This isn't Huawei's first venture into the personal computer market, but it marks the first time the company will own both the operating system and domestic processing chip for a desktop device.

Features- May 09, 2025
Huawei Officially Launches PC-Exclusive Operating System, Completely Replacing Windows
Huawei confirms its upcoming computer models will come pre-installed with HarmonyOS 5 for PC.
Comments
Sort by Newest | Popular