Mixed Reality - Science topic

In space, medical officers don’t have access to a lot of specialist facilities and equipment. Virtual reality can create ‘digital twins’ of essential infrastructure, for example a radiology reading room, explains physician and space-medicine entrepreneur Shawna Pandya. This technology could also help to deliver better health care in remote settings on Earth. To make a real difference in human exploration, “we definitely need more data”, Pandya says. “Only around 600 people have ever been to space. About 12% of those people were female, with just 1% of them Black women.”

Hi Andreas K. It is very interesting area of research!

I feel that rather than glasses; NLP or cognitive service used for language training would matter more than whether it is AR glass or VR Glass; can you share more insight about service used for language training?

Hi Jaspal! Special needs education is indeed an area that needs more attention and development at a global level. In some sense, every one is ‘special’ and the (probably utopian) ideal is one where each learner gets a personalized learning experience based on their individual learning styles and preferences.

About myself – in the past 20-odd years in my organization, I have been associated with various projects on special needs education, remediation and advocacy. I have also worked as an instructional designer on developing training courses using AR/VR/MR for various corporates.

The field of special needs education, including autism, dyslexia, dysgraphia, dyscalculia, ADHD etc. is very vast. Hence there is no panacea – creating one course for all needs is impractical and ineffective. The best and most common approach is to first identify the specific learning challenge/s that the learner faces, and then identify the most effective learning modality (Visual, Auditory, Reading/Writing and Kinesthetic) and finally design the most engaging learning solution that addresses the specific learning challenge/s.

It would be great if you could share some information about what specific learning challenges your child faces, as it would help give some direction to the effort of arriving at an appropriate and effective solution.

Like this phrase about metaverse in Google; What's certain is that the metaverse will be a new paradigm where our digital and online lives converge.

It looks like you want to quantify the long term effects of 'Hololens' and 'Screen' relative to each other, and not so much relative to no 'mixed reality display'.

In that case, I think that you need to cross over from 'Hololens' to 'Screen' or v.v. only once: after the third test run. Because if you cross-over after each test run, you'd measure the long term effects of both type of devices at the same time and cannot well contrast the results. And that implies that you can randomize only once.

Does that answer your question?

Extended reality or XR is just a term used to group all technologies that go between real and virtual worlds. The letter X is to be replaced with any of the letters: A, M or V which gives AR, MR, VR respectively.

Dear Ercument Gorgul

The iMotions VR Eye Tracking Module allows for eye tracking data collection, visualization, and analysis in virtual environments using the HTC Vive Pro Eye and Varjo VR-2 eye tracking headsets.

Kind Regards

Introducing sensory overlays (sometimes called Virtual Fixtures) can reduce the impact of kinesthetic conflict in augmented reality and telepresence environments. The best overlays are haptic (even if they don't prevent physical dislocation), but you can make real improvements (as measured by Fitts Law) with just audio overlays. Here is a link earliest work we did at the US Air Force looking at Fitts implications of haptic and audio fixtures to AR:

It also helps when there is time-delay in telepresence environments, which is an even worse kinesthetic conflict than "missing surfaces" in AR:

Agree with Qamar Ul Islam.

Needs answer a nice question

In the battlefield, security issues as follows.

Nice Dear Chris Rhodes

There is not a single, "best" definition of MR. In fact, my colleagues and I investigated this question for a paper presented at this year's CHI conference. Based on expert interviews and a literature review, what we found were 6 distinct and widely used working definitions:

These can be classified based on a conceptual framework (some would call it a taxonomy) with 7 dimensions:

Hope this helps! :)

Hi! Not so much for teaching as for personal learning.

Or rather, this reminds us of the role of the teacher as scaffolding for individual learning (Vygotskij). Collective demos of new gadgets in the classroom is not so meaningful, and these technologies have been hyped and overrated.

The bottom line is: there is no separate cyber world, nor should digital information be understood as an information layer on top of the physical. Our one and only world is today rather understood as information, in information terms. I am following Floridi’s Philosophy of Information in this line of thinking. Otherwise we cant see the forest for all the trees.

If you extend a little your question, maybe researcher give best solution.

What do you think about Kalman Filter?

Dear Gilles Van den Ede,

Without the basic knowledge about linear algebra it is difficult to get a concept of PCA. So, I think at first I should give a basic introduction of the linear algebra and the linear transformation to the student. Furthermore, there are several website that describes the fundamentals of PCA by graphical representation. You can check them as well.

Regards

Md. Asadur Rahman

BME, KUET

One of the most important challenges is still the registration problem. Since the virtual information should precisely supplement the real world, it is crucial that both information matches precisely in their position. While this problem seems to be solved by using markers/fiducials, this solution cannot be used in many real-life applications for several reasons (harsh environments / cultural heritages / esthetical design).

Moreover, it is not just the object that needs to be precisely identified and located, it also the user who is moving around in the real world. Also his position needs to be tracked, and there is still some effort e.g. to further develop the SLAM tracking technology.

We very much prefer the native mobile applications, but this has proven far more difficult to create for Apple devices when compared to Android devices. The real exciting benefit of Web Browser-supported AR apps, is the potential for the single app to be completely compatible between devices.

Google is currently testing some AR apps within their Chrome browser, so it's an exciting prospect that we might see development of this increase in the future. At the moment, we use AR apps developed within Unity for our curricula.

eg:

check out following paper

"Expected user experience of mobile augmented reality services:

a user study in the context of shopping centres" by (Olsson et al 2011)

While maybe beyond the scope of the original question ill would like to explore the idea of "Mixed Reality" further. I also agree with what you have identified as the main two definitions of "Mixed reality, both the continium concept as one, and increased level of user interaction with the real world over AR the another.

One question about how your current definition of "Mixed Reality" is what do you define as the cross over from AR to MR . For example is it just limited to physical interaction with real world? 

For example, I recently saw a panel discussion about AR and the social impact when the device starts to understands it surrounds such as identifying point of interest to the users like historical information about a site, etc, currently this is commonly refered to as AR

This made me think of this situation, now let say you have glasses on and it can identify potential hazards in the environment. For example, hazards that a fire fighter cant see due to smoke so the glasses provides a 3D virtual representation of its scanning environment as an overlay of the smoke, what term do we use now AR/VR or MR? I know this is a blue sky example but it begs the question of where the line is drawn , personally I don't have a firm opinion but my initial instict says to categorise as MR

Well as I mentioned, I certainly found in my work for Jaguar Land Rover that a video presentation could provide an 'indication' of the actual experience. In that when designs were compared, those that scored poorly following a video presentation also score poorly when rated after the in-the-car experience, so there was a correlation, though of course the actual ratings differed. So you would have to always compare ratings from the same presentation mode. I agree with Davide that the TAM needs to be extended for your actual purpose; I added a number of moderating factors to the scale I finally developed that were specific to in-car designs.

The plain SPAAM algorithm just uses Direct Linear Transform (DLT) to approximate the extrinsic (pose) and intrinsic orientation of the virtual camera (eye-display combination). DLT assumes a pinhole camera model. Hence, it does not consider radial distortion.

SPAAM is simply put just a procedure to collect your 3D-2D point correspondences. Hence, you could also use other models (considering distortion parameters) and estimation methods.

Best,

Jens