Google has developed an “Augmented Reality Microscope” (ARM) in collaboration with the Department of Defense. This microscope incorporates artificial intelligence enhancements to provide real-time visual indicators such as heatmaps and object boundaries. These AI features are intended to simplify the classification of samples and the identification of cancer cells or pathogens.
While the ARM was first introduced in 2018, it has not been used for patient diagnosis yet. Currently, there are 13 prototypes of the ARM, and further testing is required before it can be used by healthcare professionals. Google aims to create a system that can be retrofitted into existing light microscopes in hospitals and clinics. Once integrated, ARM-equipped microscopes can offer various visual feedback, including text, arrows, contours, heat maps, or animations, tailored to specific assessment needs.
The Department of Defense’s Defense Innovation Unit has reportedly negotiated agreements with Google to make the ARM technology available for military use. It is anticipated that some government users may have access to ARM in the fall. However, the estimated cost of ARM, between $90,000 and $100,000, may be prohibitively expensive for many healthcare providers. Google Health has been actively investing in AI-powered tools to enhance diagnostic accuracy and address healthcare gaps. The company has partnered with startups focused on AI healthcare solutions and has invested significantly in AI over the past decade, potentially exceeding $200 billion in investments, according to Reuters. This investment is particularly significant as the World Health Organization predicts a shortage of 15 million healthcare workers globally by 2030.