LPS enables rapid discovery of expertise and serves as a conduit between researchers, subject matter experts, investors and innovators by providing multi-faceted search capability across numerous technology areas and across the National Laboratories. Learn more about LPS.

This portal is meant to enable connection to U.S. Department of Energy (DOE) patents and experts, not to provide information about coronavirus or COVID-19. DO NOT contact the individuals and researchers included in LPS for general questions about COVID-19. For information about the virus, please visit the Centers for Disease Control (CDC) website.

Identifying and Embedding Spatial Relationships in Images

Stage: Prototype

Clinical images have a wealth of data that are currently untapped by physicians and machine learning (ML) methods alike. Most ML methods require more data than is available to sufficiently train them. In order to obtain all data contained in a clinical image, it is imperative to be able to utilize multimodal, or various types of, data such as tags or identifications, especially where spatial relationships are key to identification of a clinical diagnosis. To this end, LLNL scientists have developed a method for embedding representations into an image for more efficient processing. Elements within an image are identified, and their spatial arrangement is encoded in a graph. Any machine learning technique can then be applied to the multimodal graph, as representations of the images. These representations can give information such as the proximity of one cell to another allowing the image viewer to obtain knowledge, informing their next decisions. By tapping into the wealth of data in a clinical image, a doctor can gain knowledge that they might not have known prior to applying this patented method, potentially saving time and lives.

IP status: US provisional patent application  "Universal image representation based on a multimodal graph"