09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; diagnostic tool for analyzing and configuring vision-assisting eyewear.
2.
Enhancing the performance of near-to-eye vision systems
The majority of applications for head mounted display (HMD) users, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc. yield a conflicting set of tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Further, individual users' needs vary as do their needs with the general task at-hand, visual focus, and various regions-of-interest within their field of view. To address these issues, it is necessary to provide a high performance optical system, eyepiece design, and system features which overcome these limitations.
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and/or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and/or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G06V 20/62 - Text, e.g. of license plates, overlay texts or captions on TV images
G06T 11/60 - Editing figures and text; Combining figures or text
G09G 5/34 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G06F 40/58 - Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
G06F 40/106 - Display of layout of documents; Previewing
G06F 40/109 - Font handling; Temporal or kinetic typography
G06V 10/44 - Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
G06V 10/56 - Extraction of image or video features relating to colour
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 30/224 - Character recognition characterised by the type of writing of printed characters having additional code marks or containing code marks
Users exploiting near-to-eye (NR2I) displays for augmented reality and/or correction of low vision are typically wearing these NR2I displays for specific tasks or for extended periods of time, potentially all their time awake. Conflicting tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics should be concurrently balanced with providing an optical vision system that provides the user with a wide field of view, high image resolution, and a large exit pupil for eye placement with sufficient eye clearance. Accordingly, embodiments of the invention provide NR2I displays meeting these conflicts whilst also addressing the inherent variations between user in respect of their head dimensions, head and eye geometry, as well as adapting the displayed content to reflect the user's task at-hand, visual defects or degradations, visual focus and intent upon various regions-of-interest within their field of view. Such HMDs providing enhanced user experiences.
Users exploiting near-to-eye (NR2I) displays for augmented reality and / or correction of low vision are typically wearing these NR2I displays for specific tasks or for extended periods of time, potentially all their time awake. Conflicting tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics should be concurrently balanced with providing an optical vision system that provides the user with a wide field of view, high image resolution, and a large exit pupil for eye placement with sufficient eye clearance. Accordingly, embodiments of the invention provide NR2I displays meeting these conflicts whilst also addressing the inherent variations between user in respect of their head dimensions, head and eye geometry, as well as adapting the displayed content to reflect the user's task at-hand, visual defects or degradations, visual focus and intent upon various regions-of-interest within their field of view. Such HMDs providing enhanced user experiences.
Users exploiting near-to-eye (NR2I) displays for augmented reality and / or correction of low vision are typically wearing these NR2I displays for specific tasks or for extended periods of time, potentially all their time awake. Conflicting tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics should be concurrently balanced with providing an optical vision system that provides the user with a wide field of view, high image resolution, and a large exit pupil for eye placement with sufficient eye clearance. Accordingly, embodiments of the invention provide NR2I displays meeting these conflicts whilst also addressing the inherent variations between user in respect of their head dimensions, head and eye geometry, as well as adapting the displayed content to reflect the user's task at-hand, visual defects or degradations, visual focus and intent upon various regions-of-interest within their field of view. Such HMDs providing enhanced user experiences.
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
Within applications for Near-to-Eye (NR2I) displays, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc., there is a conflicting tradeoff between user comfort, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system within the NR2I display that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Embodiments of the invention address these issues and provide a high performance optical system through the design of the optical eyepiece design to overcome these limitations within a bioptic configuration with laterally disposed displays.
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
G02C 7/08 - Auxiliary lenses; Arrangements for varying focal length
10.
Language element vision augmentation methods and devices
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and/or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and/or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G06K 9/18 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints using printed characters having additional code marks or containing code marks, e.g. the character being composed of individual strokes of different shape, each representing a different code value
G09G 5/34 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/46 - Extraction of features or characteristics of the image
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G06F 40/58 - Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
G06F 40/106 - Display of layout of documents; Previewing
G06F 40/109 - Font handling; Temporal or kinetic typography
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and/or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user's sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the image using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.
The majority of applications for head mounted display (HMD) users, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc. yield a conflicting set of tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Further, individual users' needs vary as do their needs with the general task at-hand, visual focus, and various regions-of-interest within their field of view. To address these issues, it is necessary to provide a high performance optical system, eyepiece design, and system features which overcome these limitations.
The majority of applications for head mounted display (HMD) users, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc. yield a conflicting set of tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Further, individual users' needs vary as do their needs with the general task at-hand, visual focus, and various regions-of-interest within their field of view. To address these issues, it is necessary to provide a high performance optical system, eyepiece design, and system features which overcome these limitations.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
15.
Vision apparatus comprising eyewear frame and demountable display
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and/or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and/or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G06F 17/28 - Processing or translating of natural language
G06K 9/18 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints using printed characters having additional code marks or containing code marks, e.g. the character being composed of individual strokes of different shape, each representing a different code value
G09G 5/34 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/46 - Extraction of features or characteristics of the image
Near-to-eye displays allow a user to be presented with images that are either augmented to address defects or aberrations within their vision or provide additional information. However, an acquired image typically contains content at different depths and absent depth information image processing applied to the acquired image may discount or apply an image modification that reduces visibility of an object. Accordingly, it would be beneficial for such near-to-eye displays to exploit depth information within the image processing and/or generate depth maps allowing images presented to the user to account for depth. It would be further beneficial for such enhancements to be compatible with the evolving low weight, low volume, low complexity, and low cost near-to-eye display systems. It would be further beneficial to provide a user with other non-visual stimuli based upon depth information within the image.
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
G02C 7/08 - Auxiliary lenses; Arrangements for varying focal length
20.
LARGE EXIT PUPIL WEARABLE NEAR-TO-EYE VISION SYSTEMS EXPLOITING FREEFORM EYEPIECES
Within applications for Near-to-Eye (NR2I) displays, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc., there is a conflicting tradeoff between user comfort, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system within the NR2I display that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Embodiments of the invention address these issues and provide a high performance optical system through the design of the optical eyepiece design to overcome these limitations within a bioptic configuration with laterally disposed displays.
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer hardware for displaying data and video; head-mounted camera and display system; head mounted displays; wearable computer and mobile devices for displaying data, images, and video, namely headsets, display devices and glasses.
23.
LANGUAGE ELEMENT VISION AUGMENTATION METHODS AND DEVICES
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and / or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and / or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G09G 5/377 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory - Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
24.
Apparatus and method for a dynamic “region of interest” in a display system
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
H04N 13/346 - Image reproducers using prisms or semi-transparent mirrors
H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
25.
LANGUAGE ELEMENT VISION AUGMENTATION METHODS AND DEVICES
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and / or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and / or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G09G 5/26 - Generation of individual character patterns for modifying the character dimension, e.g. double width, double height
G09G 5/32 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual characters or indicia using display control signals derived from coded signals representing the characters or indicia with a character-code memory with means for controlling the display position
26.
LANGUAGE ELEMENT VISION AUGMENTATION METHODS AND DEVICES
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and / or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and / or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G09G 5/32 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual characters or indicia using display control signals derived from coded signals representing the characters or indicia with a character-code memory with means for controlling the display position
27.
LANGUAGE ELEMENT VISION AUGMENTATION METHODS AND DEVICES
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and / or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and / or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G09G 5/32 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual characters or indicia using display control signals derived from coded signals representing the characters or indicia with a character-code memory with means for controlling the display position
28.
Language element vision augmentation methods and devices
Near-to-eye displays support a range of applications from helping users with low vision through augmenting a real world view to displaying virtual environments. The images displayed may contain text to be read by the user. It would be beneficial to provide users with text enhancements to improve its readability and legibility, as measured through improved reading speed and/or comprehension. Such enhancements can provide benefits to both visually impaired and non-visually impaired users where legibility may be reduced by external factors as well as by visual dysfunction(s) of the user. Methodologies and system enhancements that augment text to be viewed by an individual, whatever the source of the image, are provided in order to aid the individual in poor viewing conditions and/or to overcome physiological or psychological visual defects affecting the individual or to simply improve the quality of the reading experience for the user.
G06F 17/28 - Processing or translating of natural language
G06K 9/18 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints using printed characters having additional code marks or containing code marks, e.g. the character being composed of individual strokes of different shape, each representing a different code value
G09G 5/34 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
29.
METHODS FOR NEAR-TO-EYE DISPLAYS EXPLOITING OPTICAL FOCUS AND DEPTH INFORMATION EXTRACTION
Near-to-eye displays allow a user to be presented with images that are either augmented to address defects or aberrations within their vision or provide additional information. However, an acquired image typically contains content at different depths and absent depth information image processing applied to the acquired image may discount or apply an image modification that reduces visibility of an object. Accordingly, it would be beneficial for such near-to-eye displays to exploit depth information within the image processing and / or generate depth maps allowing images presented to the user to account for depth. It would be further beneficial for such enhancements to be compatible with the evolving low weight, low volume, low complexity, and low cost near-to-eye display systems. It would be further beneficial to provide a user with other non-visual stimuli based upon depth information within the image.
Near-to-eye displays allow a user to be presented with images that are either augmented to address defects or aberrations within their vision or provide additional information. However, an acquired image typically contains content at different depths and absent depth information image processing applied to the acquired image may discount or apply an image modification that reduces visibility of an object. Accordingly, it would be beneficial for such near-to-eye displays to exploit depth information within the image processing and / or generate depth maps allowing images presented to the user to account for depth. It would be further beneficial for such enhancements to be compatible with the evolving low weight, low volume, low complexity, and low cost near-to-eye display systems. It would be further beneficial to provide a user with other non-visual stimuli based upon depth information within the image.
Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and/or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user's sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the image using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.
For users exploiting near-to-eye (NR2I) displays for augmented reality and / or correction of low vision then the user is typically going to wear the immersive or non-immersive NR2I displays for specific tasks, for specific visual environments, etc. and hence there is an issue of repeatedly attaching and removing the NR2I display. Further, in the majority of applications irrespective of whether for short-term, long-term, low vision, augmented reality, etc. there is a conflicting tradeoff between user comfort, ease of attachment, minimizing intrusiveness and aesthetics. Accordingly, a means of pivotably attaching and supporting a NR2I display is provided wherein the pivotable mounts may be permanently attached, attached, or demountably attached to a frame which may include for some user's prescription lenses.
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory
34.
METHODS AND DEVICES FOR OPTICAL ABERRATION CORRECTION
ABSTRACT Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elernents adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chrornatic aben- ations through pre-distortion based electronic processing techniques in conjunction with design optirnization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consurner grade low cost graphics processing units i=ather than application specific circuits. Date Rect.' e/Date Rece ived 2021-02-18
G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory
35.
Methods and devices for optical aberration correction
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
Near-to-eye displays within head mounted devices offer both users with and without visual impairments enhanced visual experiences either by improving or augmenting their visual perception. Unless the user directly views the display without intermediate optical elements then the designer must consider chromatic as well as other aberrations. Within the prior art the optical train is either complex through additional corrective elements adding to weight, cost, and size or through image processing. However, real time applications with mobile users require low latency to avoid physical side effects. Accordingly, it would be beneficial to provide near-to-eye displays mitigating these distortions and chromatic aberrations through pre-distortion based electronic processing techniques in conjunction with design optimization of the optical train with low weight, low volume, low complexity, and low cost. Further, it would be beneficial to exploit consumer grade low cost graphics processing units rather than application specific circuits.
G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
09 - Scientific and electric apparatus and instruments
Goods & Services
Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; diagnostic tool for analyzing and configuring vision-assisting eyewear.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; diagnostic tool for analyzing and configuring vision-assisting eyewear.
A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; diagnostic tool for analyzing and configuring vision-assisting eyewear.
(2) Wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses; computer hardware for displaying data and video; computer software for setting up, configuring, and controlling wearable computer hardware; computer software for setting up, configuring, and controlling wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; diagnostic tool for analyzing and configuring vision-assisting eyewear; wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses; vision-assisting head-worn digital device consisting of optical lenses and an electronic display computer hardware for displaying data and video computer software for setting up, configuring, and controlling wearable computer hardware; computer software for setting up, configuring, and controlling wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Vision-assisting head-worn digital device consisting of optical lenses and an electronic display.
(2) Wearable device, namely, computerized vision-assisting eyewear consisting of a camera, computer and display to capture, process, and present images, sold separately and as a unit; wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses; computer hardware for displaying data and video; computer software for setting up, configuring, and controlling wearable computer hardware; computer software for setting up, configuring, and controlling wearable peripheral for computer and mobile devices, namely headsets, display devices and glasses.
46.
APPARATUS AND METHOD FOR FITTING HEAD MOUNTED VISION AUGMENTATION SYSTEMS
A head worn display can be designed with an integrated camera for obtaining an image of a scene, transmitting the obtained image to a processor, modification of the image in substantially real time by the processor, and displaying the modified image on a display device worn by the individual. According to embodiments of the invention various methods are provided for adjusting the position of the displayed video in the horizontal left/right, vertical up/down, and horizontal in/out, and angular up/down dimensions relative to the individual's eyes.
A head worn display can be designed with an integrated camera for obtaining an image of a scene, transmitting the obtained image to a processor, modification of the image in substantially real time by the processor, and displaying the modified image on a display device worn by the individual. According to embodiments of the invention various methods are provided for adjusting the position of the displayed video in the horizontal left/right, vertical up/down, and horizontal in/out, and angular up/down dimensions relative to the individual's eyes.
A head worn display can be designed with an integrated camera for obtaining an image of a scene, transmitting the obtained image to a processor, modification of the image in substantially real time by the processor, and displaying the modified image on a display device worn by the individual. According to embodiments of the invention various methods are provided for adjusting the position of the displayed video in the horizontal left/right, vertical up/down, and horizontal in/out, and angular up/down dimensions relative to the individual's eyes.
G09G 5/37 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory - Details of the operation on graphic patterns
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
49.
Apparatus and method for enhancing human visual performance in a head worn video system
Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and/or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user's sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the image using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.
Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and / or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user's sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the image using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.
A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
A method and apparatus of displaying an electronic video image using a head- worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and / or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user's sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.
A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user's head.
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
A61F 9/00 - Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
H04N 5/335 - Transforming light or analogous information into electric information using solid-state image sensors [SSIS]
H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
A61F 9/00 - Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
G09G 5/377 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory - Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
A61F 9/00 - Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
60.
Apparatus and method for a dynamic “region of interest” in a display system
A method and apparatus of displaying a magnified image comprising obtaining an image of a scene using a camera with greater resolution than the display, and capturing the image in the native resolution of the display by either grouping pixels together, or by capturing a smaller region of interest whose pixel resolution matches that of the display. The invention also relates to a method whereby the location of the captured region of interest may be determined by external inputs such as the location of a person's gaze in the displayed unmagnified image, or coordinates from a computer mouse. The invention further relates to a method whereby a modified image can be superimposed on an unmodified image, in order to maintain the peripheral information or context from which the modified region of interest has been captured.
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
A61F 9/00 - Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
G02B 23/12 - Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
A61F 9/00 - Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
G02B 23/12 - Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Low vision aids, namely, devices that enhance a person’s vision via optical lenses and an electronic display; computer platforms; cable for low vision aids; computer software for controlling a low vision aid and enhancing an image before it is presented in the display of an electronic low vision aid; all sold separately and as an assistive technology unit; diagnostic tool used to analyze a patient’s vision in order to properly configure a low vision aid, namely a device that enhances a person’s vision via optical lenses and an electronic display.
