KR101502597B1 - Wide depth of field 3d display apparatus and method - Google Patents

Abstract

Disclosed is a display device and a method capable of high-resolution stereoscopic image display. In the display method, the input image is separated into the near-sight image and the far-sight image, the near-end image is imaged by the light field method, and the far-end image is imaged and output in a multi-point manner.

Rhyme image, perspective image, light field method, multi-point method,

Description

TECHNICAL FIELD [0001] The present invention relates to a display device and a display method capable of displaying stereoscopic images,

The present invention relates to a display device and method capable of displaying a stereoscopic image with high precision, and more particularly, to a technique of outputting a high-quality image by separating a near-sight image and a far- Lt; / RTI >

A stereoscopic display or a 3D display is an image display device that allows a displayed image to exhibit an actual stereoscopic effect. Unlike a 2D display that displays a flat image, the 3D display provides a richer depth cue that allows a person to feel a three-dimensional object in order to realize a three-dimensional feeling. Typical depth perceptions include binocular disparity stereo disparity, convergence, accommodation, and motion parallax.

At this time, there are multi-point and light field methods as a representative example of a non-eye-safe stereo display that does not use glasses. However, in realizing the stereoscopic display using the multi-viewpoint method and the light field method, the blurred image and the visual fatigue are generated in the representation of the myocardium (image positioned between the display and the user) The image is blurred when it is displayed.

Therefore, there is a continuing need for 3D display technology that overcomes the limitations of conventional 3D display technology and does not cause blurring or superimposition of images, resulting in superior image quality.

According to an embodiment of the present invention, there is provided a display method comprising the steps of: dividing an input image into a rhyme image and a perspective image; imaging the rhyme image in a light field mode; a multi view method, and a step of outputting a combination of the imaged rhyme image and the perspective image.

The display method according to an embodiment of the present invention may further include generating a depth map by extracting a depth of an input image, wherein the separating step includes: A root image, and a perspective image.

In addition, the imaging may include encoding the perspective image into a perspective image and encoding the perspective image into an orthogonal image.

In addition, the display method according to an embodiment of the present invention may further include interpolating or extrapolating the input image when the number of viewpoints of the input image is different from the number of viewpoints of the image to be output .

In addition, the display method according to an embodiment of the present invention may further include a step of grasping a location of a user and a step of controlling a sweet spot of an image output according to the location of the user.

A display device according to an embodiment of the present invention includes an image separating unit that separates an input image into a near-sight image and a far-field image, a near-end image imaging unit that images the near- A far-field image imaging unit for imaging the far-field image in a multi-view manner, an image combining unit for combining the imaged short-sighted image and the far-field image, and an image output unit for outputting the combined image.

The display apparatus may further include a depth extracting unit for extracting a depth of an input image and generating a depth map.

The display apparatus according to an embodiment of the present invention further includes an image correction unit for interpolating or extrapolating the input image when the number of viewpoints of the input image is different from the number of viewpoints of the image to be output can do.

The display device according to an exemplary embodiment of the present invention may further include a user position determination unit for determining a position of a user and an optimal point control unit for controlling a sweet spot of an image output according to the position of the user can do.

According to an embodiment of the present invention, a 3D display apparatus and method for displaying both a near-end image and a far-end image with high quality can be provided by separating the near-sight image and the far-field image from each other and imaging them in different ways and outputting them.

According to an embodiment of the present invention, a stereoscopic image and a far-field image are separated from each other and imaged and output in a different manner, thereby preventing blurring or overlapping of the image and providing a 3D display capable of viewing without visual fatigue or dizziness in a wide viewing range Can be implemented.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a view for explaining a display method capable of displaying a high-definition three-dimensional image according to an embodiment of the present invention.

Referring to FIG. 1, in step S110, an input image can be separated into a near-end image and a far-end image. At this time, the near-sight image and the far-sight image can be separated into the near-sight image and the far-field image from the user, respectively, based on the display.

In step S120, the near-end image may be imaged in a light field manner and the far-end image may be imaged in a multi view manner. At this time, step S120 will be described in more detail with reference to FIG.

FIG. 2 is a diagram for explaining a process of imaging the near-sight image and the far-sight image of the display method shown in FIG.

Referring to FIG. 2, in step S210, the root image may be encoded as a perspective image.

In step S220, the perspective image may be encoded into an orthogonal projection image.

That is, in order to output the near-end image in a light field format, the far-end image may be encoded into a perspective projection image, and the far-end image may be encoded into an orthogonal image in order to output the far- have.

Referring back to FIG. 1, in step S130, the imaged rhyme image and the perspective image may be combined and output. At this time, step S130 will be described in more detail below with reference to FIG.

FIG. 3 is a view for explaining a process of combining a near-sight image and a far-field image of the display method shown in FIG.

Referring to FIG. 3, in step S310, the imaged root-ray image and the far-end image may be weaved into one image signal to image the near-sight image and the far-field image.

In step S320, the combined video signal may be transmitted to the display panel to output an image.

That is, the near-far-vision image and the far-sight image respectively imaged by the perspective projection image and the orthogonal projection image may be sequentially weighed into one image so as to be mixed into one image frame. Accordingly, when the combined video signal is transmitted to the 3D display panel, an actual video can be output.

Referring to FIG. 1 again, a display method capable of displaying a high-definition stereoscopic image may further include a step (not shown) of extracting a depth of an input image to generate a depth map. For example, when the input image is a stereo format, a multi-point format, or the like, a depth map can be generated by extracting an image depth first when an input image is input. Therefore, the input image can be separated into the near-sight image and the far-field image based on the generated depth map. If the input image is a 3D format having a color and a depth, it is possible to separate the near-sight image and the far-field image without performing the step of generating the depth map.

 In addition, a display method capable of displaying a three-dimensional image with high precision may further include the step of interpolating or extrapolating the input image when the number of viewpoints of the input image is different from the viewpoint of the image to be output . For example, if the input image is a 6-view image and the image to be output is a 24-view image, the input image may be interpolated or extrapolated to output the 24-view image .

In addition, a display method capable of displaying a three-dimensional image with high precision may further include a step of grasping a position of a user and a step of controlling a sweet spot of an image output according to the position of the user. Here, the step of controlling the sweet spot is described in detail below with reference to Fig.

4 is a diagram illustrating a process of controlling a sweet spot of an image output according to a user's position according to an embodiment of the present invention.

Referring to FIG. 4, in step S410, a user's position is determined through a vision or the like. In step S420, a sweet spot is controlled according to the location of the user, So that the user can view the image. Here, the sweet spot may be changed by, for example, changing the interval between the display panel and the lens or shifting the output image to change the sweet spot.

As described above, the multi-view display and the light field display can be realized through the same type of display structure although the acquisition and presentation methods of the images are different. In both methods, a lenticular lens is attached to the 2D display, Image representation, or multi-projector configuration. Therefore, it is possible to display both the near-end image and the far-end image in a clear image by separating the displayed image into a multi-view image representation and a light field image representation according to the depth.

In addition, it is possible to separate the near-sight image and the far-field image from each other, respectively, and output the imaged image in the light field mode and the multi-point mode, respectively, so as to view a high-quality image without blurring or overlapping.

FIG. 5 is a diagram illustrating a display of a high-resolution stereoscopic image according to an embodiment of the present invention.

5, the near-end image 520 is represented by a light field method, and the far-sight image 510 is represented by a multi view method, and blurring or blurring of the near- it is possible to display a high-quality image without overlapping. As shown in Fig. 5, the near-end image is displayed before the far-end image, and the far-end image does not need to be displayed, so that the beam indicating the near end and the beam corresponding to the far end are not overlapped with each other. This is true regardless of the direction in which the user views the display in any direction, so that it is possible to completely separate the rhyme and the mirror from each other and display them in different ways.

FIG. 6 is a diagram illustrating a process of displaying a rhyme image and a perspective image in different ways according to an input image format, according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, in step S610, when a stereoscopic image comes in as an input image, a depth map can be generated by extracting the depth of an image first. Here, the input stereoscopic image may be at least one of a stereo format 602, a multi-view format 603, a 3D format 601 having color and depth information, Type input is also possible. Here, if the input stereoscopic image is an image of the 3D format 601 having the color and depth information, step S610 may not be performed.

In step S620, it is determined whether a stereoscopic image to be displayed based on the stereoscopic image is to be displayed before or after the display. In step S630, the stereoscopic image and the stereoscopic image may be separated from each other.

In step S640, the separated near-end and far-end images can be converted into a multi-view image and a light field image, respectively. That is, the perspective image may be encoded as a perspective image and the perspective image may be orthogonal image encoded.

In step S650, each encoded image is sequentially combined into one image, and one image frame is generated. In step S660, a final image signal obtained by combining the near-sight image and the far- So that an actual image can be displayed.

7 is a diagram illustrating a process of displaying a stereoscopic image when a stereoscopic image is input according to an embodiment of the present invention.

Referring to FIG. 7, in step S710, a stereo image including a left image and a right image may be input.

In step S720, a color image having color information and a depth image having depth information can be extracted from the stereo image, respectively.

In step S730, the near vision image and the far vision image may be separated using the color image and the depth image. At this time, the near-sight image and the far-sight image can be classified according to whether the image is outputted to a region close to the user or a region far from the user based on the display. Therefore, it is possible to compare the parameter value with the preset parameter value to separate the near-end image or the far-end image.

In step S740, a light field image can be generated for outputting in the light field method in the case of the near vision image. That is, the near-end image can be encoded into the orthogonal projection image for the output of the light field method.

In step S750, a multi-view image may be generated to output the far-field image in a multi-point manner. That is, the perspective image can be encoded into the perspective projection image for the output of the multi-view method.

In step S760, the imaged rhyme image and the perspective image may be combined to generate one image frame.

Thus, by outputting a combination of the imaged rhyme image and the perspective image in different ways, it is possible to output a blurred or superimposed clear image in both the near-sighted image and the far-sighted image.

8 is a diagram illustrating a display device capable of displaying a high-resolution three-dimensional image according to an exemplary embodiment of the present invention.

8, a display device capable of displaying a high-definition three-dimensional image includes an image separation unit 810, a near-end image imaging unit 820, a far-field image imaging unit 830, an image combining unit 840, 850 < / RTI > The display device capable of displaying the stereoscopic image may further include at least one of a depth extracting unit (not shown), an image correcting unit (not shown), a position determining unit (not shown), and an optimum point controlling unit can do.

The image separating unit 810 can separate the inputted image into the near-end image and the far-end image. At this time, the near-end image and the far-end image can be classified according to the position output based on the display unit, and can be determined by comparing with the predetermined parameter value.

The rhyme image imager 820 may image the near-end image using a light field method. Thus, the near-end image can be encoded as a perspective projection image.

The perspective image imaging unit 830 may image the perspective image in a multi view manner. Thus, the perspective image can be encoded as an orthogonal projection image.

The image combining unit 840 may weave the imaged rhyme image and the perspective image. That is, the near-sight image and the far-sight image may be combined to generate one frame image.

The video output unit 850 can output the combined video.

The depth extraction unit (not shown) extracts the depth of an input image and generates a depth map. For example, in the case of stereoscopic or multi-view images, the depth map can be generated by extracting the depth.

The image correction unit may interpolate or extrapolate the input image when the number of viewpoints of the input image is different from the viewpoint of the image to be output.

The position determiner (not shown) can determine the position of the user, and the optimal point controller (not shown) can control the sweet spot of the image output according to the position of the user. For example, the sweet spot can be changed in response to a positional change according to the movement of the user.

As described above, it is possible to implement a 3D display that can prevent blurring or superimposition of an image and can be viewed without visual fatigue or dizziness in a wide viewing range by separately separating the near-sight image and the far-sight image from each other and imaging them in different ways and outputting them.

The form or structure of the display described here is one example of the actual display, and the specific implementation may be different in implementing the 3D display. Specifically, a projector method may be used for realizing the multi-point and light field image, and a micro array lens may be used instead of the lenticular lens. Changes in the implementation of such a display and implementation changes in the method of generating each of the multi-view image and the light field image are included in the spirit and scope of the present invention.

A display method capable of displaying a high-definition stereoscopic image according to an exemplary embodiment of the present invention may be implemented in a form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

FIG. 1 is a view for explaining a display method capable of displaying a high-definition three-dimensional image according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining a process of imaging the near-sight image and the far-sight image of the display method shown in FIG.

FIG. 3 is a view for explaining a process of combining a near-sight image and a far-field image of the display method shown in FIG.

4 is a diagram illustrating a process of controlling a sweet spot of an image output according to a user's position according to an embodiment of the present invention.

FIG. 5 is a diagram illustrating a display of a high-resolution stereoscopic image according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating a process of displaying a rhyme image and a perspective image in different ways according to an input image format, according to an embodiment of the present invention. Referring to FIG.

7 is a diagram illustrating a process of displaying a stereoscopic image when a stereoscopic image is input according to an embodiment of the present invention.

8 is a diagram illustrating a display device capable of displaying a high-resolution three-dimensional image according to an exemplary embodiment of the present invention.

Description of the Related Art

810:

820: Near vision image imaging unit

830:

840:

850: Video output unit

Claims (19)

Separating the input image into a rhyme image and a perspective image; Imaging the near-end image and the far-end image in different ways; And Combining and outputting the imaged rhyme image and the perspective image Lt; / RTI > Wherein the near vision image is imaged according to a light field method and the far vision image is imaged according to a multi view method. The method according to claim 1, A step of extracting a depth of an input image and generating a depth map Further comprising: Wherein said separating comprises: And separating the input image into a near-sight image and a far-field image based on the depth map. The method according to claim 1, Wherein said separating comprises: Separating an image positioned between a display and a user of the input image into the near-end image, and separating an image positioned behind the display into the far-end image. The method according to claim 1, Wherein the imaging comprises: Encoding the near vision image into a perspective image; And Encoding the perspective image into an orthogonal projection image / RTI > The method according to claim 1, Interpolating or extrapolating the input image when the number of viewpoints of the input image is different from the viewpoint of the image to be output, ≪ / RTI > The method according to claim 1, Wherein the outputting step comprises: Combining the imaged rhyme image and the perspective image into one image signal; And Transmitting the combined video signal to a display panel and outputting an image / RTI > The method according to claim 1, Determining a position of the user; And Controlling a sweet spot of an image output according to the position of the user ≪ / RTI > 8. The method of claim 7, Wherein the controlling the sweet spot comprises: And changing the interval between the display panel and the lens to change the sweet spot. 8. The method of claim 7, Wherein the controlling the sweet spot comprises: And shifting the output image to change the sweet spot. A computer-readable recording medium recording a program for performing the method of any one of claims 1 to 9. An image separator for separating an input image into a near-end image and a far-end image; A near-end image imaging unit and a far-field image imaging unit for imaging the near-end image and the far-end image in different ways; An image combining unit that combines the imaged rhyme image and the perspective image; And And a video output unit Lt; / RTI > Wherein the near vision image is imaged according to a light field method and the far vision image is imaged according to a multi view method. 12. The method of claim 11, A depth extracting unit for extracting a depth of an input image and generating a depth map; Further comprising: 12. The method of claim 11, Wherein the image separator comprises: Separating an image positioned between a display and a user of the input image into the root image and separating an image positioned behind the display into the far-field image. 12. The method of claim 11, The near vision image imaging unit may include: And encodes the root image into a perspective image. 12. The method of claim 11, Wherein the perspective image imaging unit comprises: And encodes the perspective image into an orthogonal projection image. 12. The method of claim 11, And an image correction unit that interpolates or extrapolates the input image when the number of viewpoints of the input image is different from the viewpoint of the image to be output, And a display device. 12. The method of claim 11, A user position determination unit for determining a position of a user; And An optimal point control unit for controlling a sweet spot of an image output according to the position of the user, And a display device. 18. The method of claim 17, The optimum point control unit, And changing the interval between the display panel and the lens to change the sweet spot. 18. The method of claim 17, The optimum point control unit, And changes the sweet spot by shifting the output image.

Images