HK40092315A - Video playing method and related apparatus - Google Patents

Description

A video playback method and related apparatus

Technical Field

This application relates to the field of data processing, and in particular to a video playback method and related apparatus.

Background Technology

Users can watch various videos on content platforms. During the viewing process, more and more users will not watch the entire video from beginning to end, but will quickly jump to the part of the video content that interests them.

Related technologies provide a way to jump between video content by dragging the video timeline. That is, users can select the playback progress of the timeline by swiping, clicking, etc., so as to watch the video content corresponding to the playback progress.

However, the above method of dragging the video timeline requires users to try multiple times before they can locate the video content they are actually interested in, which increases the number of background responses and consumes unnecessary processing resources.

Summary of the Invention

To address the aforementioned technical problems, this application provides a video playback method and related apparatus, which reduces the number of attempts users need to find the desired video content and saves processing resources.

The embodiments of this application disclose the following technical solutions:

On one hand, embodiments of this application provide a video playback method, the method comprising:

The progress switching operation for the target video is obtained by measuring the display area of the target video;

Multiple plot preview information is displayed in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes the plot segments corresponding to the multiple plot preview information.

When it is determined that the first plot preview information among the multiple plot preview information is selected, the target video will be redirected to the first plot segment corresponding to the first plot preview information for playback.

On the other hand, embodiments of this application provide a video playback device, the device including an acquisition unit, a display unit, and a jump unit:

The acquisition unit is used to acquire the progress switching operation for the target video through the display area of the target video;

The display unit is used to display multiple plot preview information in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes plot segments corresponding to the multiple plot preview information.

The jump unit is used to jump the target video to the first plot segment corresponding to the first plot preview information when it is determined that the first plot preview information among the plurality of plot preview information is selected.

In another aspect, embodiments of this application provide a computer device, the computer device including a processor and a memory:

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the methods described above according to instructions in the program code.

In another aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program for performing the methods described above.

In another aspect, embodiments of this application provide a computer program product including instructions that, when run on a computer, cause the computer to perform the methods described above.

As can be seen from the above technical solution, in response to the progress switching operation of the target video obtained through the display area of the target video, multiple plot preview information of the plot segments included in the target video is displayed in the display area. Since the plot preview information includes the video footage and plot description text of the corresponding plot segment, the plot segments of the target video are displayed from multiple dimensions through images and text. This allows users to more accurately understand the specific information of multiple plot segments of the target video based on the rich information provided by the plot preview information, providing a more complete reference for users to select video content of interest from the target video. Therefore, when it is determined that the first plot preview information among multiple plot preview information is selected, when the target video jumps to the first plot segment corresponding to the first plot preview information for playback, the video content played is more likely to meet the user's needs, reducing the number of attempts for the user to find the required video content and saving processing resources.

Attached Figure Description

To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

Figure 1 is a schematic diagram of a video playback scenario provided in an embodiment of this application;

Figure 2 is a flowchart of a video playback method provided in an embodiment of this application;

Figure 3 is a schematic diagram of a video dragging method;

Figure 4 is a schematic diagram of a plot preview information display method provided in an embodiment of this application;

Figure 5 is a schematic diagram illustrating the highlighting of plot preview information according to an embodiment of this application;

Figure 6 is a schematic diagram of updating the video frame in the plot preview information during a progress switching operation provided in an embodiment of this application;

Figure 7a is a schematic diagram of displaying the plot progress corresponding to the progress switching operation in the plot preview information according to an embodiment of this application;

Figure 7b is a schematic diagram of another way to display the plot progress corresponding to the progress switching operation in the plot preview information provided by an embodiment of this application;

Figure 8 is a schematic diagram of adjusting the displayed plot preview information through a progress switching operation according to an embodiment of this application;

Figure 9 is a schematic diagram of displaying plot preview information through a preview control according to an embodiment of this application;

Figure 10 is a schematic diagram of adjusting the displayed plot preview information by sliding operation according to an embodiment of this application;

Figure 11a is a schematic diagram of determining plot segments based on bullet comments according to an embodiment of this application;

Figure 11b is a schematic diagram of determining a plot segment based on plot selection according to an embodiment of this application;

Figure 11c is a schematic diagram of determining a plot segment based on playback speed adjustment according to an embodiment of this application;

Figure 12 is a schematic diagram of a video playback system provided in an embodiment of this application;

Figure 13 is a flowchart of determining plot preview information provided in an embodiment of this application;

Figure 14 is a structural diagram of a video playback device provided in an embodiment of this application;

Figure 15 is a structural diagram of a terminal device provided in an embodiment of this application;

Figure 16 is a structural diagram of a server provided in an embodiment of this application.

Detailed Implementation

The embodiments of this application will now be described with reference to the accompanying drawings.

In video playback scenarios, if a user needs to watch content that interests them within a video, the relevant technologies require the user to make multiple attempts before they can locate the video content they are actually interested in. This increases the number of background responses and consumes unnecessary processing resources.

Therefore, embodiments of this application provide a video playback method and related apparatus, which reduces the number of attempts users need to find the desired video content and saves processing resources.

The video playback method provided in this application can be implemented using a computer device, which can be a terminal device or a server. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. Terminal devices include, but are not limited to, mobile phones, computers, smart voice interaction devices, smart home appliances, and in-vehicle terminals. Terminal devices and servers can be directly or indirectly connected via wired or wireless communication, which is not limited herein. This invention can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, and assisted driving.

It is understood that in the specific implementation of this application, historical user viewing data, such as comment information, playback position switching information, or variable speed playback information, which may be related to user information, are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

Figure 1 is a schematic diagram of a video playback scenario provided in an embodiment of this application. In this embodiment, a terminal device is used as an example of the aforementioned computer device. In Figure 1, the display screen of the terminal device 100 (exemplarily shown as a mobile phone) is playing a movie as the target video, and the area where the movie is played is denoted as the display area 200.

In response to a progress switch operation for the movie obtained through the display area 200 of the movie, the terminal device 100 displays multiple plot preview information of the plot segments included in the movie in the display area 200. Figure 1 shows three plot preview information examples, namely plot preview information 301, plot preview information 302 and plot preview information 303. Different plot preview information corresponds to different plot segments in the movie.

The plot preview information includes video footage of the corresponding plot segment and plot description text. For example, plot preview information 101 includes keyframe images of the plot segment corresponding to plot preview information 101 and plot description text "Xiao Ming makes a stunning appearance, and the whole floor is dizzy".

Because the plot preview information includes video footage of the corresponding plot segment and plot description text, it presents the plot segments of the movie from multiple dimensions through images and text. Based on the rich information provided by the plot preview information, users can more accurately understand the specific information of these three plot segments of the movie, providing a more complete reference for users to select video content of interest in the movie.

For example, when a user sees three plot previews in Figure 1 and selects plot preview 303, the terminal device 100 determines that plot preview 303 is selected as the first plot preview. When the movie jumps to the first plot segment corresponding to the first plot preview, the content of the movie played matches the video footage and plot description text shown in plot preview 303 ("Xiao Zhang used someone else as a shield but was seen through at a glance"). This makes it more likely that the movie content after the jump will meet the user's needs. For example, the user does not need to drag the movie progress again, thereby reducing the number of attempts the user makes to find the desired video content and saving the processing resources of the terminal device 100.

Figure 2 is a flowchart of a video playback method provided in an embodiment of this application. In this embodiment, the terminal device is the aforementioned computer device as an example for illustration. The method includes:

S201: Obtain the progress switching operation for the target video through the display area of the target video.

The terminal device can display the target video through its own display screen, and the area on the display screen where the target video is displayed is the display area. When a progress switch operation is performed on the target video, the target video in the display area can be in a playing state, or it can be paused or not yet played; this application does not limit this.

The target video displayed in the display area can be provided by a content platform or stored locally on the terminal device. If the target video is provided by a content platform, the terminal device can display the target video through the content platform's client. If the target video is stored locally on the terminal device, the terminal device can display the target video through a player application.

This progress switching operation is used to switch the playback progress of the target video, allowing the terminal device to jump from the current playback progress to the playback progress indicated by the progress switching operation. For example, if the current playback progress is 1 minute of the target video, and the playback progress indicated by the progress switching operation is 8 minutes and 3 seconds, then the terminal device will jump the playback progress of the target video to the playback progress indicated by the progress switching operation and start playing the target video from 8 minutes and 3 seconds.

The progress switching operation can be a continuous operation or a non-continuous operation. This application does not limit this. For example, it can be a continuous swipe operation or an intermittent click operation (e.g., at least once).

S202: Display multiple plot preview information in the display area.

The plot preview information includes video footage and plot description text for the corresponding plot segment. There is a one-to-one correspondence between the plot preview information and the plot segment, and the plot segments corresponding to multiple plot preview information are all included in the target video.

A narrative segment is used to identify a portion of video content within a target video that has a relatively complete narrative structure. This can be represented by high-quality content or exciting clips within the target video. Compared to non-narrative segments, these clips are more likely to be watched by users and are therefore the more likely parts of the target video to be viewed. The narrative segments proposed in this application are not limited to scripted video clips from movies, TV series, or variety shows; they can also include highlight segments from sports videos, important news segments from news videos, etc.

In some related technologies, users can adjust the video playback progress by continuously sliding their fingers across the display area. As shown in Figure 3, by continuously sliding across the display area of the video being played, the timeline position on the video timeline can be adjusted. For example, by sliding to the right, the timeline position can be adjusted from the 3rd minute (as shown in the left figure) to the 5th minute (as shown in the right figure). After canceling the sliding operation, the video will switch to the timeline position corresponding to when the sliding operation was canceled.

During the adjustment process based on the swipe operation, a smaller video image is displayed in the display area. This video image is used to represent the video keyframe corresponding to the current timeline moment. During this process, the user can only see a miniature version of the video image. Based solely on the information provided by the video image, the user cannot clearly understand what plot it corresponds to. This makes it unlikely that the video content played after canceling the swipe operation will meet the user's actual needs. The user will need to adjust again or even multiple times to locate the video content they want to watch.

In this embodiment, the plot preview information displayed in the display area includes not only video footage in the image dimension but also textual plot descriptions, allowing the plot preview information to provide an introduction to the plot segment from multiple information dimensions. The video footage in the video preview information can be a keyframe from the corresponding plot segment, or a description determined based on a keyframe. The plot description text in the video preview information is used to identify the content summary of the corresponding plot segment. This description text can be obtained by parsing the content of the plot segment. For example, when the plot segment contains text or audio content such as subtitles, the description text can be obtained based on this. The description text can also be obtained based on interactive information related to the plot segment, such as bullet comments, comments, and emoticons.

In some scenarios, the plot description text determined based on interactive information can be used to adjust the original plot description text determined based on plot fragments.

For example, if a scene in the target video has a subtitle stating "Character B is tasked with a mission in a time of crisis," and the comments section heavily mentions "Actor A's highlight moment" (Actor A plays character B in the target video), the subtitle can be corrected to "Actor A's highlight moment." The adjusted subtitle better reflects the user's understanding of the scene.

Moreover, compared to a single video frame at the current timeline shown in related technologies, this application displays multiple plot previews, with each preview corresponding to a different plot segment in the target video. This allows users to fully understand the plot information of the multiple plot segments included in the target video, enabling them to make better and more accurate switching decisions. This increases the likelihood that switching playback progress will meet the user's viewing needs and reduces the number of adjustments required after switching playback progress.

It should be noted that if the target video is playing before displaying multiple plot previews, the target video can continue playing at its original playback speed or pause at its original playback speed during the display of multiple plot previews.

In the scenario where the target video is playing at its original playback progress, users can continue watching the currently playing episode of the target video while viewing multiple plot previews.

Therefore, in one possible implementation, S202 includes: displaying multiple plot preview information in the display area through a navigation layer with transparency, wherein the navigation layer overlaps the display layer of the target video in the display direction.

Based on the positional relationship between the navigation layer and the display layer in the display direction, users can see that the navigation layer is overlaid on the display layer. Since the navigation layer has transparency, while displaying plot preview information through the navigation layer, the video content displayed in the display layer behind the navigation layer can also be seen to a certain extent by the user, preventing the user from missing the video content of the currently playing target video.

As shown in Figure 4, the gray area represents the navigation layer 10 with transparency. The terminal device displays the plot preview information 300 through the navigation layer 10. Through the navigation layer 10, the user can also see the display layer 20 covered by the navigation layer 10, and thus continue to pay attention to the video content playing in the display layer 20.

To better guide users in switching playback progress, multiple plot previews displayed on the terminal device's display area can be correlated to enhance their guidance.

In one possible implementation, the method further includes:

S11: Determine the playback order of the plot segments corresponding to the multiple plot preview information in the target video.

S12: Determine the display order of the multiple plot preview information based on the playback sequence.

Accordingly, S202 includes:

The multiple plot preview information are displayed in the display area according to the display order.

The target video contains story segments distributed across different playback time intervals. For example, if the target video is a 10-minute video containing three story segments, segment 1 might play from minute 1 to minute 3, segment 2 from minute 6 to minute 7, and segment 3 from minute 9 to minute 10. During normal playback of the target video, segment 1 will play first, then segment 2, and finally segment 3, demonstrating the playback order of the story segments.

By determining the playback order of plot segments within the target video, the terminal device can sequentially display the plot preview information corresponding to each plot segment. In the example above, the display order of plot preview information 1-3 for plot segments 1-3 is as follows: plot preview information 1 is to the left of plot preview information 2, and plot preview information 3 is to the right of plot preview information 2. This ensures that the display order of multiple plot preview information items conforms to the playback order of the plot segments they correspond to.

When the terminal device displays multiple plot previews based on this display order, it further provides users with the sequential relationship of the corresponding plot segments in the target video. It also serves to indicate the plot development in the target video. Users can get a general understanding of the plot of the target video based on multiple plot previews, which further provides a reference for users to switch playback progress and improves the accuracy of users switching playback progress based on progress switching operations.

S203: When it is determined that the first plot preview information among the plurality of plot preview information is selected, the target video is jumped to the first plot segment corresponding to the first plot preview information for playback.

This application does not limit the method in which the first plot preview information is selected. It can be related to the type of the aforementioned progress switching operation, which will be described in detail in subsequent embodiments and will not be repeated here.

Since the aforementioned multiple plot previews contain a wealth of information related to plot segments, when the first plot preview is selected, the video content played by the target video based on the first plot segment is more likely to be accepted by the user.

When the target video is redirected to the first plot segment for playback, video content related to the first plot segment is played. This application does not limit the specific playback time (i.e., the playback time at which the video is redirected); it can be the start time of the first plot segment in the target video, or the timeline moment when the progress switch operation is canceled.

Therefore, in response to the progress switching operation of the target video obtained through the display area of the target video, multiple plot preview information of the plot segments included in the target video is displayed in the display area. Since the plot preview information includes the video footage and plot description text of the corresponding plot segment, the plot segments of the target video are displayed from multiple dimensions through images and text. This allows users to more accurately understand the specific information of multiple plot segments of the target video based on the rich information provided by the plot preview information, providing a more complete reference for users to select video content of interest from the target video. Therefore, when the first plot preview information among multiple plot preview information is selected, and the target video jumps to the first plot segment corresponding to the first plot preview information for playback, the video content played is more likely to meet the user's needs, reducing the number of attempts the user makes to find the desired video content and saving processing resources.

The following sections will explain two specific implementation methods for progress switching operations: a sliding operation that meets triggering conditions and a control-based triggering operation.

First, let's explain the swipe gesture as the progress switching action:

In one possible implementation, S201: Obtaining a progress switching operation for the target video through the display area of the target video, including:

S2011: Obtain the sliding operation through the display area of the target video.

S2012: If the sliding operation meets the triggering condition, determine that the sliding operation is a progress switching operation for the target video, and adjust the time axis time corresponding to the time axis of the target video according to the sliding parameters of the progress switching operation.

Triggering conditions can be set based on actual scenarios or needs. For example, they can include the duration of the swipe operation, which indicates the length of time the contact surface remains in contact with the screen during the swipe operation. For instance, when a user presses and moves their finger on the display screen of a terminal device to generate a swipe operation, the finger remains in contact with the screen as long as it is pressed and has not been removed. The duration of this contact surface indicates the duration of the swipe operation.

Once the sliding operation is determined as a progress switching operation, the terminal device can adjust the time axis time corresponding to the time axis of the target video based on the sliding parameters of the sliding operation.

The sliding parameter is used to identify the sliding direction and distance or speed of the sliding operation. The sliding direction indicates whether the timeline time increases or decreases, and the sliding distance or speed indicates the degree of change in the timeline time. This application does not limit the specific method of adjusting the timeline time based on the sliding parameter. For example, in a scenario where the target video is displayed in landscape mode on a terminal device, sliding to the left can decrease the timeline time, such as adjusting from the 3rd minute to the 2nd minute, and sliding to the right can increase the timeline time, such as adjusting from the 3rd minute to the 4th minute. Alternatively, one can decrease the timeline time by sliding down and increase the timeline time by sliding up, or increase or decrease the timeline time by other sliding directions, etc.

The timeline time indicates the point at which playback is pending when the progress switching operation is canceled. In other words, the timeline time only takes effect when the progress switching operation is canceled (e.g., when the finger used to perform the swipe operation leaves the display screen of the terminal device), serving as the basis for jumping to the first plot segment corresponding to the first plot preview information for playback. During the progress switching operation, the timeline time may not affect the playback of the target video; for example, the video content corresponding to that timeline time will not be played due to changes in the timeline time.

During the adjustment of the timeline, the terminal device can display the current timeline in real time in the display area to indicate the current playback progress to the user. The user can clearly see the progress of the video content to be played in the target video when the progress switching operation is canceled. This progress can be, for example, the timeline moment when the progress switching operation is canceled.

Since different plot segments in the target video have different playback time intervals, when adjusting the timeline using the progress switch operation, the timeline will either enter or leave the playback time interval of a certain plot segment. To better indicate the position of plot segments in the target video, this application provides a method for highlighting plot preview information.

In one implementation, the method further includes: if the timeline is currently within the playback time interval of the second plot segment of the target video, highlighting the second plot preview information corresponding to the second plot segment relative to other displayed plot preview information in the display area.

This application does not limit the specific method of highlighting, as long as it can be distinguished from other currently displayed plot preview information from a display perspective. For example, as shown in Figure 5, the current timeline is at minute 3, and the playback time range of plot segment 1 is from minute 2 to minute 5. That is, the current timeline is adjusted to the playback time range of plot segment 1. The plot preview information 1 corresponding to plot segment 1 is highlighted relative to the plot preview information 2 and plot preview information 3 displayed at the same time. The specific highlighting method is to enlarge the display area of plot preview information 1 and bold the plot description text in plot preview information 1. In addition, other highlighting methods can also change the color of the plot description text, the outer frame color of the video image, etc., for example, changing it to orange.

It should be noted that the above is only an illustrative example. Once the timeline enters the playback time range of a plot segment, the plot preview information corresponding to that plot segment will be highlighted. Once the timeline leaves the playback time range of a plot segment, the highlighting of the plot preview information corresponding to that plot segment will be canceled, and the display will return to the state before the highlighting.

For example, as the progress switching operation continues, after the timeline slides out of the playback time range of the second plot segment, the preview information of the second plot segment returns to normal display; when the timeline enters the playback time range of another plot segment, such as the third plot segment, the plot preview information of the third plot segment is highlighted.

Because one of the multiple plot preview information can be highlighted based on the progress switch operation, users can clearly see whether the currently adjusted timeline moment meets their viewing needs, and thus determine when to cancel the progress switch operation.

Therefore, in one possible implementation, the method further includes: determining that the progress switching operation is canceled when the second plot preview information is highlighted, determining the second plot preview information as the selected first plot preview information, and the second plot segment as the first plot segment.

When the second plot preview information is highlighted and the progress switching operation is canceled, the terminal device can determine that the user wants to watch the video content of the plot segment corresponding to the second plot preview information. Therefore, the second plot preview information can be identified as the first plot preview information in S203, and the second plot segment can be identified as the first plot segment to be skipped to.

S203, which involves jumping the target video to the first plot segment corresponding to the first plot preview information for playback, includes:

The target video is redirected to the beginning of the first story segment for playback; or, the target video is redirected to the timeline moment when the progress switching operation was canceled for playback.

After the terminal device jumps to the playback progress of the target video, the video content played can be related to the first plot segment. For example, playing from the beginning of the first plot segment as mentioned above allows the user to watch the complete first plot segment.

For example, the timeline at which the progress switch operation was canceled perfectly matches the timeline at which the user canceled the progress switch operation.

Regardless of the method used, all of these can reduce the likelihood of users needing to reposition for playback. The specific method chosen can be selected based on the specific scenario.

As mentioned above, this application helps users determine which plot segment is related to the currently adjusted timeline moment by highlighting the plot preview information. Since the playback time interval of a plot segment has a certain length, in order to improve the accuracy of users determining the jump playback position based on the plot preview information, in one possible implementation, the method further includes:

S21: During the process of highlighting the second plot preview information, the key frame image corresponding to the timeline moment of the second plot segment is determined, and the second plot segment includes multiple key frame images.

S22: The determined keyframe images are updated and displayed as video frames in the second plot preview information.

In other words, the second plot segment has multiple keyframe images, and different keyframe images correspond to different timeline moments. Therefore, when the second plot preview information is highlighted, as the timeline moment changes within the corresponding playback time interval of the second plot segment, the video images in the second plot preview information can change accordingly. This allows the video images in the plot preview information to also reflect the video images changing with the timeline within the same plot segment. Based on the changing video images in the highlighted second plot preview information, users can gain a more detailed understanding of which part of the second plot segment the current timeline moment corresponds to.

This allows the video footage in the second story segment preview to be updated based on keyframe images of the second story segment, enabling users to more clearly understand the specific content and plot development of the second story segment, thus improving the accuracy of playback progress switching. For example, when the newly updated video footage in the second story segment preview matches the user's viewing needs, the user can promptly cancel the progress switch operation to accurately switch the playback progress of the target video.

As shown in Figure 6, as the timeline changes within the playback time interval of the second story segment, the video footage in the second story preview information is updated accordingly, allowing users to more clearly understand the plot development of the second video segment and the current story information.

To allow users to more clearly understand the playback progress at the current timeline point during progress switching, in one possible implementation, the method further includes:

S31: During the process of highlighting the second plot preview information, determine the plot progress parameter corresponding to the playback time interval of the second plot segment at the time of the time axis.

S32: Identify the plot progress parameters in the highlighted second plot preview information.

This plot progress parameter is used to identify the progress ratio corresponding to the current timeline moment within the playback time interval of the second plot segment. It can reflect the relationship between the length of time before or after the timeline moment in this playback time interval and the total duration of the playback time interval.

For example, the playback time interval of the second plot segment is 5 minutes, and the current timeline is at the 3rd minute of these 5 minutes. The time of the second plot segment before the current timeline moment accounts for 60% of the total duration of the second plot segment.

Therefore, the plot progress parameter clearly shows how much video content of the second plot segment is still available to watch if we jump to the current timeline.

Figures 7a and 7b show two different ways of indicating plot progress parameters. Figure 7a shows the vertical scale method (where the arrows are used to indicate the direction of progress, but are not shown in actual use), and Figure 7b shows the percentage method (shown as an example of 45%).

It should be noted that some target videos may contain a large number of plot segments, making it difficult to display the plot preview information of all plot segments through the display area of the terminal device. Therefore, the plot preview information displayed at the same time is only the plot preview information corresponding to a portion of the plot segments.

Therefore, in one possible implementation, if the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video, the method further includes:

S41: During the process of adjusting the time axis moment corresponding to the time axis of the target video according to the sliding parameters of the progress switching operation, based on the adjusted position of the time axis moment in the time axis, multiple plot segments in the target video whose playback time is before or after the adjusted position are determined as segments to be previewed.

S42: Update and display the plot preview information corresponding to the segments to be previewed in the display area.

Therefore, when displaying multiple plot preview information in the display area of the target video, plot preview information of plot segments around the current timeline moment can be displayed based on the current timeline moment, making the displayed plot preview information directly related to the current timeline moment and more focused.

As shown in Figure 8, the target video has 10 plot segments. At the current timeline moment, the plot preview information of plot segments 2, 3, and 4 is displayed (plot preview information 2 is highlighted at this time). When the timeline moment is adjusted to the right under the progress switch operation, the plot segments around the timeline moment become plot segments 4, 5, and 6. Correspondingly, the displayed plot preview information is updated to plot preview information 4, 5, and 6 (plot preview information 5 is highlighted at this time).

The above embodiments illustrate the implementation methods and processing flow of sliding operations that meet the triggering conditions in two progress switching operations. Next, we will explain the control-based triggering operation as a progress switching operation.

In one possible implementation, S201: Obtaining a progress switching operation for the target video through the display area of the target video, including:

S2013: Display the preview control through the display area.

S2014: In response to a trigger operation on the preview control, determine to obtain a progress switching operation for the target video.

When using a swipe gesture as a progress switch, the swipe gesture needs to be maintained throughout the timeline adjustment. The swipe gesture will only be canceled when the current timeline is determined to meet the viewing requirements, thus allowing the playback progress of the target video to jump. In other words, continuous operation is required during the adjustment period, and the display area will be more or less covered by the continuous operation object (such as a finger, stylus, etc.).

With the preview control-based approach, users do not need to perform continuous operations while the terminal device displays the plot preview information, allowing the plot preview information displayed in the display area to be observed more completely.

For example, as shown in Figure 9, by triggering the preview control, multiple plot preview information is displayed in the display area of the target video.

When a plot that meets the user's viewing needs is determined based on the plot preview information, the user can select the corresponding plot preview information to jump to the plot segment corresponding to that plot preview information for playback.

Therefore, in one possible implementation, the method further includes:

Obtain the selection operation for the first plot preview information among the multiple plot preview information; determine that the first plot preview information is selected.

This selection can be achieved by clicking on the first plot preview information, etc.

It should be noted that some target videos may contain a large number of plot segments, making it difficult to display the plot preview information of all plot segments through the display area of the terminal device. Therefore, the plot preview information displayed at the same time is only the plot preview information corresponding to a portion of the plot segments.

If the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video, in one possible implementation, the method further includes: in response to a sliding operation on the plurality of plot preview information, updating the plot preview information displayed in the display area according to the sliding parameters of the sliding operation.

In other words, users can adjust the currently displayed plot preview information by swiping in the area where the plot preview information is displayed. As shown in Figure 10, the target video has 10 plot segments. At the current timeline, the plot preview information for plot segments 2, 3, and 4 is displayed. When a swipe operation is performed to the left on the plot preview information, the displayed plot preview information is updated to plot preview information 4, 5, and 6.

In order to provide users with accurate references for switching playback progress based on plot preview information, it is necessary to identify high-quality plot segments in the target video. In other words, by segmenting the plot of the target video, if high-quality plot segments can be obtained, it can effectively guide users to consume the video.

To this end, embodiments of this application provide at least two methods for determining plot segments in a target video. The first method is based on plot segments determined by video processing methods, and the second method is based on historical user viewing data. The first method can be applied to target videos that have not yet been released and do not yet have historical user viewing data (it can also be applied to target videos that have already been released and have historical user viewing data). The second method can be applied to target videos that have historical user viewing data, and can also be used in scenarios where plot segments determined based on the first method are being optimized.

The second method will be described next. In one possible implementation, the method further includes:

S51: Determine the historical user viewing data of the target video.

S52: Determine the plot segments included in the target video based on the historical user viewing data.

Among them, historical user viewing data can reflect the viewing data generated when users watched the target video, and identify various operational behaviors based on watching the target video. Based on these operational behaviors, it can be determined which parts of the target video resonate with users and which parts users are more interested in. These parts should be considered high-quality parts of the target video and can be divided into plot segments.

Historical user viewing data may include at least one of the following: comment information, playback position switching information, or variable speed playback information.

If the historical user viewing data includes comment information, the aforementioned S52 includes:

Target comment information related to the plot is determined from the comment information; plot segments included in the target video are determined based on the first playback time parameter indicated by the target comment information.

Some comments may contain plot evaluations. If the specific time of the evaluated plot can be pointed to, it can be used as the target comment to identify the plot segment.

For example, common bullet comments are a type of comment information. Bullet comments are generally related to a specific playback time. Therefore, bullet comments that comment on the plot can be used as target comment information, and their associated playback time can be used as the first playback time parameter.

As shown in Figure 11a, the system extracts the empathy value of the content being played based on the comments posted by users in the target video, and then determines whether the segment is high-quality content. For example, if the comments are filled with phrases like "High energy ahead" or "Famous scene," the system determines that the scene is high-quality content that most users like to watch, and classifies this segment as a story segment.

If the historical user viewing data includes playback position switching information, the aforementioned S52 includes:

Determine the duration of continuous playback of the target video after the playback switching behavior corresponding to the playback position switching information; when the duration of continuous playback meets the playback conditions, determine the plot segments included in the target video according to the second playback time parameter indicated by the playback position switching information.

For example, parts that are frequently skipped in the playback history can be excluded from the plot segment classification, while parts that are frequently played normally can be classified as plot segments.

As shown in Figure 11b, if a user selects a storyline by swiping left or right, we can segment the storyline based on the user's behavior. Videos that the user swipes over are content they are not interested in. If the user locates content they are interested in and watches it for more than 1 minute, we can determine that the user is interested in this content and extract this segment as the storyline segment of the target video.

If the historical user viewing data includes variable speed playback information, the aforementioned S52 includes:

The playback speed switching behavior of the target video, which is accelerated and then slowed down, is determined from the variable speed playback information; the plot segments included in the target video are determined according to the third playback time parameter indicated by the playback speed switching behavior.

Users typically speed up video playback (e.g., 2x speed) for content they are not interested in, and slow it down (e.g., to 1x or 1.5x speed) when they reach parts they are interested in.

As shown in Figure 11c, if a user plays content at an accelerated speed but is not interested in it, the video content watched at this time will not be used as a plot segment. If the user cancels the accelerated playback or reduces the accelerated playback speed during the accelerated playback (shown in the figure, switching from 2x speed to 1.5x speed), it can be determined that the video content after cancellation is high-quality content that the user is interested in, and this segment will be used as a plot segment.

Figure 12 is a schematic diagram of a video playback system provided in an embodiment of this application, including a terminal device and a server as the backend of a content platform.

Terminal devices primarily function as input command providers:

The terminal device obtains the plot segment selected by the user through the swiping operation of the screen left and right, and displays it according to the plot preview information provided by the server. When the swiping operation is canceled, the selected plot preview information is determined, and the device jumps to the selected timeline to play the target video.

Server as the output:

Before determining the user's action from the terminal device, the server interprets, transcodes, and stores the existing video content in segments (plot details, time points/people/events/objects/stages/scenes and other plot-related connections), thus determining the plot segments of the target video and the corresponding plot preview information.

When the terminal device determines that the user is swiping on the target video's display interface, the server sends the stored plot preview information (in the form of visual text and images) to the terminal device. On the terminal device, the image of the selected plot preview information becomes larger, and the text changes to the system color to indicate that it is selected. At this time, the target video at the bottom does not pause playback. After swiping to select a plot segment, the video at the bottom will start playing.

Figure 13 is a flowchart of determining plot preview information provided in an embodiment of this application.

Firstly, segmented information can be configured through the client on the terminal device. Within this system, operators can configure the specific time information and content of the plot segments of the target video, generating a standardized data interface for the client to read.

Based on the specific time information and content of the configured plot segments, the system automatically analyzes the plot segments, selects frames suitable for use as thumbnails of video frames in the plot preview information, and stores them in image format in the specified object storage space.

Based on the foregoing embodiments, Figure 14 is a device structure diagram of a video playback device provided in an embodiment of this application. The video playback device 1400 includes an acquisition unit 1401, a display unit 1402, and a jump unit 1403.

The acquisition unit 1401 is used to acquire the progress switching operation for the target video through the display area of the target video;

The display unit 1402 is used to display multiple plot preview information in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes plot segments corresponding to the multiple plot preview information.

The jump unit 1403 is used to jump the target video to the first plot segment corresponding to the first plot preview information when it is determined that the first plot preview information among the plurality of plot preview information is selected.

In one possible implementation, the acquisition unit is further configured to:

Obtain the swipe operation by controlling the display area of the target video;

If the sliding operation meets the triggering condition, it is determined that the sliding operation is a progress switching operation for the target video, and the time axis time corresponding to the time axis of the target video is adjusted according to the sliding parameters of the progress switching operation. The time axis time is used to indicate the time to be played when the progress switching operation is canceled.

In one possible implementation, the display unit is further configured to:

If the timeline is within the playback time range of the second plot segment of the target video, the second plot preview information corresponding to the second plot segment will be highlighted in the display area relative to other displayed plot preview information.

In one possible implementation, the device further includes a determining unit:

The determining unit is used to determine that the progress switching operation is canceled when the second plot preview information is highlighted, and to determine the second plot preview information as the selected first plot preview information, and the second plot segment as the first plot segment;

The jump unit is also used to jump the target video to the start time of the first plot segment for playback; or, to jump the target video to the timeline moment when the progress switching operation is canceled for playback.

In one possible implementation, the device further includes a determining unit:

The determining unit is used to determine the key frame image of the second plot segment corresponding to the timeline moment during the process of highlighting the second plot preview information. The second plot segment includes multiple key frame images.

The display unit is also used to update and display the determined keyframe images as video frames in the second plot preview information.

In one possible implementation, the device further includes a determining unit:

The determining unit is used to determine the plot progress parameter corresponding to the playback time interval of the second plot segment when the time axis is highlighted during the process of highlighting the second plot preview information;

The display unit is also used to identify the plot progress parameters in the highlighted second plot preview information.

In one possible implementation, the device further includes a determining unit, which is used to determine, if the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video, during the process of adjusting the time axis time corresponding to the time axis time of the target video according to the sliding parameters of the progress switching operation, multiple plot segments in the target video whose playback time is before or after the adjustment position are determined as plot segments to be previewed based on the adjustment position of the time axis time in the time axis.

The display unit is also used to update and display the plot preview information corresponding to the segments to be previewed in the display area.

In one possible implementation, the display unit is further configured to:

The preview control is displayed in the display area;

In response to a trigger operation on the preview control, determine and obtain a progress switching operation for the target video.

In one possible implementation, the acquisition unit is further configured to:

Obtain the selection operation for the first plot preview information among the multiple plot preview information;

Confirm that the first plot preview information has been selected.

In one possible implementation, the display unit is further configured to, in response to a sliding operation on the plurality of plot preview information, update the plot preview information displayed in the display area according to the sliding parameters of the sliding operation if the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video.

In one possible implementation, the display unit is further configured to display multiple plot preview information in the display area via a navigation layer with transparency, wherein the navigation layer overlaps the display layer of the target video in the display direction.

In one possible implementation, the apparatus further includes a determining unit, the determining unit being configured to: determine the playback order of the plot segments corresponding to the plurality of plot preview information in the target video; and determine the display order of the plurality of plot preview information based on the playback order.

The display unit is also used for:

The multiple plot preview information are displayed in the display area according to the display order.

In one possible implementation, the apparatus further includes a determining unit, the determining unit being configured to:

Determine the historical user viewing data of the target video;

The target video includes plot segments determined based on the historical user viewing data.

In one possible implementation, the historical user viewing data includes at least one of comment information, playback position switching information, or variable speed playback information;

The determining unit is further configured to, if the historical user viewing data includes comment information, determine target comment information related to the plot from the comment information; and determine the plot segments included in the target video according to the first playback time parameter indicated by the target comment information;

The determining unit is further configured to, if the historical user viewing data includes playback position switching information, determine the continuous playback duration of the target video after the playback switching behavior corresponding to the playback position switching information; when the continuous playback duration meets the playback conditions, determine the plot segments included in the target video according to the second playback time parameter indicated by the playback position switching information.

The determining unit is further configured to, if the historical user viewing data includes variable speed playback information, determine from the variable speed playback information the playback speed switching behavior of the target video after being accelerated and then slowed down; and determine the plot segments included in the target video according to the third playback time parameter indicated by the playback speed switching behavior.

Therefore, in response to the progress switching operation of the target video obtained through the display area of the target video, multiple plot preview information of the plot segments included in the target video is displayed in the display area. Since the plot preview information includes the video footage and plot description text of the corresponding plot segment, the plot segments of the target video are displayed from multiple dimensions through images and text. This allows users to more accurately understand the specific information of multiple plot segments of the target video based on the rich information provided by the plot preview information, providing a more complete reference for users to select video content of interest from the target video. Therefore, when it is determined that the first plot preview information among multiple plot preview information is selected, when the target video jumps to the first plot segment corresponding to the first plot preview information for playback, the video content played is more likely to meet the user's needs, reducing the number of attempts for the user to find the required video content and saving processing resources.

This application also provides a computer device, which is the computer device described above, and may include a terminal device or a server. The aforementioned video playback device may be configured in this computer device. The computer device will now be described in conjunction with the accompanying drawings.

If the computer device is a terminal device, please refer to Figure 14. This application embodiment provides a terminal device, taking a mobile phone as an example:

Figure 15 shows a block diagram of a portion of the structure of a mobile phone related to the terminal device provided in the embodiments of this application. Referring to Figure 15, the mobile phone includes components such as a radio frequency (RF) circuit 1410, a memory 1420, an input unit 1430, a display unit 1440, a sensor 1450, an audio circuit 1460, a Wi-Fi module 1470, a processor 1480, and a power supply 1490. Those skilled in the art will understand that the mobile phone structure shown in Figure 15 does not constitute a limitation on the mobile phone and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

The following section, with reference to Figure 15, provides a detailed introduction to the various components of the mobile phone:

RF circuit 1410 can be used to receive and transmit signals during information transmission or calls. In particular, it receives downlink information from the base station and then processes it with processor 1480.

The memory 1420 can be used to store software programs and modules. The processor 1480 executes various functions and data processing of the mobile phone by running the software programs and modules stored in the memory 1420. The memory 1420 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.).

The input unit 1430 can be used to receive input numeric or character information, and to generate key signal inputs related to user settings and function control of the mobile phone. Specifically, the input unit 1430 may include a touch panel 1431 and other input devices 1432. The touch panel 1431, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel 1431), and drive the corresponding connected devices according to a pre-set program.

The display unit 1440 can be used to display information input by the user or information provided to the user, as well as various menus of the mobile phone. The display unit 1440 may include a display panel 1441, which may optionally be configured as a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

The mobile phone may also include at least one sensor 1450, such as a light sensor, a motion sensor, and other sensors.

Audio circuitry 1460, speaker 1461, and microphone 1462 provide an audio interface between the user and the mobile phone.

WiFi is a short-range wireless transmission technology. Through the WiFi module 1470, mobile phones can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access.

The processor 1480 is the control center of the mobile phone. It connects to various parts of the mobile phone through various interfaces and lines. It performs various functions of the mobile phone and processes data by running or executing software programs and/or modules stored in the memory 1420 and calling data stored in the memory 1420.

In this embodiment, the processor 1480 included in the terminal device also has the following functions:

The progress switching operation for the target video is obtained by measuring the display area of the target video;

Multiple plot preview information is displayed in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes the plot segments corresponding to the multiple plot preview information.

When it is determined that the first plot preview information among the multiple plot preview information is selected, the target video will be redirected to the first plot segment corresponding to the first plot preview information for playback.

If the computer device is a server, this application embodiment also provides a server, as shown in Figure 16. Figure 16 is a structural diagram of the server 1500 provided in this application embodiment. The server 1500 can vary significantly due to different configurations or performance, and may include one or more central processing units (CPUs) 1522 (e.g., one or more processors) and memory 1532, and one or more storage media 1530 (e.g., one or more mass storage devices) for storing application programs 1542 or data 1544. The memory 1532 and storage media 1530 can be temporary or persistent storage. The program stored in the storage media 1530 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 1522 may be configured to communicate with the storage media 1530 and execute the series of instruction operations in the storage media 1530 on the server 1500.

Server 1500 may also include one or more power supplies 1526, one or more wired or wireless network interfaces 1550, one or more input/output interfaces 1558, and/or one or more operating systems 1541, such as Windows Server ^™ , Mac OS X ^™ , Unix ^™ , Linux ^™ , FreeBSD ^™ , etc.

The steps performed by the server in the above embodiments can be based on the server structure shown in Figure 16.

In addition, this application embodiment also provides a storage medium for storing a computer program for executing the method provided in the above embodiment.

This application also provides a computer program product including instructions that, when run on a computer, cause the computer to perform the methods provided in the above embodiments.

Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium can be at least one of the following media: read-only memory (ROM), RAM, magnetic disk or optical disk, and other media that can store program code.

It should be noted that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiments. The device and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of the solution in this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.

The above description is merely one specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Moreover, based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims (18)

1. A video playback method, characterized in that the method comprises: The progress switching operation for the target video is obtained by measuring the display area of the target video; Multiple plot preview information is displayed in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes the plot segments corresponding to the multiple plot preview information. When it is determined that the first plot preview information among the multiple plot preview information is selected, the target video will be redirected to the first plot segment corresponding to the first plot preview information for playback. 2. The method according to claim 1, wherein obtaining the progress switching operation for the target video through the display area of the target video includes: Obtain the swipe operation by controlling the display area of the target video; If the sliding operation meets the triggering condition, it is determined that the sliding operation is a progress switching operation for the target video, and the time axis time corresponding to the time axis of the target video is adjusted according to the sliding parameters of the progress switching operation. The time axis time is used to indicate the time to be played when the progress switching operation is canceled. 3. The method according to claim 2, characterized in that the method further comprises: If the timeline is within the playback time range of the second plot segment of the target video, the second plot preview information corresponding to the second plot segment will be highlighted in the display area relative to other displayed plot preview information. 4. The method according to claim 3, characterized in that the method further comprises: When the second plot preview information is highlighted, it is determined that the progress switching operation is canceled, the second plot preview information is determined to be the selected first plot preview information, and the second plot segment is the first plot segment; The step of jumping to the target video and playing the first plot segment corresponding to the first plot preview information includes: The target video is redirected to the beginning of the first story segment for playback; or, the target video is redirected to the timeline moment when the progress switching operation was canceled for playback. 5. The method according to claim 3, characterized in that the method further comprises: During the process of highlighting the second plot preview information, the key frame images corresponding to the timeline moments of the second plot segment are determined, and the second plot segment includes multiple key frame images; The identified keyframe images are updated and displayed as video frames in the second plot preview information. 6. The method according to claim 3, characterized in that the method further comprises: During the process of highlighting the second plot preview information, the plot progress parameter corresponding to the playback time interval of the second plot segment at the time of the time axis is determined; The plot progress parameters are identified in the highlighted second plot preview information. 7. The method according to claim 2, wherein if the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video, the method further includes: During the process of adjusting the time axis moment corresponding to the time axis of the target video according to the sliding parameters of the progress switching operation, based on the adjustment position of the time axis moment in the time axis, multiple plot segments in the target video whose playback time is before and after the adjustment position are determined as segments to be previewed. The plot preview information corresponding to each of the segments to be previewed will be updated and displayed in the display area. 8. The method according to claim 1, wherein obtaining the progress switching operation for the target video through the display area of the target video includes: The preview control is displayed in the display area; In response to a trigger operation on the preview control, a progress switch operation for the target video is obtained. 9. The method according to claim 8, characterized in that the method further comprises: Obtain the selection operation for the first plot preview information among the multiple plot preview information; Confirm that the first plot preview information has been selected. 10. The method according to claim 8, wherein if the plot segments corresponding to the plurality of plot preview information are part of the plot segments in the target video, the method further comprises: In response to a swipe operation on the plurality of plot preview information, the plot preview information displayed in the display area is updated according to the swipe parameters of the swipe operation. 11. The method according to any one of claims 1-10, characterized in that, displaying multiple plot preview information in the display area includes: Multiple plot preview information are displayed in the display area through a navigation layer with transparency, and in the display direction, the navigation layer overlaps the display layer of the target video. 12. The method according to any one of claims 1-10, characterized in that the method further comprises: Determine the playback order of the plot segments corresponding to the multiple plot preview information in the target video; The display order of the multiple plot preview information is determined based on the playback sequence. The display area shows multiple plot preview information, including: The multiple plot preview information are displayed in the display area according to the display order. 13. The method according to any one of claims 1-10, characterized in that the method further comprises: Determine the historical user viewing data of the target video; The target video includes plot segments determined based on the historical user viewing data. 14. The method according to claim 13, wherein the historical user viewing data includes at least one of comment information, playback position switching information, or variable speed playback information; If the historical user viewing data includes comment information, the step of determining the plot segments included in the target video based on the historical user viewing data includes: Identify target comment information related to the plot from the aforementioned comment information; Based on the first playback time parameter indicated by the target comment information, determine the plot segments included in the target video; If the historical user viewing data includes playback position switching information, the step of determining the plot segments included in the target video based on the historical user viewing data includes: Determine the duration of continuous playback of the target video after the playback switching behavior corresponding to the playback position switching information; When the continuous playback duration meets the playback conditions, the plot segments included in the target video are determined according to the second playback time parameter indicated by the playback position switching information; If the historical user viewing data includes variable speed playback information, the step of determining the plot segments included in the target video based on the historical user viewing data includes: The playback speed switching behavior of the target video being played at a slower speed after being accelerated is determined from the variable speed playback information; The plot segments included in the target video are determined based on the third playback time parameter indicated by the playback speed switching behavior. 15. A video playback device, characterized in that the device comprises an acquisition unit, a display unit, and a jump unit: The acquisition unit is used to acquire the progress switching operation for the target video through the display area of the target video; The display unit is used to display multiple plot preview information in the display area. The plot preview information includes video footage of the corresponding plot segment and plot description text. The target video includes plot segments corresponding to the multiple plot preview information. The jump unit is used to jump the target video to the first plot segment corresponding to the first plot preview information when it is determined that the first plot preview information among the plurality of plot preview information is selected. 16. A computer device, characterized in that the computer device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is configured to execute the method described in any one of claims 1-14 according to the instructions in the program code. 17. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program, the computer program being used to perform the method described in any one of claims 1-14. 18. A computer program product comprising instructions that, when run on a computer, cause the computer to perform the method of any one of claims 1-14.