CN114302194B - Display device and playing method during multi-device switching - Google Patents

Abstract

This application provides a display device and a playback method when switching between multiple devices. The method can extract the protocol frame and the status value of the designated flag bit in the device information frame from the data stream after obtaining the signal source switching control command input by the user. Therefore, the playback modes required by the external device before and after switching are respectively detected according to the state value of the flag bit, so that when the required playback mode changes, the switching of the playback mode is performed. The method can automatically adapt to the data stream playback mode of the external device after switching, and can alleviate the problem that the playback mode does not match the audio and video data when multiple devices are switched.

Description

A display device and a playback method when switching between multiple devices

This application claims the priority of the Chinese patent application with the application number 202110046140.2 and the title of the invention "a display device and method for realizing adaptive parameters" submitted to the China Patent Office on January 14, 2021, the entire contents of which are incorporated by reference in In this application.

technical field

The present application relates to the technical field of smart TVs, and in particular to a display device and a playback method when switching between multiple devices.

Background technique

Smart TV is a TV product based on Internet application technology, with an open operating system and chip, and an open application platform, which can realize two-way human-computer interaction, and integrates multiple functions such as audio-visual, entertainment, and data. Diverse and individual needs. The smart TV is also provided with an interface of an external device for receiving a video signal and/or an audio signal sent by the external device and outputting the signal.

For example, a smart TV can be connected to a gaming device through an HDMI interface. During the user's use of the game device, the game device can output video data and audio data by running game-related programs. The video data and audio data can be sent to the smart TV through the HDMI protocol, and output through the screen and speakers of the smart TV to play the video and audio of the game device. In order to obtain better audio and video output effects, the smart TV can also adopt different playback modes for different external devices.

However, when multiple external devices are connected to the smart TV, the user can switch the audio and video data input to the smart TV by switching the signal source. However, the playback modes required by multiple external devices connected to the smart TV at the same time may be different, resulting in a mismatch between the playback mode of the smart TV and the input audio and video data after switching the signal source, reducing the output effect of the audio and video data.

Contents of the invention

The present application provides a display device and a playback method when switching between multiple devices, so as to solve the problem that the playback mode of a traditional display device does not match the audio and video data when switching between multiple devices.

In one aspect, the present application provides a display device, including a display, a controller, and multiple external device interfaces. Wherein, a plurality of external device interfaces are respectively configured to connect external devices, and the display is used for displaying a user interface and a media asset data screen sent by the external devices. The controller is configured to perform the following program steps:

Obtain a control command input by the user for switching the signal source;

Responding to the control instruction, receiving a data stream sent by an external device connected after switching the signal source, the data stream includes at least one of a protocol frame and a device information frame;

Extracting the status value of the flag bit in the protocol frame and/or the device information frame;

Switch the playback mode according to the state value of the flag bit.

On the other hand, the present application also provides a playback method during multi-device switching, which is applied to the above-mentioned display device, and the playback method during multi-device switching includes the following steps:

Obtain a control command input by the user for switching the signal source;

Responding to the control instruction, receiving a data stream sent by an external device connected after switching the signal source, the data stream includes at least one of a protocol frame and a device information frame;

Extracting the status value of the flag bit in the protocol frame and/or the device information frame;

Switch the playback mode according to the state value of the flag bit.

It can be known from the above technical solutions that the display device and the playback method when switching between multiple devices provided by the present application can extract the specified flag state value in the protocol frame and device information frame from the data stream after obtaining the signal source switching control command input by the user , so as to detect the playback mode required by the external device before and after switching according to the state value of the flag bit, so as to execute the switching of the playback mode when the required playback mode changes. The method can automatically adapt to the data stream playing mode of the external device after switching, and can alleviate the problem that the playing mode does not match the audio and video data when multiple devices are switched.

Description of drawings

In order to illustrate the technical solution of the present application more clearly, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, on the premise of not paying creative work, there are also Additional figures can be derived from these figures.

FIG. 1 is a usage scenario of a display device in an embodiment of the present application;

Fig. 2 is a block diagram of the hardware configuration of the control device in the embodiment of the present application;

FIG. 3 is a hardware configuration diagram of a display device in an embodiment of the present application;

FIG. 4 is a software configuration diagram of a display device in an embodiment of the present application;

FIG. 5 is a schematic diagram of a connection state between a display device and an external device in an embodiment of the present application;

FIG. 6 is a schematic diagram of a connection state between a display device and multiple external devices in an embodiment of the present application;

FIG. 7 is a schematic diagram showing the connection state of the device in the embodiment of the present application;

FIG. 8 is a schematic flow diagram of a playback method when switching between multiple devices in an embodiment of the present application;

Fig. 9 is a schematic diagram of extracting flag state values in the embodiment of the present application;

FIG. 10 is a schematic flow diagram of a display device switching playback modes in an embodiment of the present application;

FIG. 11A is a data relationship diagram when switching between an ALLM protocol device and a common HDMI device in the embodiment of the present application;

FIG. 11B is a schematic flow diagram of switching between an ALLM protocol device and a common HDMI device in the embodiment of the present application;

FIG. 12A is a data relationship diagram when switching between an SPD protocol device and a common HDMI device in the embodiment of the present application;

FIG. 12B is a schematic diagram of the process of switching between the SPD protocol device and the common HDMI device in the embodiment of the present application;

FIG. 13A is a data relationship diagram when switching between ALLM protocol equipment and SPD protocol equipment in the embodiment of the present application;

FIG. 13B is a schematic flow diagram of switching between the ALLM protocol device and the SPD protocol device in the embodiment of the present application.

Detailed ways

In order to make the purpose and implementation of the application clearer, the following will clearly and completely describe the exemplary implementation of the application in conjunction with the accompanying drawings in the exemplary embodiment of the application. Obviously, the described exemplary embodiment is only the present application. Claim some of the examples, not all of them.

It should be noted that the brief description of the terms in this application is only for the convenience of understanding the implementations described below, and is not intended to limit the implementations of this application. These terms are to be understood according to their ordinary and usual meaning unless otherwise stated.

The terms "first", "second", and "third" in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean limiting specific sequential or sequential unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprising" and "having", as well as any variations thereof, are intended to be inclusive but not exclusive, for example, a product or device comprising a series of components is not necessarily limited to all components expressly listed, but may include not expressly listed other components listed or inherent to these products or equipment.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly. Device 200. The user can control the display device 200 by inputting user instructions through at least one of buttons on the remote control, voice input, and control panel input.

In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR/VR device, and the like.

In some embodiments, the smart device 300 can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for data communication.

In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the module for obtaining voice commands configured inside the display device 200 can directly receive the user's voice command control , the user's voice command control can also be received through the voice control device provided outside the display device 200 .

In some embodiments, the display device 200 also performs data communication with the server 400 . The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The server 400 may be one cluster, or multiple clusters, and may include one or more types of servers.

In some embodiments, the software steps executed by one step execution body can be migrated to another step execution body for data communication with it for execution as required. Exemplarily, the software steps executed by the server can be migrated to be executed by the display device in data communication with it as required, and vice versa.

Fig. 2 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button or an alternative module.

FIG. 3 shows a block diagram of a hardware configuration of a display device 200 according to an exemplary embodiment.

In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.

In some embodiments the controller includes a CPU, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for presenting images, and a drive component for driving image display, for receiving image signals output from the controller, and displaying video content, image content, and menu manipulation interface. Components and user manipulation of the UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner-demodulator 210 receives broadcast TV signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or cable broadcast TV signals.

In some embodiments, the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220 .

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB) , RGB port, etc. any one or more interfaces. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box wait.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as hyperlinks, icons, or other operable controls. Operations related to the selected object include: displaying hyperlink pages, documents, images, etc., or executing the program corresponding to the icon.

In some embodiments, the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), RAM (Random AccessMemory, RAM), ROM (Read-Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.

CPU processor. It is used to execute the operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video content. A CPU processor may include multiple processors. For example, including a main processor and one or more sub-processors.

In some embodiments, the graphics processor is configured to generate various graphic objects, such as at least one of icons, operation menus, and user input instruction display graphics. The graphics processor includes an arithmetic unit, which performs calculations by receiving various interactive instructions input by users, and displays various objects according to display attributes; it also includes a renderer, which renders various objects obtained based on the arithmetic unit, and the above-mentioned rendered objects are used to be displayed on the display.

In some embodiments, the video processor is used to receive an external video signal and perform video decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. At least one of the processing can obtain a signal that can be directly displayed or played on the display device 200 .

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. Wherein, the demultiplexing module is used for demultiplexing the input audio and video data streams. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. An image synthesis module, such as an image synthesizer, is used to superimpose and mix the graphic generator with the zoomed video image according to the GUI signal input by the user or generated by itself, so as to generate an image signal available for display. The frame rate conversion module is used for converting the input video frame rate. The display formatting module is used to convert the received frame rate to the video output signal, and change the signal to conform to the display format signal, such as outputting RGB data signal.

In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, and perform at least one of processing such as noise reduction, digital-to-analog conversion, and amplification processing , to obtain a sound signal that can be played on a loudspeaker.

In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (Graphic User Interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. At least one of the view's interface elements.

In some embodiments, the user interface 280 is an interface that can be used to receive control input (such as: physical buttons on the display device body, or others).

In some embodiments, the system of the display device may include a kernel (Kernel), a command parser (shell), a file system and application programs. Together, the kernel, shell, and file system make up the basic operating system structure, and they allow users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signal and inter-process communication (IPC). After the kernel starts, the Shell and user applications are loaded. After the application is started, it is compiled into machine code to form a process.

Referring to Fig. 4, in some embodiments, the system is divided into four layers, from top to bottom are respectively the application (Applications) layer (abbreviated as "application layer"), application framework (Application Framework) layer (abbreviated as "framework layer") "), Android runtime (Android runtime) and system library layer (referred to as "system runtime layer"), and the kernel layer.

In some embodiments, there is at least one application program running in the application program layer, and these application programs can be window (Window) program, system setting program or clock program etc. that come with the operating system; they can also be developed by third-party developers. s application. During specific implementation, the application program packages in the application program layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to make the applications in the application layer take actions. Through the API interface, the application program can access the resources in the system and obtain the services of the system during execution.

As shown in Figure 4, in the embodiment of the present application, the application framework layer includes managers (Managers), content providers (Content Provider) etc., wherein the manager includes at least one of the following modules: Activity Manager (ActivityManager) and Interact with all activities running in the system; the Location Manager is used to provide system services or applications with access to the system location service; the Package Manager is used to retrieve the currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and removal of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers and desktops on the user interface part.

In some embodiments, the activity manager is used to manage the life cycle of each application program and the general navigation back function, such as controlling the exit, opening, back, etc. of the application program. The window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, capturing the screen, controlling the change of the display window (such as reducing the display window, shaking the display, distorting the display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library contained in the system runtime layer to realize the functions to be realized by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.

In this embodiment of the present application, connecting the display device 200 to the external device 500 refers to establishing a communication connection. The display device 200 and the external device 500 that have established a communication connection serve as a receiving end (sink end) and a sending end (source end) respectively. For example, the external device 500 can be a game device. When the user uses the game device, it can output video data and audio data in real time for the game process, and send the video data and audio data to the display device 200, so that the video data can be displayed through the display device 200. Data and audio data are output as video picture and sound. At this time, the game device acts as the sending end, and the display device 200 acts as the receiving end.

Between the sending end and the receiving end, a communication connection can be realized through a specific interface to transfer data. For this reason, data interfaces with the same interface specifications and functions should be provided on both the sending end and the receiving end. For example, as shown in FIG. 5 , both the display device 200 and the external device 500 are provided with a high-definition multimedia interface (High Definition Multimedia Interface, HDMI). During use, the user can respectively insert the two ends of the HDMI interface data cable into the display device 200 and the external device 500, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to be the HDMI interface. , realizing data transmission between the display device 200 and the external device 500 .

After the display device 200 establishes a connection relationship with the external device 500, it can receive video data and/or audio data sent by the external device 500 in real time for output. In the embodiment of the present application, for the convenience of description, the video data and audio data sent by the external device 500 to the display device 200 are collectively referred to as media asset data.

It should be noted that, in order to realize the communication connection between the display device 200 and the external device 500 , other connection manners may also be adopted between the display device 200 and the external device 500 . The specific connection method can be a wired connection method, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; it can also be a wireless connection method, such as wireless LAN, Bluetooth connection, infrared connection wait. Different communication connection methods may adopt different information transfer protocols, for example, when an HDMI interface is used for connection, an HDMI protocol may be used for data transmission.

During operation, the external device 500 can send video data and/or audio data in real time according to usage conditions. The video data and audio data sent by the external device 500 need to adapt to the corresponding playback mode in different usage scenarios, so as to obtain better image quality and sound quality. To this end, the display device 200 may have multiple built-in playback modes, and different playback modes have their own decoding parameters and processing algorithms to obtain different image quality and sound quality effects.

For example, the playback modes supported by the display device 200 may include a low-latency mode (Low-latency Mode, LLM) and a high-quality mode (High Image Quality Mode, HIQM). For an external device 500 such as a game console, since the game screen needs to maintain good fluency and response speed, when using the display device 200 to output the game screen, the display device 200 can be controlled to switch to a low-latency mode. In the low-latency mode, the display device 200 can disable some image quality processing programs, such as disabling frame interpolation algorithms, noise reduction processing, super-resolution algorithms, etc., to reduce image processing time and image display delay. For external devices 500 such as set-top boxes, compared with game screens, video and video images pay more attention to image quality and do not require too fast display response speed. Switch to high-quality mode to enable all picture-quality processing programs such as frame insertion algorithm, noise reduction processing, and super-resolution algorithm to obtain better picture effects.

Since the display device 200 and the external device 500 belong to different types of devices, the user usually cannot directly control the display device 200 through the external device 500 . For example, when a user connects a smart TV to a game device through an HDMI interface, the game device is responsible for running the game application and forming video data and audio data according to user interaction, while the smart TV can only passively obtain the audio data output by the game device And video data, the game device cannot directly adjust the playback mode of the smart TV, causing the playback mode to be inconsistent with the usage scene, affecting the audio and video output effect.

In order to adapt to different usage scenarios, in some embodiments, some external devices 500 may support an automatic control protocol, such as an automatic low-latency mode (Auto Low-latency Mode, ALLM) protocol. The automatic low-latency mode protocol can be automatically started by the source side according to preset rules or prohibited from running the low-latency mode on the sink side without manual settings by the sink side user. For example, when a user receives a video call while watching a movie, the external device 500 as the source end will automatically stop playing the movie, and notify the sink end display device 200 to switch to a low-latency mode to ensure real-time interactive performance of the video call. After the user finishes answering the video call, the external device 500 at the source end may resume the movie playing process, and notify the display device 200 at the sink end to exit the low-latency mode.

Therefore, the data stream is not limited to the above video data and audio data, but also includes other data transmitted between the display device 200 and the external device 500, such as auxiliary information such as device information and protocol information. Media asset data can form a data stream through multiple consecutive frames, that is, the data stream can include multiple data frames, such as display image data frames, device information frames, and so on. The data stream sent by the external device 500 supporting the automatic control protocol may also include data frames such as protocol frames.

In some embodiments, as shown in FIG. 6 , multiple external device interfaces 240 may be provided on the display device 200 , and the multiple external device interfaces 240 may be respectively connected to different external devices 500 . For example, the display device 200 may be provided with two HDMI interfaces, namely HDMI1 and HDMI2. Among them, the HDMI 1 interface is connected to the game device, and the HDMI 2 interface is connected to the set-top box. During use, both the game device and the set-top box can send data streams to the display device 200, but the display device 200 can only play the data stream sent by one of the devices at the same time.

In this regard, when the display device 200 is connected to multiple external devices 500 through multiple external device interfaces 240 , the user needs to perform a signal source switching operation to control the display device 200 to select and output the data stream of any external device 500 . For example, when the display device 200 outputs the data stream of the game device with the HDMI1 interface, the display device 200 can be controlled to output the data stream of the set-top box with the HDMI2 interface by switching the signal source operation. Similarly, when the display device 200 outputs the data stream of the set-top box with the HDMI2 interface, the display device 200 can be controlled to output the data stream of the game device with the HDMI1 interface by switching the signal source operation.

Different external devices 500 require different playback modes. For example, when playing the data stream of a game device, the display device 200 needs to adopt a low-latency mode, while when playing a data stream of a set-top box, the display device 200 needs to adopt a high-quality mode. It can be seen that when the display device 200 performs the signal source switching function, the playback mode of the display device 200 after switching may not match the playback mode required by the external device 500, which affects the output quality of the switched data stream. For example, after the signal source of the display device 200 is switched from HDMI1 to HDMI2, the display device 200 outputs the data stream corresponding to the set-top box, but at this time the playback mode of the display device 200 is still the low-latency mode suitable for the game device, resulting in The stream will not be processed by the display device 200 to degrade the picture quality.

Therefore, during the process of switching the signal source, the display device 200 may also switch the playback mode according to the switching process. That is, as shown in FIG. 7 , in some embodiments of the present application, a display device 200 is also provided, and the display device 200 includes a display 275 , a controller 250 and a plurality of external device interfaces 240 . Wherein, a plurality of external device interfaces 240 are respectively connected to different external devices 500 , and the display 275 is used for displaying a user interface and displaying media asset data screens sent by the external devices 500 . The controller 250 is configured to execute the playing method when switching between multiple devices in this application, so as to match the switched playing mode with the external device 500 and improve the output quality of the media data.

Specifically, as shown in FIG. 8 , the display device 200 may first acquire a control instruction input by a user for switching signal sources. The user may input an interactive action through the control device 100 such as a remote control or a mobile phone to control the display device 200 to switch signal sources. For example, the user can make the display device 200 switch between multiple signal sources by pressing the "signal source" button on the remote controller. Since each signal source may correspond to one external device 500 , the process of switching the signal source is performed, that is, the process of switching the external device 500 connected to the display device 200 .

The display device 200 can also provide an option to switch signal sources in the operating system control interface. When the user clicks this option through the mobile phone or remote control input interaction action, the display device 200 can jump to the signal source list, and then click the signal source list One of the options, the display device 200 is switched to output the audio and video data of the corresponding option. For example, if the user clicks on the signal source switching option through the main control interface or the status bar, a signal source list will pop up, and the signal source list may include options such as "HDMI1" and "HDMI2". After clicking the HDMI2 option, the signal source of the display device 200 can be switched to the external device 500 connected to the HDMI2 interface.

For the display device 200 that supports other interactive modes, a control instruction for switching signal sources may also be input through the supported input modes. For example, for the display device 200 supporting the intelligent voice system, the display device 200 can be controlled to switch the signal source by inputting contents such as "switch signal source" and "connect HDMI2" by voice.

In addition, since in practical applications, the display device 200 can only output media data for one external device 500, in order to save energy, among the multiple external devices 500 connected to the display device 200, no external connection for outputting media data data through the display device 200 The device 500 is usually in a closed or standby state. At this time, it will not send media data to the display device 200, but when it wants to output media data through the display device 200, it is usually activated to send a data stream to the display device 200. Therefore, in practical applications, the display device 200 can also detect the data input situation of each external device interface 240 in real time, and when any external device interface 240 is detected to have a data stream input, the signal source is automatically switched to the external device interface 240 .

After receiving the control instruction for switching the signal source, the display device 200 may receive the data stream sent by the external device 500 through the external device interface 240 in response to the control instruction. For example, when the HDMI1 interface of the display device 200 is connected to a game device and the HDMI2 interface is connected to a set-top box, the display device 200 can output the data stream of the HDMI1 interface by default, that is, the display device 200 can receive the data stream sent by the game device through the HDMI1 interface, such as game screen data etc.; after receiving the signal source switching control command input by the user, the display device 200 switches to output the data stream of the HDMI2 interface, that is, the data stream sent by the receiver set-top box through the HDMI2 interface, such as live TV screen data.

The data stream can be sent from the external device 500 to the display device 200 through multiple consecutive frames to form a data stream. The display device 200 forms a specific display picture by continuously analyzing and rendering the data stream. Since some interactive control can be performed between the display device 200 and the external device 500, the data stream received by the display device 200 includes not only content frame data providing video or audio images, but also device information frames, protocol frames, etc. Process-related frame data, that is, the data stream includes at least one of protocol frames and device information frames.

Among them, the device information frame is sent by the external device 500 according to the basic transmission protocol, and contains the data frame of the device type information; the protocol frame is sent by the external device 500 according to the automatic control protocol, and contains the data frame of the use scene information. For different external devices 500, the frame data related to the transmission process included in the data streams sent by them is also different. For example, for most external devices 500, the device information frame may be a source device description (Source Product Description, SPD) data frame specified in the HDMI protocol to describe the information of the device itself. Therefore, the external device 500 connected to the display device 200 through the HDMI interface can carry the SPD data frame in the data stream. The device information frame may include relevant information for describing the current external device 500, such as device name, device type, etc., and the display device 200 may identify the connected external device 500 by reading the device information frame.

For some external devices 500 that support the automatic control protocol, while sending the device information frame to the display device 200 , they can also send the protocol frame. For example, the external device 500 supporting the ALLM protocol can generate protocol frame data based on the ALLM protocol, and send it to the display device 200 together with the content frame and the SPD frame. Protocol frame data can include content related to automatic control, such as control instructions. The display device 200 can switch the playback mode according to the control instruction in the protocol frame. The protocol frame may also include current usage scene information of the external device 500, such as game scene and non-game scene.

After receiving the data stream sent by the external device 500, the display device 200 can also extract the protocol frame and/or device information frame in the data stream, and read the status value of the flag bit in the protocol frame and/or device information frame. Wherein, the flag bit refers to a specific data position in the device information frame and/or protocol frame. According to the data arrangement method stipulated in the transmission protocol, in the data frame received by the display device 200, each data used to represent a specific meaning is set at a specific position, and its specific state is represented by different state values.

For example, for the SPD data frame, the 25th byte (data byte 25) is the device classification, and the corresponding state value on the 25th byte represents the device type of the external device 500, as shown in the table below, different states Values can represent different device types:

data byte 25 Equipment type data byte 25 Equipment type 00 unknown device 07 VCD 01 set top box 08 gaming equipment 02 dvd player 09 computer 03 VCR 0A Blu-ray player 04 HDD recorder 0B digital record player 05 DVC camera 0C HD DVD 06 industrial computer 0D multimedia player

Based on the above table, the display device 200 can read the status value of the flag bit from it to obtain the type of the external device 500 connected to the display device 200 after switching the signal source. For example, when it is read that the device classification value at a specific byte position is "08", it means that the external device 500 connected to the display device 200 is a game device.

As for the protocol frame, the display device 200 may further extract the current use scene of the external device 500 . For example, for a game device supporting the ALLM protocol, when it is detected that the ALLM value in the protocol frame is equal to 1, it means that the external device 500 is in a game scene; when the ALLM value is equal to 0, it means that the external device 500 is in a non-game scene.

For the external device 500 that supports multiple usage scenarios, some additional data fields may be defined to indicate each usage scenario. For example, the usage scenario information of the external device 500 can be represented by multiple bits reserved in the HDMI specification. For computer equipment, two bits reserved in the HDMI specification can be used to indicate usage scenarios, including: Rsvd1=0 and Rsvd0=0 represent game scenarios; Rsvd1=0 and Rsvd0=1 represent instant communication scenarios; Rsvd1=1 and Rsvd0=0 represents an office scene, Rsvd1=1 and Rsvd0=1 represent a sports scene and so on.

Correspondingly, the display device 200 can obtain the protocol frame data, and traverse the parameter values (state values) on multiple bits in the protocol frame data. In this way, the current use scene information is read according to the combination of parameter values on multiple bits. For example, the display device 200 can read the parameter value on the two bits specified in the protocol frame. When reading Rsvd1=0 and Rsvd0=0, it is determined that the current computer device is in the game scene. When reading Rsvd1= 1 and Rsvd0=1, it is determined that the current computer device is in a sports scene such as watching a ball game.

After receiving the data stream, the display device 200 can detect the device type or usage scene of the external device 500 after switching the signal source by extracting the status value of the flag bit in the protocol frame and/or device information frame. In this way, the playback mode is switched according to the state value of the flag bit. When the device type or usage scene of the external device 500 changes before and after switching, the display device 200 may switch the playback mode according to the external device 500 after switching.

For example, when the user inputs a control command to switch the corresponding output data stream of the display device 200 from the HDMI1 game device to the HDMI2 set-top box, since the game device is suitable for low-latency mode, and the set-top box is suitable for high-quality mode, therefore, through the device information After the state value of "data byte 25" is switched from "08" to "01" after the frame is read, it is necessary to switch the playback mode of the display device 200 from the low-latency mode to the high-quality mode.

It can be seen that the display device 200 provided in the above embodiment can receive the data stream sent by the external device 500 after the user inputs the control command to switch the signal source, and extract the flag status of the protocol frame and/or device information frame from it. Value, detect whether the device type or usage scene of the external device 500 changes before and after switching, and switch the playback mode according to the state value of the flag bit, so that the display device 200 can automatically adapt to the data stream playback mode of the external device 500 after switching, and ease the switching of multiple devices The problem that the playback mode does not match the audio and video data.

Since the frame data carried in the data streams sent by different types of external devices 500 are different, different data extraction methods need to be used when extracting the status value of the flag bit in the protocol frame and/or device information frame. To this end, as shown in FIG. 9 , in some embodiments, the display device 200 can identify the device type of the external device 500, that is, it can extract the device information frame from the data stream, and traverse the flag status in the device information frame value, and then detect the device type of the external device 500 before and after switching the signal source according to the status value of the flag bit, so as to realize extracting the status value of the flag bit in the protocol frame and/or device information frame according to the device type.

Among them, according to the different transmission protocols supported by the external device 500, the external device 500 can be divided into three categories, namely automatic control protocol devices, general protocol devices and common interface devices. Wherein, the automatic control protocol device refers to a device supporting an automatic control protocol such as the ALLM protocol, for example, an xbox game console, a computer, and the like. The automatic control protocol device can directly send a control instruction to the display device 200 through the automatic control protocol, so that it can switch the playing mode.

Common protocol devices refer to devices that do not support automatic control protocols but support basic transmission protocols, such as PS game consoles, set-top boxes, etc. General-purpose protocol devices generally cannot directly send control commands to the display device 200 , so the playback mode can be switched by classifying devices or recognizing scenes.

Ordinary interface devices refer to devices that neither support automatic control protocols nor general transmission protocols, and are usually output and output devices with single functions and simple data forms, such as cameras and microphones. Ordinary interface devices usually do not need a specific playback mode, and the output mode set by the user can meet the output requirements of the data stream.

Based on the above device type, after the display device 200 detects the switched device type, it can extract the status value of the flag bit from the data stream according to the device type. For example, when the switching signal source is detected, the external device 500 connected to the display device 200 is an automatic control protocol device, then the protocol frame needs to be extracted from the data stream, so as to determine the current usage scene of the external device 500 through the protocol frame, and according to The currently used scene switches the playback mode. When the switching signal is detected and the external device 500 connected to the display device 200 is a general-purpose protocol device, the device category is extracted from the device information frame, so as to switch the playback mode according to the device category. After detecting that the signal source has been switched, if the external device 500 connected to the display device 200 is a common interface device, the playback mode can be directly restored to a user-defined mode.

As shown in FIG. 10 , in some embodiments, in order to facilitate the display device 200 to switch playback scenes, a playback mode switching program can be set in the display device 200, and the mode switching program can include a parsing thread and an image middleware, wherein the parsing thread can be It is a loop body, which is used to detect the status value of the flag bit in the device information frame and protocol frame in the data stream in real time. Therefore, the parsing thread includes a protocol frame parsing thread and a device information frame parsing thread. The image middleware is used to switch the playback mode for the state value according to the flag detected by the parsing thread. The parsing thread and the image middleware can be two independent program modules, which can call each other through the software interface to complete the switching of playing scenes.

Therefore, in the process of switching the playback mode according to the status value of the flag bit, the display device 200 can first call the analysis thread to utilize the analysis thread to monitor the status value of the flag bit of the protocol frame and/or device information frame. If the status value changes, the interface label value can be set according to the status value change of the flag bit, so that the image middleware can obtain the interface label value and switch the playback mode according to the interface label value. Among them, in order to facilitate the judgment of the image middleware, the interface tag value can include the automatic control protocol tag value and the general protocol tag value, and the values of the two tag values are both 1 or 0. The middleware needs to switch the playback mode to a specific mode; when the tag value is equal to 0, it means that the image middleware does not need to switch the playback mode to a specific state, and returns to the user setting.

The mode of switching the playback mode according to the status value of the flag bit in this application will be described below in conjunction with several switching scenarios of the external device 500, mainly including:

In some embodiments, if the device types before and after switching the signal source are common interface devices and automatic control protocol devices, the display device 200 may extract the first status value from the flag bit of the protocol frame. That is, the display device 200 can identify whether the external device 500 supports the automatic control protocol before and after switching from the protocol frame. If the first status value is 1, it means that the external device 500 connected to the display device 200 after switching supports the automatic control protocol, so the playback mode can be switched to the automatic control mode. Similarly, if the obtained first status value is 0, it means that the external device 500 connected to the display device 200 after switching the signal source is a common interface device that does not support the automatic control protocol, so the playback mode can be switched to the user setting mode.

For example, as shown in Figure 11A and Figure 11B, in the process of switching between ALLM protocol devices and ordinary HDMI devices, if switching from ordinary HDMI devices to ALLM protocol devices, first detect the ALLM state analysis thread loop body to read the ALLM state Change to ALLM=1, then call the image middleware ALLM interface tag value, set the ALLM tag value to 1, so that the image middleware gets the ALLM tag value to 1, and then adjust the display device 200 to enter the low-latency mode. If switching from the ALLM protocol device to the common HDMI device, first detect the ALLM state analysis thread loop body to read the ALLM state change as ALLM=0; then call the image middleware ALLM interface tag value, and set the ALLM tag value to 0, so that After the image middleware obtains the ALLM tag value of 0, it adjusts the display device 200 to exit the low-latency mode and restore the user settings.

Since some of the external devices 500 that support the automatic control protocol can be in multiple usage scenarios, in order to achieve more detailed control, after controlling the display device 200 to enter the automatic control mode, it is also possible to further switch more according to the usage scenarios according to the automatic control protocol. play mode. That is, if the first status value is 1, the display device 200 may periodically acquire multiple protocol frames from the data stream, and extract the status value combination from the reserved flag bits in the protocol frames. The combination of status values is the combination of status values of multiple reserved flag bits in the protocol frame, which can be used to represent the usage scenarios of the external device 500 . Therefore, the display device 200 can query the use scene of the external device 500 through the combination of state values, and control to switch the playback mode to a mode suitable for the use scene.

For example, the display device 200 can determine that the external device 500 is currently in the game scene when it reads Rsvd1=0 and Rsvd0=0 by reading the state value on the two bits specified in the protocol frame, so the playback mode can be set to Adjust to low latency mode.

It can be seen that in the above embodiment, the display device 200 can adjust the playback mode when switching between the common interface device and the automatic control protocol device by detecting the state value of the flag bit in the protocol frame, so that the display device 200 after switching The playback mode can immediately adapt to the external device 500, ensuring that the display device 200 can normally output data streams after switching.

In some embodiments, if the device types before and after switching the signal source are common protocol devices and common interface devices, the display device 200 can extract the second status value from the flag bit of the device information frame, and obtain the current status according to the second status value. The device type indicated by the state value, so as to switch the playback mode according to the device type.

For example, as shown in FIG. 12A and FIG. 12B, when the external device 500 connected to the display device 200 switches between the SPD protocol device and the common HDMI device, if the switch is from the normal HDMI device to the SPD protocol device, the display device 200 will You can first detect the change of the SPD frame information read by the SPD state analysis thread loop body, so as to determine whether the switched device type is a game device or a PC device. Then call the image middleware SPD interface, and set the SPD tag value to 1, so that the image middleware adjusts the display device 200 to enter the low-latency mode after obtaining the flag bit 1.

If switching from an SPD protocol device to a common HDMI device, the display device 200 reads the SPD state change by detecting the SPD state analysis thread loop body, and determines that the switched device type is not a game device or a PC device. Then call the SPD interface of the image middleware, and set the SPD tag value to 0, so that after the image middleware obtains the tag value of 0, adjust the display device 200 to exit the low-latency mode and restore the user settings.

It can be seen that when switching between a general-purpose protocol device and a common interface device, the display device 200 can automatically detect the device type of the external device 500 by reading the status value of the flag bit in the device information frame, so as to switch the playback mode according to the device type. Obviously, the general protocol devices can be further classified, that is, the general protocol devices can include a first type of device adapted to one playback mode and a second type of device adapted to multiple playback modes. Therefore, after detecting the switch to the general-purpose protocol device, the display device 200 can further detect the device classification it refers to according to the second state value, and if the device is classified as the first type of device, then switch the playback mode to be the same as the first type of device. Appropriate playback mode.

And if the device is classified as the second type of device, in order to balance the playback effect, the display device 200 can be controlled to switch the playback mode to the user setting mode. That is, after switching the signal source to a second-type device that adapts to multiple playback modes, the data stream can be output through the user-defined playback mode, so that the external device 500 can output the data stream according to the user's preferences when it is in any use scene .

In some embodiments, for the second type of device adapting to multiple playback modes, the display device 200 can also identify the use scene of the external device 500 through image recognition, AI algorithm, etc., so as to switch the playback mode according to the scene recognition result. model. That is, if the device is classified as the second type of device, the display device 200 can extract multiple frames of display images from the data stream, and perform scene recognition on the multiple frames of display images to obtain the usage scenarios of the external device 500, and finally, according to the recognized usage scenarios Switch the playback mode to adapt the playback mode to the usage scene.

In order to realize scene recognition, the display device 200 may extract display images from the data stream, and input the extracted display images into the scene recognition model, so as to obtain scene information output by the scene recognition model. Wherein, the scene recognition model is a neural network model obtained through training of sample images. The sample image is an image used for training, including display images in multiple usage scenarios supported by the external device 500 and a usage scenario label corresponding to each display image. As a classification model, the scene recognition model can calculate the classification probability of the displayed image through the neural network algorithm inside the model after inputting the displayed image, that is, the usage scene to which the displayed image corresponds.

Apparently, a scene recognition model can be built in the display device 200 before the detection of the automatic control protocol is executed. For example, the scene recognition model can be obtained by performing neural network model training, that is, an initial model can be constructed first, and then sample images can be input to the initial model one by one to obtain model output results. Then compare the model output results with the label information to determine the classification error, and adjust the model parameters using classification failure backpropagation. Based on this, by inputting a certain number of sample images multiple times, the model parameters can be gradually adjusted to finally obtain a scene recognition model with higher accuracy.

After building the scene recognition model, the display device 200 may input the display image extracted from the data stream into the scene recognition model to obtain a scene recognition result. Depending on the type of the external device 500 connected to the display device 200 , the types of recognition results that the scene recognition model can output are also different. For example, for game devices, the use scene information that the scene recognition model can output includes game scenes and non-game scenes; and for computer equipment, the use scenes that the scene recognition model can output include game scenes, instant messaging scenes, office scenes, and sports scenes, etc. . Therefore, when performing scene recognition, different scene recognition models may also be invoked for different types of external devices 500 to obtain appropriate scene classifications.

It can be seen that in this embodiment, by performing scene recognition on multi-frame display images, the use scene of the external device 500 can also be detected, so that when the signal source is switched to a general-purpose protocol device, the playback can also be switched according to the use scene of the external device 500 mode, so that the display device 200 can adjust the playback mode in real time following the use of the external device 500 to output a better data stream playback effect.

In some embodiments, if the device types before and after switching the signal source are general-purpose protocol devices and automatic control protocol devices, the display device 200 can respectively extract the first state value from the flag bits of the protocol frame, and extract the first state value from the flag bits of the device information frame. For the second state value, when the first state value is 1 and the device indicated by the second state value is classified as the first type of device, switch the playing mode to the automatic control mode.

For example, as shown in Fig. 13A and Fig. 13B, when the ALLM protocol device and the SPD protocol device are switched to each other, if the ALLM protocol device is switched to the SPD protocol device, the display device 200 can first detect the SPD parsing state thread loop body reading When the SPD frame information changes, determine whether it is a game device or a PC device, then call the image middleware SPD interface, and set the SPD interface tag value to 1, so that the image middleware obtains the SPD tag value as 1 and judges that the ALLM tag value is also When it is 1, keep the display device 200 entering the low-latency mode.

If it is switched from the SPD protocol device to the ALLM protocol device, the display device 200 first detects that the ALLM state analysis thread loop body reads the ALLM state change, that is, ALLM=1, then calls the image middleware ALLM interface, and sets the ALLM tag value to 1. Make the image middleware keep the display device 200 in the low-latency mode after acquiring the value of the ALLM tag to be 1 and determining that the value of the SPD tag is also 1.

It should be noted that during the process of switching between the signal source being a general-purpose protocol device and an automatic control protocol device, the display device 200 can extract the protocol frame from the data stream after the signal source is switched. If the protocol frame is extracted and the extracted If the protocol frame contains the use scene information, the playback mode can be controlled according to the automatic control protocol; if the protocol frame is not extracted or the extracted protocol frame does not contain the use scene information, the device information frame can be extracted, and according to The device information frame extracts the device type of the external device 200, so as to switch the playback mode according to the device type. If the device information frame is not extracted in the data stream, it can be determined that the switched external device 500 is a common interface device, so the playback mode can be switched to a user-defined mode, so that the display device 200 can automatically adapt to the signal source switching process. Equipped with playback mode to ensure the output quality of media data.

Based on the above-mentioned display device 200, in some embodiments of the present application, a playback method for multi-device switching is also provided. The playback method can be applied to the above-mentioned display device 200, and includes the following steps: the display device 200 first obtains the user input Control commands for switching signal sources. Responding to the control instruction, the data stream sent by the external device is received, wherein the data stream includes at least one of a protocol frame and a device information frame. Then extract the status value of the flag bit from the protocol frame and/or the device information frame, so as to switch the playback mode according to the status value of the flag bit.

As can be seen from the above technical solutions, the playback method provided by the above embodiment when switching between multiple devices can extract the specified flag status value in the protocol frame and device information frame from the data stream after obtaining the signal source switching control command input by the user, so that The playback modes required by the external device before and after switching are respectively detected according to the state value of the flag bit, so that when the required playback mode changes, the switching of the playback mode is performed. The method can automatically adapt to the data stream playback mode of the external device 500 after switching, and can alleviate the problem that the playback mode does not match the audio and video data when switching between multiple devices.

The similar parts between the embodiments provided in the present application can be referred to each other, and the specific implementations provided above are only a few examples under the general concept of the present application, and do not constitute a limitation of the protection scope of the present application. For those skilled in the art, any other implementations expanded based on the proposal of the present application without creative work shall fall within the scope of protection of the present application.

Claims (9)

1. A display device, characterized by comprising:

a display;

a plurality of external device interfaces configured to connect to external devices, respectively;

a controller configured to:

acquiring a control instruction input by a user and used for switching a signal source;

responding to the control instruction, receiving a data stream sent by an external device connected after switching a signal source, wherein the data stream comprises at least one of a protocol frame and a device information frame;

extracting a device information frame from the data stream;

traversing the status value of the zone bit in the equipment information frame;

detecting the equipment types of external equipment before and after switching the signal source according to the flag bit state value, wherein the equipment types comprise automatic control protocol equipment, universal protocol equipment and common interface equipment;

Extracting a flag bit state value in the protocol frame and/or the equipment information frame according to the equipment type;

switching a play mode based on an interface tag value when the flag bit state value changes; the interface tag value is obtained through the image middleware.

2. The display device according to claim 1, wherein if the device types before and after switching the signal source are a normal interface device and an automatic control protocol device, the controller is further configured to:

extracting a first state value from a flag bit of the protocol frame;

if the first state value is 1, switching the playing mode to an automatic control mode;

and if the first state value is 0, switching the playing mode to a user setting mode.

3. The display device of claim 2, wherein if the first status value is 1, the controller is further configured to;

periodically extracting a state value combination from reserved zone bits in the protocol frame;

inquiring a use scene of the external equipment by using the state value combination;

and switching the playing mode to a mode which is suitable for the use scene.

4. The display device according to claim 1, wherein if the device types before and after switching the signal source are a common protocol device and a normal interface device, the controller is further configured to:

Extracting a second state value from the flag bit of the equipment information frame;

acquiring the equipment type pointed by the second state value;

and switching the playing mode according to the equipment type.

5. The display device of claim 4, wherein in the step of switching the play mode according to the device type, the controller is further configured to:

detecting the equipment classification pointed by the second state value, wherein the equipment classification comprises first equipment adapting to one play mode and second equipment adapting to multiple play modes;

if the equipment is classified as first equipment, switching a playing mode to be a playing mode which is suitable for the first equipment;

and if the equipment is classified into the second type equipment, switching the playing mode into a user setting mode.

6. The display device of claim 5, wherein if the device is classified as a second class of devices, the controller is further configured to:

extracting multi-frame display images from the data stream;

performing scene recognition on the multi-frame display image to obtain a use scene of the external equipment;

and switching the playing mode to a mode which is suitable for the use scene.

7. The display device according to claim 1, wherein if the device types before and after switching the signal source are a universal protocol device and an automatic control protocol device, the controller is further configured to:

extracting a first state value from a flag bit of the protocol frame and extracting a second state value from a flag bit of the device information frame;

if the first state value is 1 and the equipment pointed by the second state value is classified as first equipment, switching the playing mode to be an automatic control mode.

8. The display device of claim 1, wherein in the step of switching play modes based on interface tag values when the flag bit status value changes, the controller is further configured to:

calling an analysis thread, wherein the analysis thread comprises a protocol frame analysis thread and an equipment information frame analysis thread;

monitoring the status value of the flag bit of the protocol frame and/or the equipment information frame by utilizing the analysis thread;

if the status value of the flag bit changes, setting an interface tag value;

and acquiring the interface tag value by utilizing the image middleware so as to switch the playing mode according to the interface tag value.

9. The playing method during multi-device switching is characterized by being applied to display equipment, wherein the display equipment is connected with at least two external devices, and the playing method during multi-device switching comprises the following steps:

Acquiring a control instruction input by a user and used for switching a signal source;

responding to the control instruction, receiving a data stream sent by an external device connected after switching a signal source, wherein the data stream comprises at least one of a protocol frame and a device information frame;

extracting a device information frame from the data stream;

traversing the status value of the zone bit in the equipment information frame;

detecting the equipment types of external equipment before and after switching the signal source according to the flag bit state value, wherein the equipment types comprise automatic control protocol equipment, universal protocol equipment and common interface equipment;

extracting a flag bit state value in the protocol frame and/or the equipment information frame according to the equipment type;

switching a play mode based on an interface tag value when the flag bit state value changes; the interface tag value is obtained through the image middleware.

Images