CN110071952B - Service call quantity control method and device - Google Patents

Abstract

The invention discloses a method and device for controlling the amount of service calls, and relates to the technical field of computers. A specific implementation of the method includes: receiving a user request to call a local service; wherein the local service depends on at least one upstream service; when the user requests to call the local service normally, using the pre-stored, the The current invocation volume control policy of each upstream service in at least one upstream service determines whether the user request calls the upstream service normally: if yes, returns the normal invocation data of the upstream service; otherwise, returns the default data of the upstream service; according to The normal call data or default data returned by each upstream service generates response information and returns it to the user. This embodiment can use the pre-stored current call volume control policy of each upstream service to automatically control the call volume of the upstream service, thereby realizing automatic degradation or automatic recovery of the upstream service.

Description

Method and device for controlling service call volume

technical field

The invention relates to the field of computer technology, in particular to a method and device for controlling the amount of service calls.

Background technique

In the field of computer technology, the server needs to be able to cope with the huge load brought by a large number of requests in a short period of time in a specific scenario, and to provide uninterrupted high-availability services under general load conditions. In practical applications, a local service often depends on multiple upstream services. When the performance of upstream services becomes poor, unavailable, or unable to support traffic peaks, it is necessary to downgrade the corresponding services in advance or immediately. The existing downgrade operations are generally Implemented manually.

In the process of realizing the present invention, the inventor finds that there are at least the following problems in the prior art:

1. The downgrade operation is not fast enough. There will be a long time lag in the process from service problems to developers receiving business alarms to the completion of manual downgrade operations, which will lead to more services being unavailable. For the same reason, the recovery (recovery from degradation) operation also has a long time lag, which is easy to cause waste of service resources.

2. The existing downgrade and recovery can only perform full-flow operations, and cannot perform partial-flow operations. In this way, some services that can support relatively small traffic will be downgraded in advance with full traffic in the face of large traffic, resulting in waste of resources; after a period of downgrading, full traffic recovery will easily cause cold start problems.

3. In a specific scenario, the traffic flood peak is triggered in the middle of the night or early in the morning. At this time, additional manpower needs to be arranged to perform the downgrade operation in advance, resulting in an increase in manpower costs.

Contents of the invention

In view of this, the embodiments of the present invention provide a method and device for controlling the volume of service calls, which can use the pre-stored current call volume control strategy of each upstream service to automatically control the volume of upstream service calls, thereby realizing automatic downgrading of upstream services or automatic recovery.

To achieve the above purpose, according to one aspect of the present invention, a method for controlling the amount of service calls is provided.

The method for controlling the amount of service calls in the embodiment of the present invention includes: receiving a user request to call a local service; wherein the local service depends on at least one upstream service; The current invocation volume control strategy of each upstream service in the at least one upstream service, determine whether the user request normally invokes the upstream service: if yes, return the normal invocation data of the upstream service; otherwise, return the upstream service Default data; and, generate response information to return to the user according to normal call data or default data returned by each upstream service.

Optionally, the method further includes: setting multiple call volume control policies for each upstream service; wherein, the multiple call volume control policies include at least one downgrade policy and at least one recovery policy; when the upstream service is at full volume In the degraded state, select a recovery policy of the upstream service as the current call volume control policy of the upstream service and store it; when the upstream service is not in a fully degraded state, select a degraded policy of the upstream service as the current Invoke the volume control strategy and store it.

Optionally, the degradation strategy includes: at least one performance degradation strategy, each of which includes a degradation condition and a call volume degradation ratio; and, selecting a degradation policy of the upstream service as the current call volume of the upstream service The control strategy includes: collecting the operation data of the upstream service, counting the operation data to obtain the performance index of the upstream service in the current statistical cycle; in the performance degradation strategy of the upstream service, determining that the degradation condition matches the performance index of the current statistical cycle The performance degradation strategy for the upstream service is used as the primary call volume control strategy for the upstream service; and the one with the largest call volume degradation ratio among the primary call volume control strategies is determined as the current call volume control strategy for the upstream service.

Optionally, the downgrading strategy further includes: at least one availability downgrading strategy; and, selecting a downgrading strategy of the upstream service as the current call volume control strategy of the upstream service includes: obtaining the upstream Availability indicators of the service in multiple statistical periods closest to the current moment; in the availability degradation strategy of the upstream service, determine the availability degradation strategy whose degradation condition matches the availability indicator, and use it as the availability degradation strategy of the upstream service Primary call volume control strategy.

Optionally, the downgrading strategy further includes: at least one timing downgrading strategy, and the downgrading condition of each timing downgrading strategy is a downgrading time interval; and, selecting a downgrading strategy of the upstream service as the current call amount of the upstream service The control strategy includes: in the timing downgrading strategy of the upstream service, determine that the downgrading time interval includes the timing downgrading strategy at the current moment, and use it as the primary call volume control strategy of the upstream service.

Optionally, each recovery strategy in the at least one recovery strategy includes a call volume downgrade ratio, and the user request carries a user identifier; The current call volume control policy of the service, determining whether the user request calls the upstream service normally includes: converting the user ID into a hash value between 0 and 1; when the hash value is less than the current call volume control policy When the call volume downgrade ratio of , control the upstream service not to provide calls to the user request; when the hash value is not less than the call volume downgrade ratio in the current call volume control policy, control the upstream service to provide the user request with transfer.

Optionally, the method further includes: pre-storing the current call volume control policy of the local service; and the user requesting to call the local service normally includes: using the current call volume control policy of the local service to determine The user requests to call the local service normally.

Optionally, the default data includes: the normal invocation data or null value returned by the upstream service last time; the operation data includes: each invocation status and each response time of the upstream service; the performance indicators include the following At least one: response time percentage line TP index, response time maximum value, response time average value.

To achieve the above object, according to another aspect of the present invention, a device for controlling the amount of service calls is provided.

The device for controlling the amount of service calls in the embodiment of the present invention may include: a receiving unit, configured to receive a user request for calling a local service; wherein, the local service depends on at least one upstream service; a call control unit, configured to When requesting to call the local service normally, use the pre-stored current call volume control policy of each upstream service in the at least one upstream service to determine whether the user request calls the upstream service normally: if so, return the upstream service otherwise, return the default data of the upstream service; the response unit can be used to generate response information to return to the user according to the normal call data or default data returned by each upstream service.

Optionally, the device may further include: a current policy acquisition unit, configured to set multiple call volume control policies for each upstream service; wherein, the multiple call volume control policies include at least one downgrading policy and at least one restoration policy strategy; when the upstream service is in the full degraded state, select a recovery strategy of the upstream service as the current call volume control strategy of the upstream service and store it; when the upstream service is not in the full degraded state, select a recovery strategy of the upstream service The downgrading policy is used as the current call volume control policy of the upstream service and stored.

Optionally, the degradation strategy includes: at least one performance degradation strategy, each of which includes a degradation condition and a call volume degradation ratio; and, the current policy acquisition unit can be further used to: collect the operation data of the upstream service , counting the operating data to obtain the performance index of the upstream service in the current statistical cycle; in the performance degradation strategy of the upstream service, determine the performance degradation strategy whose degradation condition matches the performance index of the current statistical cycle, and use it as the upstream service The primary call volume control strategy; determine the call volume reduction ratio among the primary call volume control strategies as the current call volume control strategy of the upstream service.

Optionally, the degradation policy may further include: at least one availability rate degradation policy; and the current policy acquiring unit may be further configured to: acquire a plurality of statistics of the upstream service closest to the current moment according to the operation data A periodic availability rate index; in the availability rate degradation strategy of the upstream service, determine the availability rate degradation policy whose degradation condition matches the availability rate index, and use it as the primary call volume control strategy of the upstream service.

Optionally, the downgrading strategy may further include: at least one timing downgrading strategy, and the downgrading condition of each timing downgrading strategy is a downgrading time interval; and, the current policy acquisition unit may be further used to: In the downgrade strategy, it is determined that the downgrade time interval contains the timed downgrade strategy at the current moment, and it is used as the primary call volume control strategy for the upstream service.

Optionally, each recovery strategy in the at least one recovery strategy includes a call volume downgrade ratio, and the user request carries a user identifier; and, the call control unit may be further configured to: convert the user identifier into A hash value between 0 and 1; when the hash value is less than the call volume degradation ratio in the current call volume control policy, control the upstream service not to provide calls to the user request; when the hash value is not less than the current When the call volume reduction ratio in the call volume control strategy is used, the upstream service is controlled to provide calls to the user request.

Optionally, the current policy acquisition unit may be further configured to: pre-store the current call volume control policy of the local service; and the call control unit may be further used to: utilize the current call volume control policy of the local service A policy is used to determine that the user requests to call the local service normally.

Optionally, the default data includes: the normal invocation data or null value returned by the upstream service last time; the operation data includes: each invocation status and each response time of the upstream service; the performance indicators include the following At least one: response time percentage line TP index, response time maximum value, response time average value.

To achieve the above object, according to another aspect of the present invention, an electronic device is provided.

An electronic device according to the present invention includes: one or more processors; storage means for storing one or more programs, when the one or more programs are executed by the one or more processors, so that the One or more processors implement the method for controlling the amount of service calls provided by the present invention.

To achieve the above purpose, according to still another aspect of the present invention, a computer-readable storage medium is provided.

A computer-readable storage medium of the present invention stores a computer program thereon, and when the program is executed by a processor, the method for controlling the amount of service calls provided by the present invention is realized.

According to the technical solution of the present invention, one embodiment of the above invention has the following advantages or beneficial effects: by setting multiple call volume control strategies for each upstream service, and obtaining its performance according to the operating data of each upstream service collected in real time , availability rate and other operating indicators, and then use operating indicators and other parameters to determine the current call volume control strategy from its call volume control strategy to adjust the proportion of degraded or restored call volume, so as to realize automatic control of upstream service call volume and improve system sensitivity. performance, availability, and service resource utilization, overcoming the serious defect of the existing manual operation lag; This can solve the problem of only full-flow operation in the prior art, improve resource utilization, and avoid cold start problems; in addition, in the embodiment of the present invention, a timing downgrading strategy can also be set, which can be set in advance before the traffic flood peak The automatic downgrade of the service can be realized, thereby improving the accuracy of the downgrade operation and reducing labor costs.

The further effects of the above-mentioned non-conventional alternatives will be described below in conjunction with specific embodiments.

Description of drawings

The accompanying drawings are used to better understand the present invention, and do not constitute improper limitations to the present invention. in:

FIG. 1 is a schematic diagram of main steps of a method for controlling the amount of service calls according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a specific implementation of a method for controlling the amount of service calls according to the first embodiment of the present invention;

FIG. 3 is a schematic diagram of configuration of a call volume control strategy of a service call volume control method according to the first embodiment of the present invention;

FIG. 4 is a schematic diagram of main parts of a device for controlling the amount of service calls according to an embodiment of the present invention;

FIG. 5 is an exemplary system architecture diagram that can be applied thereto according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of an electronic device used to implement the method for controlling the amount of service calls according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the technical solution of the embodiment of the present invention, multiple call volume control strategies are set for each upstream service, and operating indicators such as performance and availability are obtained according to the operating data of each upstream service collected in real time, and then parameters such as operating indicators are used to obtain In its call volume control strategy, the current call volume control strategy is determined to adjust the proportion of downgraded or restored calls, so as to realize the automatic control of the upstream service call volume, improve the sensitivity, availability and service resource utilization of the system, and overcome the existing The serious defect of manual operation lagging; in the embodiment of the present invention, the call volume control strategy set for each upstream service can realize the degradation or recovery of part of the flow, thus solving the problem of only full flow operation in the prior art Insufficient, improve resource utilization and avoid cold start problems; in addition, in the embodiment of the present invention, a timing downgrading strategy can also be set, and the automatic downgrading of services can be realized by setting in advance before the traffic flood peak, thereby improving the accuracy of downgrading operations. Reduce labor costs.

It should be noted that, in the case of no conflict, the embodiments of the present invention and the technical features in the embodiments can be combined with each other.

Fig. 1 is a schematic diagram of main steps of a method for controlling the amount of service calls according to an embodiment of the present invention.

As shown in Figure 1, the method for controlling the amount of service calls in the embodiment of the present invention may perform the following steps:

Step S101: the local server receives a user request for invoking a local service.

In the embodiment of the present invention, the user request is used to request the local server from the local server for the local service set in the local server. After receiving the user request, the local server often needs to call at least one upstream service that the local service depends on, and according to the data in response. Wherein, the user identification may be carried in the user request, and the user identifier may be the user's mobile phone number, the International Mobile Equipment Identity (IMEI) of the user's mobile phone, and the like.

Step S102: When the user requests to call the local service normally, the local server determines whether the user requests to call the upstream service normally by using the pre-stored current call volume control strategy of each upstream service in at least one upstream service: if so, return the upstream service The normal invocation data of the service; otherwise, the default data of the upstream service is returned.

In this step, the local server pre-stores the current call volume control policy of each upstream service, the current call volume control policy is determined according to the real-time operation of the upstream service, and is used to automatically downgrade or restore the upstream service. Among them, service degradation refers to: when the server pressure increases sharply, the operation of restricting the traffic of a service according to the current business situation and access traffic, service recovery refers to: when a service is in the full traffic degraded state for a period of time, It restores a certain percentage of access traffic operations.

In practical applications, the local server determines the current call volume control strategy for each upstream service through the following steps:

1. Set up multiple call volume control strategies for each upstream service; among them, multiple call volume control policies include at least one downgrade strategy and at least one recovery strategy, each downgrade strategy includes downgrade conditions and call volume downgrade ratios, each The recovery strategies all include the recovery condition and call volume detection ratio.

Specifically, the downgrading condition refers to the triggering condition of the downgrading policy, and the invocation volume downgrading ratio refers to the proportion of degraded service invocation volume when the downgrading policy is executed. Generally, the calling amount downgrading ratio is a value between 0 and 1 (that is, not less than 0 and not greater than 1).

For example: a downgrade policy of an upstream service is: when TP90 is greater than 1000 milliseconds, 20% of the traffic will be downgraded automatically. Among them, TP90 is a response time percentage line TP (Top Percentile) index, and its physical meaning is: sort the multiple response times of the upstream service within the statistical period from small to large, and rank at the 90th percentile response time. Similarly, TP50 refers to the multiple response times of the upstream service within the statistical period, sorted from small to large, and the response time that is at the 50th percentile. In the above downgrade strategy, the downgrade condition is: TP90 is greater than 1000 milliseconds, and the call volume downgrade ratio is 20%. If the downgrade policy is used as the current call volume control strategy of the upstream service, it can control the upstream service to 20% of the access traffic Calls are not provided, and calls are provided for 80% of the access traffic.

In the embodiment of the present invention, the degradation policy of each upstream service may include: a performance degradation policy, an availability rate degradation policy, and a timing degradation policy. Among them, the degradation condition of the performance degradation policy is the performance index of the upstream service, such as: TP50, TP90, TP99, TP999, the average response time, the maximum response time, etc., the degradation policy in the above example "when TP90 is greater than 1000 milliseconds, automatically Downgrade 20% of traffic" is the performance downgrade strategy.

The downgrading condition of the availability downgrading policy is the availability index of the upstream service. In a specific application, the availability rate of the upstream service in a certain statistical period is the quotient of the total number of normal calls (that is, the total number of successful calls) and the total number of calls of the upstream service in the statistical period. . For example: the following downgrading policy is the availability downgrading policy: when the service availability is less than 50% for three consecutive times, 40% of the traffic will be automatically downgraded.

The downgrade condition of the scheduled downgrade policy is the downgrade time interval, which is the preset time interval for triggering downgrade operations. For example: the following downgrade policy is a time interval: from 2017-10-27 23:55:00 to 2017-10-28 00:05:00, automatically downgrade 80% of the traffic, which means: in 2017 During the time interval from 23:55 on October 27 to 0:05 in 2018, 80% of the access traffic will be downgraded, among which "2017-10-27 23:55:00～2017-10-28 00:05 :00" is the downgrade interval.

In this step, the recovery condition refers to the condition that triggers the recovery strategy when the upstream service is in the state of full downgrade (that is, downgrades all access traffic), and the call volume detection ratio refers to the service call volume ratio initially started when the recovery strategy is executed . Generally, the calling amount detection ratio is a value between 0 and 1. It can be understood that the sum of the call volume detection ratio and the call volume degradation ratio in the same recovery strategy is 1. By setting the call volume detection ratio, it is possible to prevent upstream services from alternating between full-flow degradation and full-flow recovery, and to avoid cold start problems.

For example, a certain recovery strategy of an upstream service is: after 10 minutes of automatic downgrade of full traffic, open 5% of inspection traffic. In this recovery strategy, the recovery conditions are: full traffic is automatically downgraded for 10 minutes, the call volume detection ratio is 5%, and the call volume downgrade ratio is 95%. If this recovery strategy is used as the current call volume control strategy of the upstream service, it can The upstream service is controlled not to provide calls to 95% of the access traffic, and to provide calls to 5% of the access traffic.

2. When the upstream service is in the full degraded state, select a recovery policy of the upstream service as the current call volume control strategy of the upstream service and store it; when the upstream service is not in the full degraded state, select a degraded policy of the upstream service as the upstream service The current call volume control strategy and store it.

Preferably, in the embodiment of the present invention, if the upstream service is in a fully degraded state, one of at least one recovery strategy is selected as the current call volume control strategy according to preset rules, and stored. If the upstream service is not in the full degraded state, you can select the current call volume control policy of the upstream service from at least one degraded policy according to the following steps:

(1) Collect the operation data of the upstream service, and collect the operation data to obtain the performance index of the upstream service in the current statistical cycle; in the performance degradation strategy of the upstream service, determine the performance degradation strategy whose degradation condition matches the performance index of the current statistical cycle, Use it as the primary call volume control strategy for the upstream service.

Preferably, the running data of the upstream service may include: each invocation status and each response time of the upstream service, wherein the invocation status refers to whether each invocation of the upstream service is a normal invocation (ie a successful invocation) or a failed invocation. By counting the running data of the current statistical period, the performance indicators of the upstream service in the current statistical period can be obtained, and then the degradation policy whose degradation condition matches the performance indicators of the current statistical period can be determined as the primary call volume control strategy of the upstream service.

(2) Collect the operation data of the upstream service, and obtain the availability rate index of the upstream service in the nearest statistical period according to the operation data; in the availability rate downgrading strategy of the upstream service, determine whether the downgrade condition matches the availability rate index Availability downgrading strategy, which is used as the primary call volume control strategy for the upstream service.

Wherein, the above-mentioned multiple statistical periods are multiple continuous statistical periods closest to the current moment. In practical applications, statistics can be made on the operation data of the above-mentioned multiple statistical periods to obtain the availability rate index of each statistical cycle, and the downgrade policy whose downgrade condition matches the above-mentioned availability rate index can be determined as the primary call volume control of the upstream service Strategy.

(3) In the timing downgrading strategy of the upstream service, it is determined that the downgrading time interval contains the timing downgrading strategy of the current moment (that is, the current moment is within the downgrading time interval), and it is used as the primary call volume control strategy of the upstream service.

(4) Determining the one with the largest call volume reduction ratio among the primary call volume control strategies as the current call volume control strategy of the upstream service, and storing the current call volume control strategy.

It can be understood that the primary call volume control strategy may be determined from one or two of the performance degradation strategy, the availability ratio degradation strategy, and the timing degradation strategy, which is not limited in the present invention.

Through the above steps, the present invention can determine the degrading strategy corresponding to the real-time status of the upstream service according to the collected operating data, operating indicators and current time, and the automatic and rapid degrading of the upstream service can be realized by using the degrading strategy.

In step S102, the local server may use the current call volume control policy of the upstream service to determine whether the user request calls the upstream service normally. Specifically, the local server can judge through the following steps:

1. Convert the user ID carried in the user request into a hash value between 0 and 1.

2. Compare the hash value with the call volume downgrade ratio in the current call volume control strategy: if the hash value is smaller than the above call volume downgrade ratio, control the upstream service not to provide calls to user requests, and return to the default value of the upstream service data; if the hash value is not less than the above call reduction ratio, control the upstream service to provide calls to the user request, and return the normal call data of the upstream service. Among them, the default data refers to the normal call data or null value returned by the upstream service last time.

As a preferred solution, in step S102, the current calling amount control policy of each local service may be stored in the local server. Similar to the current call volume control strategy of the upstream service, the current call volume control strategy of the local service is also determined from the predetermined local service call volume control strategy, and its call volume control strategy can also include a downgrade strategy and recovery strategy. Policies may also include performance degradation policies, availability rate degradation policies, and timed degradation policies. When the local service is not in the full degraded state, the current call volume control strategy is also determined through the following similar steps:

1. Collect the operation data of the local service, and obtain its operation indicators through statistics. According to the operation indicators and the current moment, determine the primary call volume control strategy of the local service from its performance degradation strategy, availability rate degradation strategy, and timing degradation strategy.

2. Determine the current call volume control strategy of the local service as the current call volume control strategy of the local service, and store the current call volume control strategy among the primary call volume control strategies.

Afterwards, the current call volume control policy of the local service can be used to determine whether the user request calls the local service normally. The above judgment process of the local service for the user request is the same as that of the upstream service, and will not be repeated here. After getting the judgment result, if the local service requests the user to provide a normal call, it will then try to call the upstream service; if the local service does not provide the call to the user request, then return the default data of the local service to the user.

Step S103: Generate response information and return it to the user according to the normal call data or default data returned by each upstream service.

In this step, the local service can integrate the data returned by each upstream service, and generate response information based on the integrated data to return to the user.

Fig. 2 is a schematic diagram of a specific realization of the method for controlling the amount of service calls according to the first embodiment of the present invention.

As shown in Figure 2, the method for controlling the amount of service calls in this embodiment can be composed of a local monitoring module, an upstream monitoring module, a data monitoring center, a configuration center, an alarm reminder module, a notification module, a cache module, a degraded service module, and a real-time interface service module interaction is achieved.

Specifically, the local monitoring module is used to collect operating data such as calling status and response time of local services, and the local services are inside the real-time interface service module in FIG. 2 . The upstream monitoring module is used to collect the operation data of upstream services. The data monitoring center is used to collect the real-time operation data fed back by the local monitoring module and the upstream monitoring module, and obtain the operation indicators such as performance indicators and availability indicators through statistics.

The configuration center is responsible for the configuration of all call volume control strategies for local services and upstream services. It regularly reads the various operating indicators of the data monitoring center according to the update frequency, and determines the current call volume from the call volume control strategy that matches the degradation condition or recovery condition. control strategy, and update the current call volume control strategy to the cache module, and send an update message to the notification module at the same time. In addition, if the current calling amount control strategy changes, an alarm will be issued through the alarm reminder module.

Fig. 3 is a schematic diagram of configuration of a call volume control policy in a method for controlling service call volume according to a first embodiment of the present invention.

As shown in Figure 3, the configuration name of the local service or upstream service can be configured as the service identifier in the configuration center, the configuration value and the update frequency of the automatic downgrade policy can be set, and at least one performance downgrade policy, availability downgrade policy, and timing downgrade policy can be configured and recovery strategies. Through the above configuration, highly sensitive control of service call volume can be realized.

The cache module is responsible for storing the current call volume control policy determined by the configuration center, and providing the current call volume control policy to the downgrade service module for access. The notification module is used to receive the update message sent by the configuration center, and synchronize the update message to the degraded service module through zookeeper (a distributed application coordination service).

After receiving the update message, the degraded service module reads the current call volume control policy from the cache module and stores it in the local cache of the degraded service module. At the same time, the degraded service module provides services for the real-time interface service module. According to the user identification and service identification sent by the real-time interface service module, it judges whether to provide service calls by using its stored current call volume control strategy corresponding to the service identification.

The real-time interface service module is responsible for receiving user requests, and then calls the downgrade service module, and determines whether to call the service according to the judgment result of the downgrade service module.

In this embodiment, the automatic control of the service call volume mainly relies on the running indicators counted by the data monitoring center, the regular update of the policy of the configuration center, and the adjustment closed loop of service call-data monitoring-policy update-call volume control. The update logic of the call volume control strategy mainly occurs in the configuration center and the downgrade service module, both of which are transparent to the real-time interface service module, so they have almost no impact on the performance of the real-time interface service module. In addition, various configuration data are stored locally on the server, so the degraded service module is still a lightweight service. Therefore, the method for controlling the amount of service calls provided in this embodiment can realize automatic control of the amount of service calls without affecting service performance, and has high system sensitivity, availability, and service resource utilization.

In the technical solution of the embodiment of the present invention, by setting multiple call volume control strategies for each upstream service, and obtaining operating indicators such as performance and availability rate according to the operating data of each upstream service collected in real time, and then using the operating indicators Determine the current call volume control strategy from its call volume control strategy to adjust the proportion of downgraded or restored calls, so as to realize the automatic control of the upstream service call volume, improve the system's sensitivity, availability and service resource utilization, and overcome the The existing manual operation lags serious defects; in the embodiment of the present invention, the call volume control strategy set for each upstream service can realize the degradation or recovery of part of the traffic, thus solving the problem that only full traffic can only be performed in the prior art. Insufficient traffic operation can improve resource utilization and avoid cold start problems; in addition, in the embodiment of the present invention, a timing downgrading strategy can also be set, which can be set in advance before the traffic flood peak to realize automatic service downgrading, thereby improving downgrading Operational precision, reducing labor costs.

Fig. 4 is a schematic diagram of main parts of the device for controlling the amount of service calls according to the embodiment of the present invention.

As shown in FIG. 4 , the apparatus 400 for controlling the amount of service calls in the embodiment of the present invention may include: a receiving unit 401 , a calling control unit 402 and a responding unit 403 . in:

The receiving unit 401 may be configured to receive a user request for invoking a local service; wherein the local service depends on at least one upstream service;

The call control unit 402 may be configured to determine whether the user request calls the local service normally by using a pre-stored current call volume control strategy for each upstream service in the at least one upstream service The upstream service: if yes, return the normal call data of the upstream service; otherwise, return the default data of the upstream service;

The response unit 403 may be configured to generate response information to return to the user according to normal call data or default data returned by each upstream service.

In the embodiment of the present invention, the device 400 may further include: a current policy acquisition unit, configured to set multiple call volume control policies for each upstream service; wherein, the multiple call volume control policies include at least one downgrade strategy and at least one recovery strategy; when the upstream service is in the full degraded state, select a recovery strategy of the upstream service as the current call volume control strategy of the upstream service and store it; when the upstream service is not in the full degraded state, select A degrading policy of the upstream service is used as the current call volume control policy of the upstream service and stored.

In practical applications, the degradation strategy may include: at least one performance degradation strategy, and each degradation strategy includes a degradation condition and a call volume degradation ratio. The current policy acquisition unit may be further used to: collect the operation data of the upstream service, and collect the operation data to obtain the performance index of the upstream service in the current statistical cycle; in the performance degradation strategy of the upstream service, determine the degradation condition and The performance degradation strategy matched by the performance index of the current statistical cycle is used as the primary call volume control strategy of the upstream service; the one with the largest call volume degradation ratio among the primary call volume control strategies is determined as the current upstream service Call volume control strategy.

In a specific application, the degradation policy may further include: at least one availability rate degradation policy. The current policy obtaining unit may be further configured to: obtain the availability rate indicators of the upstream service in the nearest statistical periods according to the operation data; in the availability rate degradation strategy of the upstream service, determine the degradation condition and The availability rate degradation policy matched by the availability rate index is used as the primary call volume control policy of the upstream service.

In an actual application scenario, the downgrading strategy may further include: at least one timing downgrading strategy, and the downgrading condition of each timing downgrading strategy is a downgrading time interval. The current policy acquisition unit may be further configured to: in the timing downgrade policy of the upstream service, determine that the downgrade time interval includes the timing downgrade policy at the current moment, and use it as the primary call volume control strategy of the upstream service.

Preferably, each recovery strategy in the at least one recovery strategy includes a call volume degradation ratio, and the user request carries a user identifier. The call control unit 402 may be further configured to: convert the user identifier into a hash value between 0 and 1; The service does not request to provide calls to the user; when the hash value is not less than the call volume reduction ratio in the current call volume control policy, control the upstream service to request to provide calls to the user.

As a preferred solution, the current policy acquisition unit may be further configured to: pre-store the current call volume control policy of the local service. The call control unit 402 may be further configured to: use the current call volume control policy of the local service to determine that the user requests to call the local service normally.

In addition, in the embodiment of the present invention, the default data includes: the normal call data or null value returned by the upstream service last time; the running data includes: each call status and each response time of the upstream service; The performance index includes at least one of the following: response time percentage line TP index, response time maximum value, and response time average value.

In the technical solution of the embodiment of the present invention, by setting multiple call volume control strategies for each upstream service, and obtaining operating indicators such as performance and availability rate according to the operating data of each upstream service collected in real time, and then using the operating indicators Determine the current call volume control strategy from its call volume control strategy to adjust the proportion of downgraded or restored calls, so as to realize the automatic control of the upstream service call volume, improve the system's sensitivity, availability and service resource utilization, and overcome the The existing manual operation lags serious defects; in the embodiment of the present invention, the call volume control strategy set for each upstream service can realize the degradation or recovery of part of the traffic, thus solving the problem that only full traffic can only be performed in the prior art. Insufficient traffic operation can improve resource utilization and avoid cold start problems; in addition, in the embodiment of the present invention, a timing downgrading strategy can also be set, which can be set in advance before the traffic flood peak to realize automatic service downgrading, thereby improving downgrading Operational precision, reducing labor costs.

Fig. 5 shows an exemplary system architecture 500 to which the method for controlling the amount of service calls or the device for controlling the amount of service calls according to the embodiments of the present invention can be applied.

As shown in Fig. 5, the system architecture 500 may include terminal devices 501, 502, 503, a network 504 and a server 505 (this architecture is only an example, and the components contained in the specific architecture can be adjusted according to the specific conditions of the application). The network 504 is used as a medium for providing communication links between the terminal devices 501 , 502 , 503 and the server 505 . Network 504 may include various connection types, such as wires, wireless communication links, or fiber optic cables, among others.

Users can use terminal devices 501 , 502 , 503 to interact with server 505 through network 504 to receive or send messages and the like. Various communication client applications can be installed on the terminal devices 501, 502, and 503, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (just for example).

The terminal devices 501, 502, 503 may be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers and the like.

The server 505 may be a server that provides various services, such as a background management server that provides support for shopping websites browsed by users using the terminal devices 501 , 502 , 503 (just an example). The background management server can analyze and process the received data such as product information query requests, and feed back the processing results (such as target push information, product information—just an example) to the terminal device.

It should be noted that the method for controlling the amount of service calls provided by the embodiment of the present invention is generally executed by the server 505 , and correspondingly, the device for controlling the amount of service calls is generally set in the server 505 .

It should be understood that the numbers of terminal devices, networks and servers in Fig. 5 are only illustrative. According to the implementation needs, there can be any number of terminal devices, networks and servers.

The invention also provides an electronic device. The electronic device in the embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, so that the One or more processors implement the method for controlling the amount of service calls provided by the present invention.

Referring now to FIG. 6 , it shows a schematic structural diagram of a computer system 600 suitable for implementing an electronic device according to an embodiment of the present invention. The electronic device shown in FIG. 6 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention.

As shown in FIG. 6 , a computer system 600 includes a central processing unit (CPU) 601 that can be programmed according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage section 608 into a random-access memory (RAM) 603 Instead, various appropriate actions and processes are performed. In the RAM 603, various programs and data necessary for the operation of the computer system 600 are also stored. The CPU 601 , ROM 602 , and RAM 603 are connected to each other via a bus 604 . An input/output (I/O) interface 605 is also connected to the bus 604 .

The following components are connected to the I/O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 608 including a hard disk, etc. and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc. is mounted on the drive 610 as necessary so that a computer program read therefrom is installed into the storage section 608 as necessary.

In particular, according to the disclosed embodiments of the present invention, the process described in the main step diagram above can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the method shown in the main step diagram. In the above-described embodiments, the computer program can be downloaded and installed from the network via the communication section 609, and/or installed from the removable medium 611. When this computer program is executed by the central processing unit 601, the above-mentioned functions defined in the system of the present invention are performed.

It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium other than a computer readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that includes one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block in the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a A combination of dedicated hardware and computer instructions.

The units involved in the description in the embodiments of the present invention may be implemented by means of software or by means of hardware. The described units may also be set in a processor, for example, it may be described as: a processor includes a receiving unit, a calling control unit, and a responding unit. Wherein, the names of these units do not limit the unit itself under certain circumstances, for example, the receiving unit may also be described as "a unit that provides user requests to the calling control unit".

As another aspect, the present invention also provides a computer-readable medium. The computer-readable medium may be contained in the device described in the above embodiments; . The above computer-readable medium bears one or more programs, and when the one or more programs are executed by the device, the steps performed by the device include: receiving a user request for invoking a local service; wherein the local service depends on At least one upstream service; when the user requests to call the local service normally, determine whether the user request calls the local service normally by using a pre-stored current call volume control strategy for each upstream service in the at least one upstream service Upstream service: if yes, return the normal call data of the upstream service; otherwise, return the default data of the upstream service; and generate response information according to the normal call data or default data returned by each upstream service and return it to the user.

According to the technical solution of the embodiment of the present invention, by setting multiple call volume control strategies for each upstream service, and obtaining its performance, availability and other operating indicators according to the operating data of each upstream service collected in real time, and then using the operating indicators, etc. Parameters determine the current call volume control strategy from its call volume control strategy to adjust the proportion of downgraded or restored calls, thereby realizing automatic control of upstream service calls, improving system sensitivity, availability, and service resource utilization, and overcoming existing problems. Some manual operations have a serious lagging defect; in the embodiment of the present invention, the call volume control strategy set for each upstream service can realize the degradation or recovery of part of the traffic, thus solving the problem of only full traffic in the prior art Insufficient operation can improve resource utilization and avoid cold start problems; in addition, in the embodiment of the present invention, a timing downgrading strategy can also be set, which can be set in advance before the traffic flood peak to realize automatic service downgrading, thereby improving downgrading operation Accuracy, reduce labor cost.

The above specific implementation methods do not constitute a limitation to the protection scope of the present invention. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (18)

1. A method for controlling a service call amount, comprising:

setting a plurality of call quantity control strategies for each upstream service on which the local service depends; wherein the plurality of call volume control policies includes at least one demotion policy, each demotion policy including a demotion condition to a corresponding call volume demotion ratio;

receiving a user request for calling the local service;

when the user requests to normally call the local service, determining whether the user requests to normally call the upstream service by using a pre-stored current call quantity control strategy of each upstream service in the at least one upstream service: if yes, returning the normal calling data of the upstream service; otherwise, returning default data of the upstream service; in the case that the current call volume control policy of any upstream service is a degradation policy, the current call volume control policy of the upstream service is selected from a plurality of call volume control policies set for the upstream service according to operation data of the upstream service or current time;

And generating response information according to the normal call data or default data returned by each upstream service and returning the response information to the user.

2. The method of claim 1, wherein the plurality of call volume control policies further comprises at least one restoration policy;

when the upstream service is in a full-scale degradation state, selecting a recovery strategy of the upstream service as a current call volume control strategy of the upstream service and storing the recovery strategy; and when the upstream service is not in the full-volume degradation state, selecting and storing a degradation strategy of the upstream service as a current call volume control strategy of the upstream service.

3. The method of claim 2, wherein the downgrade policy comprises: at least one performance downgrade policy, each downgrade policy including a downgrade condition to call volume downgrade ratio; and selecting a demotion policy of the upstream service as a current call volume control policy of the upstream service includes:

collecting operation data of the upstream service, and counting the operation data to obtain performance indexes of the upstream service in a current counting period;

in the performance degradation strategy of the upstream service, determining a performance degradation strategy with degradation conditions matched with the performance index of the current statistical period, and taking the performance degradation strategy as a primary call quantity control strategy of the upstream service; and determining the largest calling quantity degradation proportion in the initially selected calling quantity control strategy as the current calling quantity control strategy of the upstream service.

4. The method of claim 3, wherein the downgrade policy further comprises: at least one availability downgrade policy; and selecting a demotion policy of the upstream service as a current call volume control policy of the upstream service includes:

acquiring an availability index of the upstream service in a plurality of statistical periods nearest to the current moment according to the operation data;

and determining an availability degradation strategy with degradation conditions matched with the availability index from the availability degradation strategies of the upstream service, and taking the availability degradation strategy as a primary call volume control strategy of the upstream service.

5. The method of claim 4, wherein the downgrade policy further comprises: at least one timing downgrade strategy, the downgrade condition of each timing downgrade strategy is a downgrade time interval; and selecting a demotion policy of the upstream service as a current call volume control policy of the upstream service includes:

and determining that the degradation time interval contains the timing degradation strategy of the current moment in the timing degradation strategy of the upstream service, and taking the timing degradation strategy as the initial call quantity control strategy of the upstream service.

6. The method of any of claims 3-5, wherein each of the at least one recovery policy includes a call volume degradation ratio, the user request carrying a user identification; and determining whether the user request normally invokes each of the at least one upstream service using a pre-stored current invocation quantity control policy for the upstream service, comprising:

Converting the user identification into a hash value between 0 and 1;

when the hash value is smaller than the calling quantity degradation proportion in the current calling quantity control strategy, controlling the upstream service not to provide calling for the user request;

and controlling the upstream service to provide calling for the user request when the hash value is not smaller than the calling degradation proportion in the current calling quantity control strategy.

7. The method according to claim 1, wherein the method further comprises: pre-storing a current call volume control strategy of the local service; and the user requesting normal invocation of the local service includes:

and determining that the user requests to normally call the local service by using the current call quantity control strategy of the local service.

8. The method of claim 6, wherein the default data comprises: the upstream service returns the last time normal call data or null value; the operation data includes: each call state and each response time of the upstream service; the performance index includes at least one of: response time percentage TP indicator, response time maximum value, response time average value.

9. A control device for a service call amount, comprising:

the current strategy acquisition unit is used for setting a plurality of call quantity control strategies for each upstream service on which the local service depends; wherein the plurality of call volume control policies includes at least one demotion policy, each demotion policy including a demotion condition to a corresponding call volume demotion ratio;

a receiving unit, configured to receive a user request for invoking the local service;

a call control unit, configured to determine, when the user requests to call the local service normally, whether the user requests to call the upstream service normally, by using a pre-stored current call volume control policy of each upstream service in the at least one upstream service: if yes, returning the normal calling data of the upstream service; otherwise, returning default data of the upstream service; in the case that the current call volume control policy of any upstream service is a degradation policy, the current call volume control policy of the upstream service is selected from a plurality of call volume control policies set for the upstream service according to operation data of the upstream service or current time;

and the response unit is used for generating response information according to the normal call data or default data returned by each upstream service and returning the response information to the user.

10. The apparatus of claim 9, wherein the plurality of call volume control policies further comprises at least one recovery policy; and, the current policy obtaining unit is further configured to:

when the upstream service is in a full-scale degradation state, selecting a recovery strategy of the upstream service as a current call volume control strategy of the upstream service and storing the recovery strategy; and when the upstream service is not in the full-volume degradation state, selecting and storing a degradation strategy of the upstream service as a current call volume control strategy of the upstream service.

11. The apparatus of claim 10, wherein the downgrade policy comprises: at least one performance downgrade policy, each downgrade policy including a downgrade condition to call volume downgrade ratio; the method comprises the steps of,

the current policy obtaining unit is further configured to: collecting operation data of the upstream service, and counting the operation data to obtain performance indexes of the upstream service in a current counting period; in the performance degradation strategy of the upstream service, determining a performance degradation strategy with degradation conditions matched with the performance index of the current statistical period, and taking the performance degradation strategy as a primary call quantity control strategy of the upstream service; and determining the largest calling quantity degradation proportion in the initially selected calling quantity control strategy as the current calling quantity control strategy of the upstream service.

12. The apparatus of claim 11, wherein the downgrade policy further comprises: at least one availability downgrade policy; the method comprises the steps of,

the current policy obtaining unit is further configured to: acquiring an availability index of the upstream service in a plurality of statistical periods nearest to the current moment according to the operation data; and determining an availability degradation strategy with degradation conditions matched with the availability index from the availability degradation strategies of the upstream service, and taking the availability degradation strategy as a primary call volume control strategy of the upstream service.

13. The apparatus of claim 12, wherein the downgrade policy further comprises: at least one timing downgrade strategy, the downgrade condition of each timing downgrade strategy is a downgrade time interval; the method comprises the steps of,

the current policy obtaining unit is further configured to: and determining that the degradation time interval contains the timing degradation strategy of the current moment in the timing degradation strategy of the upstream service, and taking the timing degradation strategy as the initial call quantity control strategy of the upstream service.

14. The apparatus of any of claims 11-13, wherein each of the at least one recovery policy includes a call volume degradation ratio, the user request carrying a user identification; the method comprises the steps of,

The call control unit is further configured to: converting the user identification into a hash value between 0 and 1; when the hash value is smaller than the calling quantity degradation proportion in the current calling quantity control strategy, controlling the upstream service not to provide calling for the user request; and controlling the upstream service to provide calling for the user request when the hash value is not smaller than the calling degradation proportion in the current calling quantity control strategy.

15. The apparatus of claim 9, wherein the current policy acquisition unit is further to: pre-storing a current call volume control strategy of the local service; the method comprises the steps of,

the call control unit is further configured to: and determining that the user requests to normally call the local service by using the current call quantity control strategy of the local service.

16. The apparatus of claim 14, wherein the default data comprises: the upstream service returns the last time normal call data or null value; the operation data includes: each call state and each response time of the upstream service; the performance index includes at least one of: response time percentage TP indicator, response time maximum value, response time average value.

17. An electronic device, comprising:

one or more processors;

storage means for storing one or more programs,

when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-8.

18. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-8.