浏览 795
Nginx virtual host traffic status module
This document describes nginx-module-vts v0.1.18
released on 22 Jun 2018.
Earlier versions is not tested.
shell> git clone git://github.com/vozlt/nginx-module-vts.git
Add the module to the build configuration by adding --add-module=/path/to/nginx-module-vts
Build the nginx binary.
Install the nginx binary.
http { vhost_traffic_status_zone; ... server { ... location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
This is an Nginx module that provides access to virtual host status information. It contains the current status such as servers, upstreams, caches. This is similar to the live activity monitoring of nginx plus. The built-in html is also taken from the demo page of old version.
First of all, the directive vhost_traffic_status_zone
is required, and then if the directive vhost_traffic_status_display
is set, can be access to as follows:
/status/format/json
, will respond with a JSON document containing the current activity data for using in live dashboards and third-party monitoring tools./status/format/html
, will respond with the built-in live dashboard in HTML that requests internally to /status/format/json
./status/format/jsonp
, will respond with a JSONP callback function containing the current activity data for using in live dashboards and third-party monitoring tools./status/format/prometheus
, will respond with a prometheus document containing the current activity data./status/control
, will respond with a JSON document after it reset or delete zones through a query string. See the Control.JSON document contains as follows:
{ "hostName": ..., "nginxVersion": ..., "loadMsec": ..., "nowMsec": ..., "connections": { "active":..., "reading":..., "writing":..., "waiting":..., "accepted":..., "handled":..., "requests":... }, "sharedZones": { "name":..., "maxSize":..., "usedSize":..., "usedNode":... }, "serverZones": { "...":{ "requestCounter":..., "inBytes":..., "outBytes":..., "responses":{ "1xx":..., "2xx":..., "3xx":..., "4xx":..., "5xx":..., "miss":..., "bypass":..., "expired":..., "stale":..., "updating":..., "revalidated":..., "hit":..., "scarce":... }, "requestMsecCounter":..., "requestMsec":..., "requestMsecs":{ "times":[...], "msecs":[...] }, "requestBuckets":{ "msecs":[...], "counters":[...] }, } ... }, "filterZones": { "...":{ "...":{ "requestCounter":..., "inBytes":..., "outBytes":..., "responses":{ "1xx":..., "2xx":..., "3xx":..., "4xx":..., "5xx":..., "miss":..., "bypass":..., "expired":..., "stale":..., "updating":..., "revalidated":..., "hit":..., "scarce":... }, "requestMsecCounter":..., "requestMsec":..., "requestMsecs":{ "times":[...], "msecs":[...] }, "requestBuckets":{ "msecs":[...], "counters":[...] }, }, ... }, ... }, "upstreamZones": { "...":[ { "server":..., "requestCounter":..., "inBytes":..., "outBytes":..., "responses":{ "1xx":..., "2xx":..., "3xx":..., "4xx":..., "5xx":... }, "requestMsecCounter":..., "requestMsec":..., "requestMsecs":{ "times":[...], "msecs":[...] }, "requestBuckets":{ "msecs":[...], "counters":[...] }, "responseMsecCounter":..., "responseMsec":..., "responseMsecs":{ "times":[...], "msecs":[...] }, "responseBuckets":{ "msecs":[...], "counters":[...] }, "weight":..., "maxFails":..., "failTimeout":..., "backup":..., "down":... } ... ], ... } "cacheZones": { "...":{ "maxSize":..., "usedSize":..., "inBytes":..., "outBytes":..., "responses":{ "miss":..., "bypass":..., "expired":..., "stale":..., "updating":..., "revalidated":..., "hit":..., "scarce":... } }, ... } }
*
) and hit ratiovhost_traffic_status_filter_by_set_key
directive*
) and hit ratio filtered through the vhost_traffic_status_filter_by_set_key
directiveThe overCounts
objects in JSON document are mostly for 32bit system and will be increment by 1 if its value is overflowed. The directive vhost_traffic_status_display_format
sets the default ouput format that is one of json, jsonp, html, prometheus. (Default: json)
Traffic calculation as follows:
All calculations are working in log processing phase of Nginx. Internal redirects(X-Accel-Redirect or error_page) does not calculate in the UpstreamZones.
Caveats:
this module relies on nginx logging system(NGX_HTTP_LOG_PHASE:last phase of the nginx http), so the traffic may be in certain cirumstances different that real bandwidth traffic. Websocket, canceled downloads may be cause of inaccuracies. The working of the module doesn't matter at all whether the access_log directive "on" or "off". Again, this module works well on "access_log off". When using several domains it sets to be first domain(left) of server_name directive. If you don't want it, see the vhost_traffic_status_filter_by_host, vhost_traffic_status_filter_by_set_key directive.
See the following modules for the stream
traffic statistics:
It is able to reset or delete traffic zones through a query string. The request responds with a JSON document.
{status_uri}
/control?cmd={command}
&group={group}
&zone={name}
http { geoip_country /usr/share/GeoIP/GeoIP.dat; vhost_traffic_status_zone; vhost_traffic_status_filter_by_set_key $geoip_country_code country::*; ... server { server_name example.org; ... vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
If it set as above, then the control uri is like example.org/status/control
.
The available request arguments are as follows:
status
|reset
|delete
>status/format/json
.server
|filter
|upstream@alone
|upstream@group
|cache
|*
>This is similar to the status/format/json
except that it can get each zones.
status/format/json
.The mainZones values are default status values including hostName
, nginxVersion
, loadMsec
, nowMsec
, connections
.
name
filter_group
@name
upstream_group
@name
name
name
It reset the values of specified zones to 0.
name
filter_group
@name
upstream_group
@name
name
name
It delete the specified zones in shared memory.
name
filter_group
@name
upstream_group
@name
name
name
It can get the status values in nginx configuration separately using vhost_traffic_status_set_by_filter
directive. It can acquire almost all status values and the obtained value is stored in user-defined-variable which is first argument.
http { geoip_country /usr/share/GeoIP/GeoIP.dat; vhost_traffic_status_zone; vhost_traffic_status_filter_by_set_key $geoip_country_code country::*; ... upstream backend { 10.10.10.11:80; 10.10.10.12:80; } server { server_name example.org; ... vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; vhost_traffic_status_set_by_filter $requestCounter server/example.org/requestCounter; vhost_traffic_status_set_by_filter $requestCounterKR filter/country::example.org@KR/requestCounter; location /backend { vhost_traffic_status_set_by_filter $requestCounterB1 upstream@group/backend@10.10.10.11:80/requestCounter; proxy_pass http://backend; } } }
The above settings are as follows:
Please see the vhost_traffic_status_set_by_filter directive for detailed usage.
The following status information is provided in the JSON format:
/{status_uri}
/format/json
/{status_uri}
/control?cmd=status&...
vhost_traffic_status
)vhost_traffic_status_histogram_buckets
directive.serverZones
except that it included group names.vhost_traffic_status_histogram_buckets
directive.vhost_traffic_status_histogram_buckets
directive.weight
setting of the server.max_fails
setting of the server.fail_timeout
setting of the server.backup
setting of the server.down
setting of the server. Basically, this is just a mark the ngx_http_upstream_module's server down(eg. server backend3.example.com down
), not actual upstream server state. It will changed to actual state if you enabled the upstream zone directive./{status_uri}
/control?cmd=reset&...
/{status_uri}
/control?cmd=delete&...
The following embedded variables are provided:
It is able to limit total traffic per each host by using the directive vhost_traffic_status_limit_traffic
. It also is able to limit all traffic by using the directive vhost_traffic_status_limit_traffic_by_set_key
. When the limit is exceeded, the server will return the 503 (Service Temporarily Unavailable) error in reply to a request. The return code can be changeable.
http { vhost_traffic_status_zone; ... server { server_name *.example.org; vhost_traffic_status_limit_traffic in:64G; vhost_traffic_status_limit_traffic out:1024G; ... } }
*.example.org
to 64G and 1024G respectively. It works individually per each domain if vhost_traffic_status_filter_by_host
directive is enabled.http { geoip_country /usr/share/GeoIP/GeoIP.dat; vhost_traffic_status_zone; ... server { server_name example.org; vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; vhost_traffic_status_limit_traffic_by_set_key FG@country::$server_name@US out:1024G; vhost_traffic_status_limit_traffic_by_set_key FG@country::$server_name@CN out:2048G; ... } }
example.org
to 1024G and 2048G respectively.http { vhost_traffic_status_zone; ... upstream backend { server 10.10.10.17:80; server 10.10.10.18:80; } server { server_name example.org; location /backend { vhost_traffic_status_limit_traffic_by_set_key UG@backend@10.10.10.17:80 in:512G; vhost_traffic_status_limit_traffic_by_set_key UG@backend@10.10.10.18:80 in:1024G; proxy_pass http://backend; } ... } }
example.org
to 512G and 1024G per each peer.Caveats:
Traffic is the cumulative transfer or counter, not a bandwidth.
It is able to calculate the user defined individual stats by using the directive vhost_traffic_status_filter_by_set_key
.
http { geoip_country /usr/share/GeoIP/GeoIP.dat; vhost_traffic_status_zone; vhost_traffic_status_filter_by_set_key $geoip_country_code country::*; ... server { ... vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
Basically, country flags image is built-in in HTML. The country flags image is enabled if the country
string is included in group name which is second argument of vhost_traffic_status_filter_by_set_key
directive.
http { vhost_traffic_status_zone; ... server { ... location ~ ^/storage/(.+)/.*$ { set $volume $1; vhost_traffic_status_filter_by_set_key $volume storage::$server_name; } location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
http { vhost_traffic_status_zone; map $http_user_agent $filter_user_agent { default 'unknown'; ~iPhone ios; ~Android android; ~(MSIE|Mozilla) windows; } vhost_traffic_status_filter_by_set_key $filter_user_agent agent::*; ... server { ... vhost_traffic_status_filter_by_set_key $filter_user_agent agent::$server_name; location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
http_user_agent
http { vhost_traffic_status_zone; server { ... vhost_traffic_status_filter_by_set_key $status $server_name; location /status { vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
http status code
Caveats:
$status variable is available in nginx-(1.3.2, 1.2.2).
If the domain has multiple DNS A records, you can calculate traffic for individual IPs for the domain using the filter feature or a variable in proxy_pass.
http { vhost_traffic_status_zone; upstream backend { elb.example.org:80; } ... server { ... location /backend { vhost_traffic_status_filter_by_set_key $upstream_addr upstream::backend; proxy_pass backend; } } }
elb.example.org
. If elb.example.org
has multiple DNS A records, will be display all IPs in filterZones
. In the above settings, as NGINX starts up or reloads it configuration, it queries a DNS server to resolve domain and DNS A records is cached in memory. Therefore the DNS A records are not changed in memory even if DNS A records are chagned by DNS administrator unless NGINX re-starts up or reloads.http { vhost_traffic_status_zone; resolver 10.10.10.53 valid=10s ... server { ... location /backend { set $backend_server elb.example.org; proxy_pass http://$backend_server; } } }
elb.example.org
. If elb.example.org
's DNS A record is changed, will be display both the old IP and the new IP in ::nogroups
. Unlike the first upstream group setting, the second setting works well even if DNS A records are chagned by DNS administrator.Caveats:
Please more details about NGINX DNS see the dns-service-discovery-nginx-plus.
http { vhost_traffic_status_zone; ... server { ... location /status { vhost_traffic_status_bypass_limit on; vhost_traffic_status_bypass_stats on; vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
/status
uri is excluded from the status traffic calculation and limit feature. See the following directives:http { vhost_traffic_status_zone; vhost_traffic_status_dump /var/log/nginx/vts.db; ... server { ... } }
vhost_traffic_status_dump
directive maintains statistics data permanently even if system has been rebooted or nginx has been restarted. Please see the vhost_traffic_status_dump directive for detailed usage.{{uri}}
string to your status uri in status.template.html as follows:shell> vi share/status.template.html
var vtsStatusURI = "yourStatusUri/format/json", vtsUpdateInterval = 1000;
shell> cp share/status.template.html /usr/share/nginx/html/status.html
nginx.conf
server { server_name example.org; root /usr/share/nginx/html; # Redirect requests for / to /status.html location = / { return 301 /status.html; } location = /status.html {} # Everything beginning /status (except for /status.html) is # processed by the status handler location /status { vhost_traffic_status_display; vhost_traffic_status_display_format json; } }
http://example.org/status.html
Modify share/status.template.html
(Do not change {{uri}}
string)
Recreate the ngx_http_vhost_traffic_status_module_html.h
as follows:
shell> cd util
shell> ./tplToDefine.sh ../share/status.template.html > ../src/ngx_http_vhost_traffic_status_module_html.h
Add the module to the build configuration by adding --add-module=/path/to/nginx-module-vts
Build the nginx binary.
Install the nginx binary.
- | - |
---|---|
Syntax | vhost_traffic_status <on|off> |
Default | off |
Context | http, server, location |
Description:
Enables or disables the module working. If you set vhost_traffic_status_zone
directive, is automatically enabled.
- | - |
---|---|
Syntax | vhost_traffic_status_zone [shared:name:size] |
Default | shared:vhost_traffic_status:1m |
Context | http |
Description:
Sets parameters for a shared memory zone that will keep states for various keys. The cache is shared between all worker processes. In most cases, the shared memory size used by nginx-module-vts does not increase much. The shared memory size is increased pretty when using vhost_traffic_status_filter_by_set_key
directive but if filter's keys are fixed(eg. the total number of the country code is about 240) it does not continuously increase.
If you use vhost_traffic_status_filter_by_set_key
directive, set it as follows:
vhost_traffic_status_zone shared:vhost_traffic_status:32m
)"ngx_slab_alloc() failed: no memory in vhost_traffic_status_zone"
) printed in error_log, increase to more than (usedSize * 2).- | - |
---|---|
Syntax | vhost_traffic_status_dump path [period] |
Default | - |
Context | http |
Description:
Enables the statistics data dump and restore. The path is a location to dump the statistics data.(e.g. /var/log/nginx/vts.db
) The period is a backup cycle time.(Default: 60s) It is backed up immediately regardless of the backup cycle if nginx is exited by signal(SIGKILL
).
- | - |
---|---|
Syntax | vhost_traffic_status_display |
Default | - |
Context | http, server, location |
Description:
Enables or disables the module display handler.
- | - |
---|---|
Syntax | vhost_traffic_status_display_format <json|html|jsonp|prometheus> |
Default | json |
Context | http, server, location |
Description:
Sets the display handler's output format. If you set json
, will respond with a JSON document. If you set html
, will respond with the built-in live dashboard in HTML. If you set jsonp
, will respond with a JSONP callback function(default: ngx_http_vhost_traffic_status_jsonp_callback). If you set prometheus
, will respond with a prometheus document.
- | - |
---|---|
Syntax | vhost_traffic_status_display_jsonp callback |
Default | ngx_http_vhost_traffic_status_jsonp_callback |
Context | http, server, location |
Description:
Sets the callback name for the JSONP.
- | - |
---|---|
Syntax | vhost_traffic_status_display_sum_key name |
Default | * |
Context | http, server, location |
Description:
Sets the sum key string in serverZones field's JSON. The default sum key string is the "*".
- | - |
---|---|
Syntax | vhost_traffic_status_filter <on|off> |
Default | on |
Context | http, server, location |
Description:
Enables or disables the filter features.
- | - |
---|---|
Syntax | vhost_traffic_status_filter_by_host <on|off> |
Default | off |
Context | http, server, location |
Description:
Enables or disables the keys by Host header field. If you set on
and nginx's server_name directive set several or wildcard name starting with an asterisk, e.g. “*.example.org” and requested to server with hostname such as (a|b|c).example.org or *.example.org then json serverZones is printed as follows:
server { server_name *.example.org; vhost_traffic_status_filter_by_host on; ... }
... "serverZones": { "a.example.org": { ... }, "b.example.org": { ... }, "c.example.org": { ... } ... }, ...
It provides the same function that set vhost_traffic_status_filter_by_set_key $host
.
- | - |
---|---|
Syntax | vhost_traffic_status_filter_by_set_key key [name] |
Default | - |
Context | http, server, location |
Description:
Enables the keys by user defined variable. The key is a key string to calculate traffic. The name is a group string to calculate traffic. The key and name can contain variables such as $host, $server_name. The name's group belongs to filterZones
if specified. The key's group belongs to serverZones
if not specified second argument name. The example with geoip module is as follows:
server { server_name example.org; vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; ... }
... "serverZones": { ... }, "filterZones": { "country::example.org": { "KR": { "requestCounter":..., "inBytes":..., "outBytes":..., "responses":{ "1xx":..., "2xx":..., "3xx":..., "4xx":..., "5xx":..., "miss":..., "bypass":..., "expired":..., "stale":..., "updating":..., "revalidated":..., "hit":..., "scarce":... }, "requestMsecCounter":..., "requestMsec":..., "requestMsecs":{ "times":[...], "msecs":[...] }, }, "US": { ... }, ... }, ... }, ...
- | - |
---|---|
Syntax | vhost_traffic_status_filter_check_duplicate <on|off> |
Default | on |
Context | http, server, location |
Description:
Enables or disables the deduplication of vhost_traffic_status_filter_by_set_key. It is processed only one of duplicate values(key
+ name
) in each directives(http, server, location) if this option is enabled.
- | - |
---|---|
Syntax | vhost_traffic_status_filter_max_node number [string ...] |
Default | 0 |
Context | http |
Description:
Enables the limit of filter size using the specified number and string values. If the number is exceeded, the existing nodes are deleted by the LRU algorithm. The number argument is the size of the node that will be limited. The default value 0
does not limit filters. The one node is an object in filterZones
in JSON document. The string arguments are the matching string values for the group string value set by vhost_traffic_status_filter_by_set_key
directive. Even if only the first part matches, matching is successful like the regular expression /^string.*/
. By default, If you do not set string arguments then it applied for all filters.
For examples:
$ vi nginx.conf
http { geoip_country /usr/share/GeoIP/GeoIP.dat; vhost_traffic_status_zone; # The all filters are limited to a total of 16 nodes. # vhost_traffic_status_filter_max_node 16 # The `/^uris.*/` and `/^client::ports.*/` group string patterns are limited to a total of 64 nodes. vhost_traffic_status_filter_max_node 16 uris client::ports ... server { server_name example.org; ... vhost_traffic_status_filter_by_set_key $uri uris::$server_name; vhost_traffic_status_filter_by_set_key $remote_port client::ports::$server_name; vhost_traffic_status_filter_by_set_key $geoip_country_code country::$server_name; } }
$ for i in {0..1000}; do curl -H 'Host: example.org' -i "http://localhost:80/test$i"; done
In the above example, the /^uris.*/
and /^client::ports.*/
group string patterns are limited to a total of 16 nodes. The other filters like country::.*
are not limited.
- | - |
---|---|
Syntax | vhost_traffic_status_limit <on|off> |
Default | on |
Context | http, server, location |
Description:
Enables or disables the limit features.
- | - |
---|---|
Syntax | vhost_traffic_status_limit_traffic member:size [code] |
Default | - |
Context | http, server, location |
Description:
Enables the traffic limit for specified member. The member is a member string to limit traffic. The size is a size(k/m/g) to limit traffic. The code is a code to return in response to rejected requests.(Default: 503)
The available member
strings are as follows:
- | - |
---|---|
Syntax | vhost_traffic_status_limit_traffic_by_set_key key member:size [code] |
Default | - |
Context | http, server, location |
Description:
Enables the traffic limit for specified key and member. The key is a key string to limit traffic. The member is a member string to limit traffic. The size is a size(k/m/g) to limit traffic. The code is a code to return in response to rejected requests.(Default: 503)
The key
syntax is as follows:
group
@[subgroup
@]name
The available group
strings are as follows:
subgroup
)subgroup
)The available member
strings are as follows:
The member is the same as vhost_traffic_status_limit_traffic
directive.
- | - |
---|---|
Syntax | vhost_traffic_status_limit_check_duplicate <on|off> |
Default | on |
Context | http, server, location |
Description:
Enables or disables the deduplication of vhost_traffic_status_limit_by_set_key. It is processed only one of duplicate values(member
| key
+ member
) in each directives(http, server, location) if this option is enabled.
- | - |
---|---|
Syntax | vhost_traffic_status_set_by_filter $variable group/zone/name |
Default | - |
Context | http, server, location, if |
Description:
Get the specified status value stored in shared memory. It can acquire almost all status values and the obtained value is stored in $variable which is first argument.
Caveats:
The name is case sensitive. All return values take the integer type.
For examples:
$requestCounter
server/example.org/requestCounter
$requestCounter
filter/country::example.org@KR/requestCounter
$requestCounter
upstream@group/backend@10.10.10.11:80/requestCounter
$requestCounter
upstream@alone/10.10.10.11:80/requestCounter
$cacheHit
cache/my_cache_name/cacheHit
- | - |
---|---|
Syntax | vhost_traffic_status_average_method <AMM|WMA> [period] |
Default | AMM 60s |
Context | http, server, location |
Description:
Sets the method which is a formula that calculate the average of response processing times. The period is an effective time of the values used for the average calculation.(Default: 60s) If period set to 0, effective time is ignored. In this case, the last average value is displayed even if there is no requests and after the elapse of time. The corresponding values are requestMsec
and responseMsec
in JSON.
- | - |
---|---|
Syntax | vhost_traffic_status_histogram_buckets second ... |
Default | - |
Context | http, server, location |
Description:
Sets the observe buckets to be used in the histograms. By default, if you do not set this directive, it will not work. The second can be expressed in decimal places with a minimum value of 0.001(1ms). The maximum size of the buckets is 32. If this value is insufficient for you, change the NGX_HTTP_VHOST_TRAFFIC_STATUS_DEFAULT_BUCKET_LEN
in the src/ngx_http_vhost_traffic_status_node.h
For examples:
0.005
0.01
0.05
0.1
0.5
1
5
10
0.005
0.01
0.05
0.1
Caveats:
By default, if you do not set this directive, the histogram statistics does not work. The restored histograms by vhost_traffic_status_dump
directive have no affected by changes to the buckets by vhost_traffic_status_histogram_buckets
directive. So you must first delete the zone or the dump file before changing the buckets by vhost_traffic_status_histogram_buckets
directive. Similar to the above, delete the dump file when using the histogram for the first time.
- | - |
---|---|
Syntax | vhost_traffic_status_bypass_limit <on|off> |
Default | off |
Context | http, server, location |
Description:
Enables or disables to bypass vhost_traffic_status_limit
directives. The limit features is bypassed if this option is enabled. This is mostly useful if you want to connect the status web page like /status
regardless of vhost_traffic_status_limit
directives as follows:
http { vhost_traffic_status_zone; ... server { ... location /status { vhost_traffic_status_bypass_limit on; vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
- | - |
---|---|
Syntax | vhost_traffic_status_bypass_stats <on|off> |
Default | off |
Context | http, server, location |
Description:
Enables or disables to bypass vhost_traffic_status
. The traffic status stats features is bypassed if this option is enabled. In other words, it is excluded from the traffic status stats. This is mostly useful if you want to ignore your request in status web page like /status
as follows:
http { vhost_traffic_status_zone; ... server { ... location /status { vhost_traffic_status_bypass_stats on; vhost_traffic_status_display; vhost_traffic_status_display_format html; } } }
Stream traffic status
Prometheus
System protection
YoungJoo.Kim(김영주) [vozltx@gmail.com]
按点赞数排序
按时间排序