命令行curl可以使用-D选项显示响应标头,但我想看看它发送的是什么请求标头。我该怎么做?
-D
curl的-v或--verbose选项显示HTTP请求标头等。这是一些示例输出:
-v
--verbose
$ curl -v http://google.com/ * About to connect() to google.com port 80 (#0) * Trying 66.102.7.104... connected * Connected to google.com (66.102.7.104) port 80 (#0) > GET / HTTP/1.1 > User-Agent: curl/7.16.4 (i386-apple-darwin9.0) libcurl/7.16.4 OpenSSL/0.9.7l zlib/1.2.3 > Host: google.com > Accept: */* > < HTTP/1.1 301 Moved Permanently < Location: http://www.google.com/ < Content-Type: text/html; charset=UTF-8 < Date: Thu, 15 Jul 2010 06:06:52 GMT < Expires: Sat, 14 Aug 2010 06:06:52 GMT < Cache-Control: public, max-age=2592000 < Server: gws < Content-Length: 219 < X-XSS-Protection: 1; mode=block < <HTML><HEAD><meta http-equiv="content-type" content="text/html;charset=utf-8"> <TITLE>301 Moved</TITLE></HEAD><BODY> <H1>301 Moved</H1> The document has moved <A HREF="http://www.google.com/">here</A>. </BODY></HTML> * Connection #0 to host google.com left intact * Closing connection #0
详细选项很方便,但如果您想查看curl所做的一切(包括传输的HTTP主体,而不仅仅是标头),我建议使用以下选项之一:
--trace-ascii -
--trace-ascii output_file.txt
我相信您要传递给curl的命令行开关是-I。
-I
示例用法:
$ curl -I http://heatmiser.counterhack.com/zone-5-15614E3A-CEA7-4A28-A85A-D688CC418287 HTTP/1.1 301 Moved Permanently Date: Sat, 29 Dec 2012 15:22:05 GMT Server: Apache Location: http://heatmiser.counterhack.com/zone-5-15614E3A-CEA7-4A28-A85A-D688CC418287/ Content-Type: text/html; charset=iso-8859-1
此外,如果您遇到响应HTTP状态代码301,您可能还想传递一个-L参数开关来告诉curl遵循URL重定向,并且在这种情况下,打印所有页面的标题(包括URL重定向),如下所示:
-L
curl
$ curl -I -L http://heatmiser.counterhack.com/zone-5-15614E3A-CEA7-4A28-A85A-D688CC418287 HTTP/1.1 301 Moved Permanently Date: Sat, 29 Dec 2012 15:22:13 GMT Server: Apache Location: http://heatmiser.counterhack.com/zone-5-15614E3A-CEA7-4A28-A85A-D688CC418287/ Content-Type: text/html; charset=iso-8859-1 HTTP/1.1 302 Found Date: Sat, 29 Dec 2012 15:22:13 GMT Server: Apache Set-Cookie: UID=b8c37e33defde51cf91e1e03e51657da Location: noaccess.php Content-Type: text/html HTTP/1.1 200 OK Date: Sat, 29 Dec 2012 15:22:13 GMT Server: Apache Content-Type: text/html
在调试Web应用程序时,我必须自己克服这个问题。-v很棒,但对我的口味来说也有点冗长。这是我想出的(仅限bash)解决方案:
curl -v http://example.com/ 2> >(sed '/^*/d')
这之所以有效,是因为-v的输出被发送到stderr,而不是stdout。通过将其重定向到子shell,我们可以sed删除以*开头的行。由于实际输出不通过子shell,因此不受影响。使用子shell有点麻烦,但这是将stderr重定向到另一个命令的最简单方法。(正如我所说,我只在测试中使用它,所以对我来说效果很好。)
sed
*
curl的-v选项在包含前导*(状态行)或>(请求头字段)或<(响应头字段)的错误输出中过于冗长。
>
<
curl -v -sS www.stackoverflow.com 2>&1 >/dev/null | grep '>' | cut -c1-2 --complement
仅获取请求头字段:
curl -v -sS www.stackoverflow.com 2>&1 >/dev/null | grep '<' | cut -c1-2 --complement
或者使用-D选项将其转储到/tmp/test.txt文件中
/tmp/test.txt
curl -D /tmp/test.txt -sS www.stackoverflow.com > /dev/null
为了过滤-v输出,您应该将错误输出引导到终端并将std输出引导到 /dev/null,-s选项是禁止进度计量
显示响应标头的流行答案,但OP询问请求标头。
curl -s -D - -o /dev/null http://example.com
-s
-D -
-
-o /dev/null
这比-I更好,因为它不发送HEAD请求,这可能会产生不同的结果。
HEAD
它比-v更好,因为你不需要那么多的黑客来取消它。
您可以使用以下命令获得一个不错的标头输出:
curl -L -v -s -o /dev/null google.de
-L, --location
-v, --verbose
-s, --silent
-o, --output /dev/null
或者更短的版本:
curl -Lvso /dev/null google.de
结果在:
* Rebuilt URL to: google.de/ * Trying 2a00:1450:4008:802::2003... * Connected to google.de (2a00:1450:4008:802::2003) port 80 (#0) > GET / HTTP/1.1 > Host: google.de > User-Agent: curl/7.43.0 > Accept: */* > < HTTP/1.1 301 Moved Permanently < Location: http://www.google.de/ < Content-Type: text/html; charset=UTF-8 < Date: Fri, 12 Aug 2016 15:45:36 GMT < Expires: Sun, 11 Sep 2016 15:45:36 GMT < Cache-Control: public, max-age=2592000 < Server: gws < Content-Length: 218 < X-XSS-Protection: 1; mode=block < X-Frame-Options: SAMEORIGIN < * Ignoring the response-body { [218 bytes data] * Connection #0 to host google.de left intact * Issue another request to this URL: 'http://www.google.de/' * Trying 2a00:1450:4008:800::2003... * Connected to www.google.de (2a00:1450:4008:800::2003) port 80 (#1) > GET / HTTP/1.1 > Host: www.google.de > User-Agent: curl/7.43.0 > Accept: */* > < HTTP/1.1 200 OK < Date: Fri, 12 Aug 2016 15:45:36 GMT < Expires: -1 < Cache-Control: private, max-age=0 < Content-Type: text/html; charset=ISO-8859-1 < P3P: CP="This is not a P3P policy! See https://www.google.com/support/accounts/answer/151657?hl=en for more info." < Server: gws < X-XSS-Protection: 1; mode=block < X-Frame-Options: SAMEORIGIN < Set-Cookie: NID=84=Z0WT_INFoDbf_0FIe_uHqzL9mf3DMSQs0mHyTEDAQOGY2sOrQaKVgN2domEw8frXvo4I3x3QVLqCH340HME3t1-6gNu8R-ArecuaneSURXNxSXYMhW2kBIE8Duty-_w7; expires=Sat, 11-Feb-2017 15:45:36 GMT; path=/; domain=.google.de; HttpOnly < Accept-Ranges: none < Vary: Accept-Encoding < Transfer-Encoding: chunked < { [11080 bytes data] * Connection #1 to host www.google.de left intact
正如您所看到的curl输出传出和传入的标头,并跳过主体数据,尽管它告诉您主体有多大。
此外,每一行的方向都有指示,以便易于阅读。我发现追踪长链的重定向特别有用。
如果您想要更多替代方案,您可以尝试安装像HTTPIE这样的现代命令行HTTP客户端,它适用于大多数具有brew、apt-get、pip、yum等包管理器的操作系统
例如:-对于OSX
brew install httpie
然后您可以在命令行上使用各种选项使用它
http GET https://www.google.com
像下面这样的命令将显示三个部分:请求标头、响应标头和数据(由CRLF分隔)。它避免了curl添加的技术信息和语法噪音。
curl -vs www.stackoverflow.com 2>&1 | sed '/^* /d; /bytes data]$/d; s/> //; s/< //'
该命令将产生以下输出:
GET / HTTP/1.1 Host: www.stackoverflow.com User-Agent: curl/7.54.0 Accept: */* HTTP/1.1 301 Moved Permanently Content-Type: text/html; charset=UTF-8 Location: https://stackoverflow.com/ Content-Length: 149 Accept-Ranges: bytes Date: Wed, 16 Jan 2019 20:28:56 GMT Via: 1.1 varnish Connection: keep-alive X-Served-By: cache-bma1622-BMA X-Cache: MISS X-Cache-Hits: 0 X-Timer: S1547670537.588756,VS0,VE105 Vary: Fastly-SSL X-DNS-Prefetch-Control: off Set-Cookie: prov=e4b211f7-ae13-dad3-9720-167742a5dff8; domain=.stackoverflow.com; expires=Fri, 01-Jan-2055 00:00:00 GMT; path=/; HttpOnly <head><title>Document Moved</title></head> <body><h1>Object Moved</h1>This document may be found <a HREF="https://stackoverflow.com/">here</a></body>
问题描述
-vs
2>&1
/^* /d
/bytes data]$/d
s/> //
s/< //