Python实现Request Headers参数格式化（添加引号和逗号）

发表于 更新于 分类于

在使用 Python 爬虫时，需要将浏览器复制下来的 Request Headers 参数给它加上引号和逗号，如果参数过多，手动添加的效率就会很低。本文使用字符串的 splitlines() 和 replace() 方法一键格式化

说明

这是浏览器复制下来的 Request Headers：

1
2
3
4
5
6
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Accept-Encoding: gzip, deflate, br
Accept-Language: zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6
Host: www.gaoyuanqi.cn
sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="101", "Microsoft Edge";v="101"
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.53

给它格式化成以下效果：

1
2
3
4
5
6
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
'Accept-Encoding': 'gzip, deflate, br',
'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
'Host': 'www.gaoyuanqi.cn',
'sec-ch-ua': '" Not A;Brand";v="99", "Chromium";v="101", "Microsoft Edge";v="101"',
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.53',

变化的地方有：

  • 每行首尾分别添加 ' 、',
  • : 替换为 ': '

代码

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
headers_str = '''
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Accept-Encoding: gzip, deflate, br
Accept-Language: zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6
Host: www.gaoyuanqi.cn
sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="101", "Microsoft Edge";v="101"
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.53
'''

# 返回由原字符串中各行组成的列表，在行边界的位置拆分
headers_list = headers_str.splitlines()
for str in headers_list:
    if str:
        str_1 = str.replace(": ", "': '")  # 替换字符串
        str_2 = f'\'{str_1}\','            # 拼接字符串
        print(str_2)

输出如下：

1
2
3
4
5
6
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
'Accept-Encoding': 'gzip, deflate, br',
'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
'Host': 'www.gaoyuanqi.cn',
'sec-ch-ua': '" Not A;Brand";v="99", "Chromium";v="101", "Microsoft Edge";v="101"',
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.53',

使用Web服务

格式化更方便的方式是使用 Web 服务，这是 Django 框架搭建的web：

返回的结果如下：
python-headers-1