省市区三级行政区数据获取和GeoJson地图下载

文章目录

1.背景
2.行政区域数据获取
3.获取GeoJson数据

1.背景

项目中用到省市区三级的行政区划的选择，在网上找到的数据与最新的行政区域划分不一致，也难以确认数据的完成性。

基于echarts完成数据地区分布图时，需要提供地区对应的geoJson格式地图。

2.行政区域数据获取

高德开放平台提供了丰富数据API，其中行政区域信息可通过以下接口：
https://restapi.amap.com/v3/config/district?keywords=中国&subdistrict=3&key=5b138cc729f37d29702ff904ca9cedeb

接口获取的数据是按照行政等级多层嵌套，为了方便后续操作，将数据转化为了List。
以下代码将行政区划转化为List并添加了id和parent_id，同时保存为json数组(area_dict.json)和MySQL数据库脚本(area_dict.sql)。

#-*-coding:UTF-8-*-
"""
Author: Gray Snail
Date: 2020-06-30最新行政区划获取
基于高德地图API获取数据
https://restapi.amap.com/v3/config/district?keywords=中国&subdistrict=3&key=5b138cc729f37d29702ff904ca9cedeb"""
import json
import requestsdef parse_district(districtObj : dict, idx=1, parent_id=0):res = []if 'name' in districtObj.keys():if districtObj['level'] == 'street':return reslng, lat = districtCenter(districtObj['center'])level = districtLevel(districtObj['level'])citycode = districtObj['citycode'] if isinstance(districtObj['citycode'], str) else ''# {"citycode":"0379","adcode":"410300","name":"洛阳市","center":"112.434468,34.663041","level":"city"}# idx, districtObj['adcode'], districtObj['name'], level, citycode, lng, lat, parent_iditem = {'id'        : idx,'adcode'    : districtObj['adcode'],'name'      : districtObj['name'],'level'     : level,'citycode'  : citycode,'lng'       : lng,'lat'       : lat,'parent_id' : parent_id}res.append(item)parent_id = idxidx = idx + 1if isinstance(districtObj.get('districts'), list) and len(districtObj['districts']) > 0:for subitem in districtObj['districts']:subs = parse_district(subitem, idx, parent_id)res += subsidx += len(subs)return resdef districtLevel(levelStr):map_val = {'country': 0,'province': 1,'city': 2,'district': 3}return map_val[levelStr]def districtCenter(center):items = center.split(',')return float(items[0]), float(items[1])# 结果保存为json数组
def saveJson(data):with open('area_dict.json', 'w', encoding='utf-8') as fp:json.dump(data, fp, ensure_ascii=False, indent=4)print('Save json file: area_dict.json')# 保存为SQL脚本
def saveSqlFile(data, includeCreate=True):# +--------------+-------------+------+-----+---------+----------------+# | Field        | Type        | Null | Key | Default | Extra          |# +--------------+-------------+------+-----+---------+----------------+# | area_id      | int(11)     | NO   | PRI | NULL    | auto_increment |# | area_code    | char(6)     | NO   | MUL | NULL    |                |# | area_name    | varchar(20) | NO   | MUL | NULL    |                |# | level        | tinyint(1)  | NO   | MUL | 0       |                |# | city_code    | char(4)     | YES  |     | NULL    |                |# | longitudinal | int(11)     | YES  |     | 0       |                |# | lateral      | int(11)     | YES  |     | 0       |                |# | parent_id    | int(11)     | NO   | MUL | -1      |                |# +--------------+-------------+------+-----+---------+----------------+createCode = """
CREATE TABLE `area_dict` (`area_id` int(11) NOT NULL AUTO_INCREMENT COMMENT '地区Id',`area_code` char(6) NOT NULL COMMENT '地区编码',`area_name` varchar(20) NOT NULL COMMENT '地区名',`level` tinyint(1) NOT NULL DEFAULT '0' COMMENT '地区级别（1:省份province,2:市city,3:区县district,4:街道street）',`city_code` char(4) DEFAULT NULL COMMENT '城市编码',`lng` int(11) DEFAULT '0' COMMENT '城市中心经度',`lat` int(11) DEFAULT '0' COMMENT '城市中心纬度',`parent_id` int(11) NOT NULL DEFAULT '-1' COMMENT '地区父节点',PRIMARY KEY (`area_id`),KEY `areaCode` (`area_code`),KEY `parentId` (`parent_id`),KEY `level` (`level`),KEY `areaName` (`area_name`)
) ENGINE=InnoDB AUTO_INCREMENT=3261 DEFAULT CHARSET=utf8 COMMENT='地区码表';
"""with open('area_dict.sql', 'w', encoding='utf-8') as fp:if includeCreate:fp.write(createCode)for item in data:item['lng'] = int(item['lng'] * 1e6)item['lat'] = int(item['lat'] * 1e6)sql = "INSERT INTO area_dict(`area_id`,`area_code`,`area_name`,`level`,`city_code`,`lng`,`lat`,`parent_id`) " + \"VALUES({id},'{adcode}','{name}',{level},'{citycode}',{lng},{lat},{parent_id});\n".format(**item)fp.write(sql)print('Save sql file: area_dict.sql')if __name__ == "__main__":url = 'https://restapi.amap.com/v3/config/district?keywords=中国&subdistrict=3&key=5b138cc729f37d29702ff904ca9cedeb'response = requests.get(url)if response.ok and response.status_code == 200:data = response.json()data = parse_district(data)print('Download data successful, total:{0}!'.format(len(data)))saveJson(data)saveSqlFile(data)else:print('Request error!')

3.获取GeoJson数据

数据来源：基于阿里云datav，数据文件以地区编码命名。
根据行政区域数据中保存的area_dict.json自动下载对应GeoJson文件。

行政区划的更新，两个平台的数据可能存在差异，即同一地区有着不同的地区编码，导致对应地区的地图无法下载。代码中errorCodes记录了未成功下载的地区编码。2020.07.01，未下载成功的不到30条。

#-*-coding:UTF-8-*-
"""
Author: Gray Snail
Date: 2020-06-30GeoJson地图数据下载
基于阿里云datav
http://datav.aliyun.com/tools/atlas
"""
import requests
import json
import osdef loadDistrict(filename):# {"citycode":"0379","adcode":"410300","name":"洛阳市","center":"112.434468,34.663041","level":"city"}data = []with open(filename, 'r', encoding='utf-8') as fp:data = json.load(fp)return datadef saveGeoJson(areaCode, force=False):saveName = 'geo/{0}.json'.format(areaCode)if not force and os.path.isfile(saveName):return None baseUrl = 'https://geo.datav.aliyun.com/areas_v2/bound/{0}_full.json'baseUrl2 = 'https://geo.datav.aliyun.com/areas_v2/bound/{0}.json'if areaCode[-2:] == '00':url = baseUrl.format(areaCode)else:url = baseUrl2.format(areaCode)print(url)response = requests.get(url)if response.ok and response.status_code == 200:res_json = response.json()with open(saveName, 'w', encoding='utf-8') as fp:json.dump(res_json, fp, ensure_ascii=False)else:return areaCodeif __name__ == "__main__":districts = loadDistrict('area_dict.json')errorCodes = []for district in districts:code = saveGeoJson(district['adcode'])if not code is None:errorCodes.append(code)print(errorCodes)