这篇文章中的内容是来源于去年我用美国的vps搭建博客的初始阶段,那是有很多恶意访问,我就根据access log中的源ip来进行了很多统计,同时我也将访问量最高的恶意访问的源ip拿来查询其地理位置信息。所以,我就用到了根据ip查询地理位置信息的一些东西,现在将这方面积累的一点东西共享出来。
根据ip查询所在地、运营商等信息的一些api如下(根据我有限的一点经验):1. 淘宝的api(推荐):http://ip.taobao.com/service/getipinfo.php?ip=110.84.0.1292. 国外freegeoip.net(推荐):http://freegeoip.net/json/110.84.0.129 这个还提供了经纬度信息(但不一定准)3. 新浪的api:http://int.dpool.sina.com.cn/iplookup/iplookup.php?format=json&ip=110.84.0.1294. 腾讯的网页查询:http://ip.qq.com/cgi-bin/searchip?searchip1=110.84.0.1295. ip.cn的网页:http://www.ip.cn/index.php?ip=110.84.0.1296. ip-api.com: http://ip-api.com/json/110.84.0.129 (看起来挺不错的,貌似直接返回中文城市信息,文档在 ip-api.com/docs/api:json)7. http://www.locatorhq.com/ip-to-location-api/documentation.php (这个要注册才能使用,还没用过呢)
(第2个freegeoip.net的网站和ip数据的生成,代码在:https://github.com/fiorix/freegeoip)
为什么其中第4、5两个是网页查询也推荐了呢?是因为两方面原因,一是它们提供的信息比较准,二是使用了页面信息自动抓取(可能会用到我曾经写过的phantomjs)也容易将其写到程序中成为api。
根据ip查询地理位置信息,我将其写成了一个较为通用的python库(提供了前面提到的1、2、4、5等4种查询方式的api),可以根据ip查询到地域信息和isp信息,具体代码见:https://github.com/smilejay/python/blob/master/py2013/iplocation.py注意其中对ip.cn网页的解析用到了webdriver和phantomjs.
代码如下:
#!/usr/bin/python# -*- coding: utf-8 -*-”’created on oct 20, 2013@summary: geography info about an ip address@author: jay http://smilejay.com/”’import json, urllib2import refrom selenium import webdriverfrom selenium.webdriver.common.desired_capabilities import desiredcapabilities class location_freegeoip(): ”’build the mapping of the ip address and its location.the geo info is from ”’ def __init__(self, ip): ”’constructor of location_freegeoip class”’ self.ip = ip self.api_format = ‘json’ self.api_url = ‘http://freegeoip.net/%s/%s’ % (self.api_format, self.ip) def get_geoinfo(self): “”” get the geo info from the remote api.return a dict about the location.””” urlobj = urllib2.urlopen(self.api_url) data = urlobj.read() datadict = json.loads(data, encoding=’utf-8′)# print datadict return datadict def get_country(self): key = ‘country_name’ datadict = self.get_geoinfo() return datadict[key] def get_region(self): key = ‘region_name’ datadict = self.get_geoinfo() return datadict[key] def get_city(self): key = ‘city’ datadict = self.get_geoinfo() return datadict[key]class location_taobao(): ”’build the mapping of the ip address and its locationthe geo info is from taobaoe.g. http://ip.taobao.com/service/getipinfo.php?ip=112.111.184.63the getipinfo api from taobao returns a json object.”’ def __init__(self, ip): self.ip = ip self.api_url = ‘http://ip.taobao.com/service/getipinfo.php?ip=%s’ % self.ip def get_geoinfo(self): “”” get the geo info from the remote api.return a dict about the location.””” urlobj = urllib2.urlopen(self.api_url) data = urlobj.read() datadict = json.loads(data, encoding=’utf-8′)# print datadict return datadict[‘data’] def get_country(self): key = u’country’ datadict = self.get_geoinfo() return datadict[key] def get_region(self): key = ‘region’ datadict = self.get_geoinfo() return datadict[key] def get_city(self): key = ‘city’ datadict = self.get_geoinfo() return datadict[key] def get_isp(self): key = ‘isp’ datadict = self.get_geoinfo() return datadict[key] class location_qq(): ”’build the mapping of the ip address and its location.the geo info is from tencent.note: the content of the tencent’s api return page is encoded by ‘gb2312′.e.g. http://ip.qq.com/cgi-bin/searchip?searchip1=112.111.184.64”’ def __init__(self, ip): ”’construction of location_ipdotcn class.”’ self.ip = ip self.api_url = ‘http://ip.qq.com/cgi-bin/searchip?searchip1=%s’ % ip def get_geoinfo(self): urlobj = urllib2.urlopen(self.api_url) data = urlobj.read().decode(‘gb2312’).encode(‘utf8′) pattern = re.compile(r’该ip所在地为:(.+)’) m = re.search(pattern, data) if m != none: return m.group(1).split(‘ ‘) else: return none def get_region(self): return self.get_geoinfo()[0] def get_isp(self): return self.get_geoinfo()[1] class location_ipdotcn(): ”’build the mapping of the ip address and its location.the geo info is from www.ip.cnneed to use phantomjs to open the url to render its js”’ def __init__(self, ip): ”’construction of location_ipdotcn class.”’ self.ip = ip self.api_url = ‘http://www.ip.cn/%s’ % ip def get_geoinfo(self): dcap = dict(desiredcapabilities.phantomjs) dcap[“phantomjs.page.settings.useragent”] = ( “mozilla/5.0 (macintosh; intel mac os x 10.9; rv:25.0) gecko/20100101 firefox/29.0 ” ) driver = webdriver.phantomjs(executable_path=’/usr/local/bin/phantomjs’, desired_capabilities=dcap) driver.get(self.api_url) text = driver.find_element_by_xpath(‘//p[@]/p/p’).text res = text.split(‘来自:’)[1].split(‘ ‘) driver.quit() return res def get_region(self): return self.get_geoinfo()[0] def get_isp(self): return self.get_geoinfo()[1] if __name__ == ‘__main__’: ip = ‘110.84.0.129’# iploc = location_taobao(ip)# print iploc.get_geoinfo()# print iploc.get_country()# print iploc.get_region()# print iploc.get_city()# print iploc.get_isp()# iploc = location_qq(ip) iploc = location_ipdotcn(ip)# iploc.get_geoinfo() print iploc.get_region() print iploc.get_isp()