ReneKMueller.com: Computer Diary *

Here my little rant and praise place, where the daily experiences of my programming work are expressed. I publish them with the idea that others might find it useful and benefit from it.

Title:

Text:
I like to index all my texts (articles, emails) according 'geonames', a database of locations, for that purpose I found a CSV from [http://www.maxmind.com/app/geolitecity|MaxMind.com: GeoliteCity], and started to create a database with DBD::SQLite, and finally made this comparison. The dataset is 12MB, with 235,000 lines: <pre> % wc GeoLiteCity-Location.csv 235422 277043 12450133 GeoLiteCity-Location.csv </pre> <pre> % time grep \"Marseille\" GeoLiteCity-Location.csv 49739,"FR","B8","Marseille","",43.3000,5.4000,, 0.045u 0.090s 0:00.13 100.0% 105+1040k 0+0io 0pf+0w </pre> vs perl with DBD::SQLite, whereas the geonames.db is 14MB in size, and used in a script with <pre> select city,long,lat from cities where city == 'New York' </pre> where as an index was made for city column, then the command line call: <pre> % time ./geotag Marseille Marseille: Marseille, B8, FR: 43.3, 5.4 0.271u 0.062s 0:00.33 100.0% 10+2054k 0+0io 0pf+0w </pre> The computing time is grep 0.090 vs sql 0.062, which is 1/3 faster, but user time was 6 times longer, which is explainable by the overhead to load perl and the required modules. Update: [Geonames.org] seems to have better data with aliases of city names, I used it for a small tool named "geotag", see my [[/Computer_Diary/1240381680/Automatically_Geotag_Photos_without_GPS__Flickr_or_GoogleMaps|post]].
Tags:

Password:

Topics
Kubuntu (5)
MacOSX (4)
UNIX (4)
Lighttpd (3)
Linux (3)
AdBlock Plus (2)
Android (2)
Dell (2)
Firefox (2)
Geonames (2)
Google (2)
MaraDNS (2)
Metadata (2)
Perl (2)
Sqlite (2)
VirtualBox.org (2)
Cellphone (1)
VirtualBox.org (1)
!Flickr (1)
!GoogleMaps (1)
!GPS (1)
Advertisement (1)
AFP (1)
Amrok (1)
Apache2 (1)
App Store (1)
Benchmark (1)
Beta Software (1)
Big Brother (1)
Bind9 (1)
Blackberry (1)
Bloatware (1)
Catch 22 (1)
Cellphone (1)
Cellphone Networks (1)
CGI (1)
Collaboration (1)
Crap (1)
Cygwin (1)
DNS (1)
Donations (1)
DVD/HDD Recorder (1)
Ethics (1)
EXIF (1)
Eye Candy (1)
FastCGI (1)
FUSE (1)
GeoLite (1)
Geotagging (1)
Gestures (1)
GMail (1)
Grep (1)
Hassle (1)
Heuristics (1)
iDeneb (1)
IMAP (1)
Insanity (1)
Internet Explorer (1)
iPhone (1)
iTunes Alike (1)
JavaScript (1)
KDE (1)
Keyboard Mapping (1)
Kinect (1)
Laptop (1)
Location Lookup (1)
LXC (1)
MacOS-X (1)
MacPorts.org (1)
Markup (1)
Medion Life (1)
Memory Waste (1)
MetaFS (1)
Micropayment (1)
NoGREP (1)
Not Ready (1)
NSD (1)
NTFS (1)
Objective-C (1)
Old Laptop (1)
Open Source Software (1)
OpenStreetMap (1)
Opera (1)
Paypal (1)
PhoneGap (1)
QuickConnect (1)
Rant (1)
Review (1)
Server Farm (1)
Servers (1)
Smartphone (1)
Systemic Limitation (1)
Thieves (1)
Thunderbird (1)
Ubuntu (1)
Useability (1)
Virtualization (1)
VMWare Fusion (1)
WebServer (1)
Windows 7 (1)
Windows XP (1)
XBMC (1)
XML (1)

.:.