python - mongodb: unreasonable slow query, with index and simple documents -


i using python , mongodb, need query documents database , save information documents, code :

for trips in trip.find({},{'latlng_start':1, 'latlng_end':1, 'trip_data':1, 'trip_id':1}).batch_size(500):     orig_coord = trips['latlng_start']['coordinates']     dest_coord = trips['latlng_end']['coordinates']     cell_start = citymap.find({"trips_orig": {"$exists": true},"cell_latlng":{"$geointersects":{"$geometry":{"type":"point", "coordinates":orig_coord}}}})     cell_end = citymap.find({"trips_dest": {"$exists": true},"cell_latlng":{"$geointersects":{"$geometry":{"type":"point", "coordinates":dest_coord}}}})      if cell_start.count() == 1 , cell_end.count() == 1 , cell_start[0]['big_cell8']['poi'] != {} , cell_end[0]['big_cell8']['poi'] != {}:         try:             labels_raw.append(purpose_mapping[trips['trip_data']['purpose']])                        user_ids_raw.append(int(trips['trip_id'][:10]))                      venue_feature_start.append([cell_start[0]['big_cell8']['poi'], orig_coord])             venue_feature_end.append([cell_end[0]['big_cell8']['poi'], dest_coord])          except:             continue      else:         continue

i have assigned 2dsphere index collection citymap , indexes of collection are:

[     {         "v" : 1,         "key" : {             "_id" : 1         },         "name" : "_id_",         "ns" : "cityseg2014.grid750"     },     {         "v" : 1,         "key" : {             "latlng" : "2dsphere"         },         "name" : "latlng_2dsphere",         "ns" : "cityseg2014.grid750",         "2dsphereindexversion" : 2     },     {         "v" : 1,         "key" : {             "cell_latlng" : "2dsphere"         },         "name" : "cell_latlng_2dsphere",         "ns" : "cityseg2014.grid750",         "2dsphereindexversion" : 2     },     {         "v" : 1,         "key" : {             "_fts" : "text",             "_ftsx" : 1         },         "name" : "trips_dest_text_trips_orig_text",         "ns" : "cityseg2014.grid750",         "weights" : {             "trips_dest" : 1,             "trips_orig" : 1         },         "default_language" : "english",         "language_override" : "language",         "textindexversion" : 2     } ]

the problem that, although there 47000 trips , citymap contains 11600 documents, query takes 3000 seconds!!! morning when run same program takes 800 seconds. have no idea why happen. idea improve efficiency?


Comments

Post a Comment

Popular posts from this blog

IF statement in MySQL trigger -

this query code in mysql trigger. if 1=2 select 'yes'; else select 'no'; end if; but has following error: if '1'='2' select 'yes' error code: 1064. have error in sql syntax; check manual corresponds mysql server version right syntax use near 'if '1'='2' select 'yes'' @ line 1 0.000 sec what solution?
Read more

c++ - What does MSC in "// appease MSC" comments mean? -

i run across // appease msc in c++ comments, e.g. here : const int& array::operator[](int offset) const { int mysize = getitssize(); if (offset >= 0 && offset < getitssize()) return ptype[offset]; throw xboundary(); return ptype[offset]; // appease msc! } what msc stand ? the author means microsoft's compiler, more formally known msvc.
Read more

android - MPAndroidChart - How to add Annotations or images to the chart -

i working latest mpandroidchart library , looking way add annotations or images clickable. example: once data reaches value event occurs want able display user - there multiple events can occur annotations (not sure if right word) or image added @ point in chart. any pointers welcome. check documentation of yaxis . focus on setspacetop(...) , setaxismaxvalue(...) methods. for background: bar-shadow , disable calling: barchart.setdrawbarshadow(false) or change color: bardataset.setbarshadowcolor(int color)
Read more