Improve throughput of ndb query over large data

前端 未结 3 1631
余生分开走
余生分开走 2021-02-04 21:16

I am trying to perform some data processing in a GAE application over data that is stored in the Datastore. The bottleneck point is the throughput in which the query returns ent

3条回答
  •  佛祖请我去吃肉
    2021-02-04 21:37

    The new experimental Data Processing feature (an AppEngine API for MapReduce) might be suitable. It uses automatic sharding to execute multiple parallel worker processes, which may or may not help (like the Approach C in the other linked question).

提交回复
热议问题