firebase - Firestore Deadline Exceeded Node

Question

I would like to load collection that is ~30k records. I.e load it via.

const db = admin.firestore();
let documentsArray: Array<{}> = [];
db.collection(collection)
  .get()
  .then(snap => {
    snap.forEach(doc => {
      documentsArray.push(doc);
    });
  })
  .catch(err => console.log(err));

This will always throw Deadline Exceeded error. I have searched for some sorts of mechanism that will allow me to paginate trough it but I find it unbelievable not to be able to query for not that big amount in one go.

I was thinking that it may be that due to my rather slow machine I was hitting the limit but then I deployed simple express app that would do the fetching to app engine and still had no luck.

Alternatively I could also export the collection with gcloud beta firestore export but it does not provide JSON data.

Answer 1

Waitting for answers