node.js - Insert millon data with TypeOrm and Oracle

Question

I am currently having a problem, I need to insert a large amount of data, greater than 100K into an Oracle database from node using TypeOrm. The problem is that when using the ".save ()" method, if the amount of data exceeds 4000 rows, the data is duplicated in Oracle and I do not understand the reason, besides that it takes too long to insert, approximately 30min in 150K records.

What is the most efficient way to insert a large amount of data in a small amount of time?

question from:https://stackoverflow.com/questions/65545987/insert-millon-data-with-typeorm-and-oracle

Answer 1

Bulk inserts can be performed according to the documentation here:

import {getConnection} from "typeorm";

await getConnection()
    .createQueryBuilder()
    .insert()
    .into(User)
    .values([
        { firstName: "Timber", lastName: "Saw" }, 
        { firstName: "Phantom", lastName: "Lancer" }
     ])
    .execute();

This is the most efficient way in terms of performance to insert rows into your database. You can also perform bulk insertions this way.

I'm not sure about the duplicate issue you are facing.