Error while uploading JSON data from local linux vm to ElasticSearch (status:400)

Question

I have a json dataset in the given form and wish to upload it to Elastic search from my local virtual machine via curl command.

This is a Csv file converted to Json. I now wish to import the entire file from my linux Vm to Elasticsearch and I use the following curl command.

$ curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/bank/_bulk?pretty' --data-binary @Bank_adv.json

I end up with the following error:

{ "error" : { "root_cause" : [ { "type" : "json_e_o_f_exception", "reason" : "Unexpected end-of-input: expected close marker for Object (start marker at [Source: (byte[])" { "CUSTOMER_ID":

Here is the full screenshot. My elasticsearch node is up and running fine on port 9200 so i don't think it is a connection issue but a data issue. This is the only format by which I can use this Json data so if there is a way I can modify it to be able to be uploaded it would help.

question from:https://stackoverflow.com/questions/66047262/error-while-uploading-json-data-from-local-linux-vm-to-elasticsearch-status400

Answer 1

You will have to properly restructure you input data file to follow elasticsearch's bulk index format.

If your curl looks like:

curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/bank/_bulk?pretty' --data-binary @Bank_adv.json

then you will need to structure your file so that it looks like this:

{"index":{}}
{"text": "hello world"}
{"index":{}}
{"text": "goodbye"}

You need the index directive before each document. Each document must be on a single line.